Orbital MCMC
Most MCMC algorithms follow the same procedure1:
- Use a transformation to generate a proposal
- Use a RMH acceptance test
The design of a transfomation is constrained by the fact that it must leave the underlying measure invariant. The Involutive MCMC framework shows that many existing algorithms can be understood as involutions embedded in stochastic transition kernels. This paper extends this work and derives kernels that do not rely on involutions.
Given a deterministic map \(f\) we try to buil the kernel \(k\) that admits the target density as its eigenfunction. First we need to derive the acceptance test.
\[ \operatorname{orb}(x_0) = \left\{f^k(x_0), k \in \mathbb{Z} \right\} \]
Arrive at the conclusion that \(f\) must preserve the measure \(q(x)p(x)\) on \(\operatorname{orb}(x_0)\).
Periodic Orbital MCMC
Starting from the initial state \(x_0\) we would like to traverse \(\operatorname{orb}(x_0)\) and accept \(\{f^k(x_0), k\in\mathbb{Z}\}\) with the weights \(\omega_k\) associated with them.
direction decides how we apply \(f\) to the current state \(x_0\).
Contracting Orbital MCMC
Using Hamiltonian dynamics
Choice of deterministic function \(f\):
- periodic Orbital MCMC: Leapfrog integrator
- contracting Orbital MCMC: Leapfrog integrator with a friction component.
In this case, can it be interpreted as another way (like recycled HMC) to get more samplers out of Hamiltonian trajectories? In this case aren't HMC and recycled HMC particular cases of orbital HMC?