Comments (3)
I was wondering what would be your take on implementing features similar to HMCGibbs for non HMC samplers, such as the brand-new ensemble sampler or the previous SA ?
while numpyro has a pretty sizable set of mcmc kernels at this point, we have generally been more focused on variational inference so we don't have a particularly flexible mcmc kernel api. the right approach would probably be to
- create such an api
- re-implement things like
HMCGibbs
with that API - possibly expose new things like
SAGibbs
or otherwise add tutorials etc that make it clear how to create such custom kernels from smaller components
Also, what would be the approach for doing so with variational inference ?
i don't understand this question
from numpyro.
- create such an api
- re-implement things like HMCGibbs with that API
- possibly expose new things like SAGibbs or otherwise add tutorials etc that make it clear how to create such custom kernels from smaller components
Thank you for your answer, I'll take a look about how feasible this would be on my side
Also, what would be the approach for doing so with variational inference ?
This was a more general question, I am not yet familiar with VI in general. For my specific problem, I have a parameter for which I know the posterior distribution, and I used the HMCGibbs
to sample directly from this distribution, and was wondering on how to expand this knowledge to the case of VI (which is directly sampling from this distribution instead of fitting it with a guide). I may be a dumb question and I am sorry if this is the case, thank you anyway
from numpyro.
well if your goal is to "fix" a distribution in VI you could just set the approximate posterior distribution in the guide
to that distribution (i.e. not learn it) and you'd be done
from numpyro.
Related Issues (20)
- [FR] Truncated Power Law distribution
- An auto guide's `_unpack_latent` and `_unpack_latent._inverse` don't use produce the same order HOT 1
- [FR] Utility for joint distributions HOT 14
- How can I gibbs before HMC/NUTS? HOT 8
- Large potential energy while using `HMCGibbs` at the initial stage HOT 3
- Inference Test Failing HOT 2
- Figure in AR2 example is not reproducible
- Got Problems When Computing Log Likelihoods in a Scan-Based VAR Model HOT 2
- Inference for `gaussian_hmm` is broken on latest jax version (0.4.30) HOT 1
- autocorrelation function HOT 5
- saving render_model() output to the desired file path HOT 5
- Object oriented wrapper API HOT 5
- Stress test utility for numpyro? HOT 2
- Samples are outside the support for DiscreteUniform distribution HOT 3
- Crash when using `TruncatedNormal` in `parallel` MCMC, but not in `sequential` MCMC HOT 5
- `nuts.get_extra_fields()["num_steps"]=0` after warmup HOT 4
- Trouble Initializing Parameters with Highly Degenerate Data HOT 1
- Predictive: better docs for setting obs to `None` HOT 4
- Error in model using CircularReparam when trying to use Predictive HOT 1
- Error when using obs_mask and predictive with different input shape HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from numpyro.