Coder Social home page Coder Social logo

Comments (4)

lalit-pathak avatar lalit-pathak commented on June 3, 2024

So if we define a ball/ellipsoid/cube in the posterior space around the ML point, How do we exactly set the boundaries? In the case of small boundaries, we could get railings in the posteriors, right? In that case, we would either need to repeat the exercise for various boundaries or make an effective fisher matrix covering some given volume of the posterior.

from dynesty.

segasai avatar segasai commented on June 3, 2024

My thinking was that if we define an ellipsoid around the MAP value and then maybe sample from the prior that has 99% of the volume inside the ellipsoid and 1% outside. This way the majority of the sampling will be focused on the ellipsoid, but if there is substatial posterior volume outside, it'll likely still be captured. But this is a vague idea, I am not sure it's implementable.

Specifically if x is parameter within the unit Cube then the posterior is just
$1/Z* L(x) $
, but now if we adopt the prior
$\pi(x)$
so with the volume requirement given above and then we'd sample the posterior of the form
$\pi(x) * (1/z * 1/\pi(x) * L(x))$
This is technically the same posterior as before, but the sampling will mostly avoid low L regions.

The problem is I'm not sure there is a parameter transformation implementing this kind of prior.

from dynesty.

mvsoom avatar mvsoom commented on June 3, 2024

One way of using the MAP approximation is to fit a MVN to it (Laplace approximation) and use that as a proposal distribution, to be incorporated into the prior, much like the expressions in your previous reply. Here is a fine short paper exploring this idea: https://arxiv.org/pdf/2212.01760.pdf.

from dynesty.

lalit-pathak avatar lalit-pathak commented on June 3, 2024

@mvsoom Thanks for posting this nice paper here. I will look into it.

from dynesty.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.