Skip to yearly menu bar Skip to main content


In-Person Poster presentation / top 25% paper

Diffusion Posterior Sampling for General Noisy Inverse Problems

Hyungjin Chung · Jeongsol Kim · Michael McCann · Marc Klasky · Jong Ye

MH1-2-3-4 #74

Keywords: [ inverse problem ] [ diffusion model ] [ Posterior sampling ] [ Generative models ]


Abstract:

Diffusion models have been recently studied as powerful generative inverse problem solvers, owing to their high quality reconstructions and the ease of combining existing iterative solvers. However, most works focus on solving simple linear inverse problems in noiseless settings, which significantly under-represents the complexity of real-world problems. In this work, we extend diffusion solvers to efficiently handle general noisy (non)linear inverse problems via the Laplace approximation of the posterior sampling. Interestingly, the resulting posterior sampling scheme is a blended version of diffusion sampling with the manifold constrained gradient without a strict measurement consistency projection step, yielding a more desirable generative path in noisy settings compared to the previous studies. Our method demonstrates that diffusion models can incorporate various measurement noise statistics such as Gaussian and Poisson, and also efficiently handle noisy nonlinear inverse problems such as Fourier phase retrieval and non-uniform deblurring.

Chat is not available.