TY - JOUR
T1 - Deep generative models in inversion: The impact of the generator’s nonlinearity and development of a new approach based on a variational autoencoder
AU - Lopez-Alvis, Jorge
AU - Laloy, Eric
AU - Nguyen, Frédéric
AU - Hermans, Thomas
N1 - Score=10
PY - 2021/7/1
Y1 - 2021/7/1
N2 - When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological setting) of the subsurface. In such case, inversion may be formulated in a latent space where a lowdimensional parameterization of the patterns is defined and where Markov chain Monte Carlo or gradient-based methods may be applied. However, the generative mapping between the latent and the original (pixel) representations is usually highly nonlinear which may cause some difficulties for inversion, especially for radientbased methods. In this contribution we review the conceptual framework of inversion with DGMs and propose that this nonlinearity is caused mainly by changes in topology and curvature induced by the generative function. As a result, we identify a conflict between two goals: the accuracy of the generated patterns and the
feasibility of gradient-based inversion. In addition, we show how some of the training parameters of a variational autoencoder, which is a particular instance of a DGM, may be chosen so that a tradeoff between these two goals is achieved and acceptable inversion results are obtained with a stochastic gradient-descent scheme. A series of test cases using synthetic models with channel patterns of different complexity and cross-borehole traveltime tomographic data involving both a linear and a nonlinear forward operator show that the proposed method provides useful results and performs better compared to previous approaches using DGMs with gradient-based
inversion.
AB - When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological setting) of the subsurface. In such case, inversion may be formulated in a latent space where a lowdimensional parameterization of the patterns is defined and where Markov chain Monte Carlo or gradient-based methods may be applied. However, the generative mapping between the latent and the original (pixel) representations is usually highly nonlinear which may cause some difficulties for inversion, especially for radientbased methods. In this contribution we review the conceptual framework of inversion with DGMs and propose that this nonlinearity is caused mainly by changes in topology and curvature induced by the generative function. As a result, we identify a conflict between two goals: the accuracy of the generated patterns and the
feasibility of gradient-based inversion. In addition, we show how some of the training parameters of a variational autoencoder, which is a particular instance of a DGM, may be chosen so that a tradeoff between these two goals is achieved and acceptable inversion results are obtained with a stochastic gradient-descent scheme. A series of test cases using synthetic models with channel patterns of different complexity and cross-borehole traveltime tomographic data involving both a linear and a nonlinear forward operator show that the proposed method provides useful results and performs better compared to previous approaches using DGMs with gradient-based
inversion.
KW - Deep generative model
KW - Geophysical inversion
KW - Geological prior information
KW - Variational autoencoder
KW - Stochastic gradient descent
KW - Deep learning
UR - https://ecm.sckcen.be/OTCS/llisapi.dll/open/44278369
U2 - 10.1016/j.cageo.2021.104762
DO - 10.1016/j.cageo.2021.104762
M3 - Article
SN - 0098-3004
VL - 152
SP - 1
EP - 18
JO - Computers and Geosciences
JF - Computers and Geosciences
M1 - 104762
ER -