In Bayesian statistics, routinely implemented deterministic approximations of posterior distributions typically rely on symmetric densities, often taken to be Gaussian. Such a choice facilitates optimization and inference, but may compromise the quality of the overall approximation. In fact, even in simple parametric models, the posterior distribution can displays substantial asymmetries that yield major bias and reduced accuracy when considering symmetric approximations. Recent research has moved toward more flexible classes of approximating densities incorporating skewness. However, current solutions are model specific, lack general supporting theory and usually increase the computational challenges and complexity of the optimization problem. This thesis aims to fill such a gap by developing a general, and theoretically supported, family of skew-symmetric approximations. To accomplish this goal, Chapter 1 demonstrates that in the idealized framework where the true data generating mechanism is known, the posterior distribution converges, in an appropriate sense, to a specific sequence of skew-symmetric distributions at a rate that is faster than the classical Gaussian one derived under the Bernstein-Von Mises theorem. In Chapter 2, these findings further motivate the development of practical plug-in versions that, besides enjoying the same theoretical guarantees, can approximate the posterior distribution in real-world scenarios. The approximations developed in the first two chapters are derived by exploiting asymptotic arguments. Chapter 3 offers a different perspective by introducing a general and provably optimal strategy to perturb any off-the-shelf symmetric approximation of a generic posterior distribution. Such a novel perturbation is derived without additional optimization steps and yields a similarly-tractable approximation within the class of skew-symmetric densities that provably improves
Approssimazioni asimmetriche delle distribuzioni a posteriori
POZZA, FRANCESCO
2024
Abstract
In Bayesian statistics, routinely implemented deterministic approximations of posterior distributions typically rely on symmetric densities, often taken to be Gaussian. Such a choice facilitates optimization and inference, but may compromise the quality of the overall approximation. In fact, even in simple parametric models, the posterior distribution can displays substantial asymmetries that yield major bias and reduced accuracy when considering symmetric approximations. Recent research has moved toward more flexible classes of approximating densities incorporating skewness. However, current solutions are model specific, lack general supporting theory and usually increase the computational challenges and complexity of the optimization problem. This thesis aims to fill such a gap by developing a general, and theoretically supported, family of skew-symmetric approximations. To accomplish this goal, Chapter 1 demonstrates that in the idealized framework where the true data generating mechanism is known, the posterior distribution converges, in an appropriate sense, to a specific sequence of skew-symmetric distributions at a rate that is faster than the classical Gaussian one derived under the Bernstein-Von Mises theorem. In Chapter 2, these findings further motivate the development of practical plug-in versions that, besides enjoying the same theoretical guarantees, can approximate the posterior distribution in real-world scenarios. The approximations developed in the first two chapters are derived by exploiting asymptotic arguments. Chapter 3 offers a different perspective by introducing a general and provably optimal strategy to perturb any off-the-shelf symmetric approximation of a generic posterior distribution. Such a novel perturbation is derived without additional optimization steps and yields a similarly-tractable approximation within the class of skew-symmetric densities that provably improvesFile | Dimensione | Formato | |
---|---|---|---|
tesi_Francesco_Pozza.pdf
accesso aperto
Dimensione
3.44 MB
Formato
Adobe PDF
|
3.44 MB | Adobe PDF | Visualizza/Apri |
I documenti in UNITESI sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/20.500.14242/96379
URN:NBN:IT:UNIPD-96379