Quantile Slice Sampling

We propose and demonstrate an alternate, effective approach to simple slice sampling. Using the probability integral transform, we first generalize Neal's shrinkage algorithm, standardizing the procedure to an automatic and universal starting point: the unit interval. This enables the introduct...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Heiner, Matthew J, Johnson, Samuel B, Christensen, Joshua R, Dahl, David B
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Heiner, Matthew J
Johnson, Samuel B
Christensen, Joshua R
Dahl, David B
description We propose and demonstrate an alternate, effective approach to simple slice sampling. Using the probability integral transform, we first generalize Neal's shrinkage algorithm, standardizing the procedure to an automatic and universal starting point: the unit interval. This enables the introduction of approximate (pseudo-) targets through importance reweighting, a technique that has popularized elliptical slice sampling. Reasonably accurate pseudo-targets can boost sampler efficiency by requiring fewer rejections and by reducing target skewness. This strategy is effective when a natural, possibly crude, approximation to the target exists. Alternatively, obtaining a marginal pseudo-target from initial samples provides an intuitive and automatic tuning procedure. We consider two metrics for evaluating the quality of approximation; each can be used as a criterion to find an optimal pseudo-target or as an interpretable diagnostic. We examine performance of the proposed sampler relative to other popular, easily implemented MCMC samplers on standard targets in isolation, and as steps within a Gibbs sampler in a Bayesian modeling context. We extend the transformation method to multivariate slice samplers and demonstrate with a constrained state-space model for which a readily available forward-backward algorithm provides the target approximation.
doi_str_mv 10.48550/arxiv.2407.12608
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2407_12608</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2407_12608</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2407_126083</originalsourceid><addsrcrecordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw1zM0MjOw4GQQDyxNzCvJzElVCM7JTAaSibkFOZl56TwMrGmJOcWpvFCam0HezTXE2UMXbER8QVFmbmJRZTzIqHiwUcaEVQAAO-AnUw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Quantile Slice Sampling</title><source>arXiv.org</source><creator>Heiner, Matthew J ; Johnson, Samuel B ; Christensen, Joshua R ; Dahl, David B</creator><creatorcontrib>Heiner, Matthew J ; Johnson, Samuel B ; Christensen, Joshua R ; Dahl, David B</creatorcontrib><description>We propose and demonstrate an alternate, effective approach to simple slice sampling. Using the probability integral transform, we first generalize Neal's shrinkage algorithm, standardizing the procedure to an automatic and universal starting point: the unit interval. This enables the introduction of approximate (pseudo-) targets through importance reweighting, a technique that has popularized elliptical slice sampling. Reasonably accurate pseudo-targets can boost sampler efficiency by requiring fewer rejections and by reducing target skewness. This strategy is effective when a natural, possibly crude, approximation to the target exists. Alternatively, obtaining a marginal pseudo-target from initial samples provides an intuitive and automatic tuning procedure. We consider two metrics for evaluating the quality of approximation; each can be used as a criterion to find an optimal pseudo-target or as an interpretable diagnostic. We examine performance of the proposed sampler relative to other popular, easily implemented MCMC samplers on standard targets in isolation, and as steps within a Gibbs sampler in a Bayesian modeling context. We extend the transformation method to multivariate slice samplers and demonstrate with a constrained state-space model for which a readily available forward-backward algorithm provides the target approximation.</description><identifier>DOI: 10.48550/arxiv.2407.12608</identifier><language>eng</language><subject>Statistics - Computation</subject><creationdate>2024-07</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2407.12608$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2407.12608$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Heiner, Matthew J</creatorcontrib><creatorcontrib>Johnson, Samuel B</creatorcontrib><creatorcontrib>Christensen, Joshua R</creatorcontrib><creatorcontrib>Dahl, David B</creatorcontrib><title>Quantile Slice Sampling</title><description>We propose and demonstrate an alternate, effective approach to simple slice sampling. Using the probability integral transform, we first generalize Neal's shrinkage algorithm, standardizing the procedure to an automatic and universal starting point: the unit interval. This enables the introduction of approximate (pseudo-) targets through importance reweighting, a technique that has popularized elliptical slice sampling. Reasonably accurate pseudo-targets can boost sampler efficiency by requiring fewer rejections and by reducing target skewness. This strategy is effective when a natural, possibly crude, approximation to the target exists. Alternatively, obtaining a marginal pseudo-target from initial samples provides an intuitive and automatic tuning procedure. We consider two metrics for evaluating the quality of approximation; each can be used as a criterion to find an optimal pseudo-target or as an interpretable diagnostic. We examine performance of the proposed sampler relative to other popular, easily implemented MCMC samplers on standard targets in isolation, and as steps within a Gibbs sampler in a Bayesian modeling context. We extend the transformation method to multivariate slice samplers and demonstrate with a constrained state-space model for which a readily available forward-backward algorithm provides the target approximation.</description><subject>Statistics - Computation</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw1zM0MjOw4GQQDyxNzCvJzElVCM7JTAaSibkFOZl56TwMrGmJOcWpvFCam0HezTXE2UMXbER8QVFmbmJRZTzIqHiwUcaEVQAAO-AnUw</recordid><startdate>20240717</startdate><enddate>20240717</enddate><creator>Heiner, Matthew J</creator><creator>Johnson, Samuel B</creator><creator>Christensen, Joshua R</creator><creator>Dahl, David B</creator><scope>EPD</scope><scope>GOX</scope></search><sort><creationdate>20240717</creationdate><title>Quantile Slice Sampling</title><author>Heiner, Matthew J ; Johnson, Samuel B ; Christensen, Joshua R ; Dahl, David B</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2407_126083</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Statistics - Computation</topic><toplevel>online_resources</toplevel><creatorcontrib>Heiner, Matthew J</creatorcontrib><creatorcontrib>Johnson, Samuel B</creatorcontrib><creatorcontrib>Christensen, Joshua R</creatorcontrib><creatorcontrib>Dahl, David B</creatorcontrib><collection>arXiv Statistics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Heiner, Matthew J</au><au>Johnson, Samuel B</au><au>Christensen, Joshua R</au><au>Dahl, David B</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Quantile Slice Sampling</atitle><date>2024-07-17</date><risdate>2024</risdate><abstract>We propose and demonstrate an alternate, effective approach to simple slice sampling. Using the probability integral transform, we first generalize Neal's shrinkage algorithm, standardizing the procedure to an automatic and universal starting point: the unit interval. This enables the introduction of approximate (pseudo-) targets through importance reweighting, a technique that has popularized elliptical slice sampling. Reasonably accurate pseudo-targets can boost sampler efficiency by requiring fewer rejections and by reducing target skewness. This strategy is effective when a natural, possibly crude, approximation to the target exists. Alternatively, obtaining a marginal pseudo-target from initial samples provides an intuitive and automatic tuning procedure. We consider two metrics for evaluating the quality of approximation; each can be used as a criterion to find an optimal pseudo-target or as an interpretable diagnostic. We examine performance of the proposed sampler relative to other popular, easily implemented MCMC samplers on standard targets in isolation, and as steps within a Gibbs sampler in a Bayesian modeling context. We extend the transformation method to multivariate slice samplers and demonstrate with a constrained state-space model for which a readily available forward-backward algorithm provides the target approximation.</abstract><doi>10.48550/arxiv.2407.12608</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2407.12608
ispartof
issn
language eng
recordid cdi_arxiv_primary_2407_12608
source arXiv.org
subjects Statistics - Computation
title Quantile Slice Sampling
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-13T02%3A51%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Quantile%20Slice%20Sampling&rft.au=Heiner,%20Matthew%20J&rft.date=2024-07-17&rft_id=info:doi/10.48550/arxiv.2407.12608&rft_dat=%3Carxiv_GOX%3E2407_12608%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true