BAYESIAN QUANTILE REGRESSION WITH SUBSET SELECTION: A DECISION ANALYSIS PERSPECTIVE

  • Joseph Feldman
  • , Daniel R. Kowal

    Research output: Contribution to journalArticlepeer-review

    1 Scopus citations

    Abstract

    Quantile regression is a powerful tool in epidemiological studies where interest lies in inferring how different exposures affect specific percentiles of the distribution of a health or life outcome. Existing methods either estimate conditional quantiles separately for each quantile of interest or estimate the entire conditional distribution using semi-or nonparametric models. The former often produce inadequate models for real data and do not share information across quantiles, while the latter are characterized by complex and constrained models that can be difficult to interpret and computationally inefficient. Further, neither approach is well suited for quantile-specific subset selection. Instead, we pose the fundamental problems of linear quantile estimation, uncertainty quantification, and subset selection from a Bayesian decision analysis perspective. For any Bayesian regression model, we derive optimal and interpretable linear estimates and uncertainty quantification for each model-based conditional quantile. Our approach introduces a quantilefocused squared error loss, which enables efficient, closed-form computing and maintains a close relationship with Wasserstein-based density estimation. In an extensive simulation study, our methods demonstrate substantial gains in quantile estimation accuracy, variable selection, and inference over frequentist and Bayesian competitors. We use these tools to identify and quantify the heterogeneous impacts of multiple social stressors and environmental exposures on educational outcomes across the full spectrum of low-, medium-, and high-achieving students in North Carolina.

    Original languageEnglish
    Pages (from-to)2294-2319
    Number of pages26
    JournalAnnals of Applied Statistics
    Volume19
    Issue number3
    DOIs
    StatePublished - Sep 2025

    Keywords

    • Bayesian inference
    • Variable selection
    • decision theory
    • interpretable machine learning

    Fingerprint

    Dive into the research topics of 'BAYESIAN QUANTILE REGRESSION WITH SUBSET SELECTION: A DECISION ANALYSIS PERSPECTIVE'. Together they form a unique fingerprint.

    Cite this