Conditional mean and quantile dependence testing in high dimension

  • Xianyang Zhang
  • , Shun Yao
  • , Xiaofeng Shao

    Research output: Contribution to journalArticlepeer-review

    39 Scopus citations

    Abstract

    Motivated by applications in biological science, we propose a novel test to assess the conditional mean dependence of a response variable on a large number of covariates. Our procedure is built on the martingale difference divergence recently proposed in Shao and Zhang [J. Amer. Statist. Assoc. 109 (2014) 1302-1318], and it is able to detect certain type of departure from the null hypothesis of conditional mean independence without making any specific model assumptions. Theoretically, we establish the asymptotic normality of the proposed test statistic under suitable assumption on the eigenvalues of a Hermitian operator, which is constructed based on the characteristic function of the covariates. These conditions can be simplified under banded dependence structure on the covariates or Gaussian design. To account for heterogeneity within the data, we further develop a testing procedure for conditional quantile independence at a given quantile level and provide an asymptotic justification. Empirically, our test of conditional mean independence delivers comparable results to the competitor, which was constructed under the linear model framework, when the underlying model is linear. It significantly outperforms the competitor when the conditional mean admits a nonlinear form.

    Original languageEnglish
    Pages (from-to)219-246
    Number of pages28
    JournalAnnals of Statistics
    Volume46
    Issue number1
    DOIs
    StatePublished - Feb 2018

    Keywords

    • Large-p-small-n
    • Martingale difference divergence
    • Simultaneous test
    • U-statistics

    Fingerprint

    Dive into the research topics of 'Conditional mean and quantile dependence testing in high dimension'. Together they form a unique fingerprint.

    Cite this