Data-adaptive statistics for multiple hypothesis testing in high-dimensional settings

Abstract

Current statistical inference problems in areas like astronomy, genomics, and marketing routinely involve the simultaneous testing of thousands of null hypotheses. For high-dimensional multivariate distributions, these hypotheses may concern a wide range of parameters, with complex and unknown dependence structures among variables. In analyzing such hypothesis testing procedures, gains in efficiency and power can be achieved by performing variable reduction on the set of hypotheses prior to testing. We present an approach using data-adaptive multiple testing that applies data mining techniques to screen the full set of covariates on equally sized partitions of the sample via cross-validation. This generalized screening procedure is used to create average ranks for covariates, defining a reduced (sub)set of hypotheses.

Nima Hejazi
Nima Hejazi
Assistant Professor of Biostatistics

My research lies at the intersection of causal inference and machine learning, developing flexible methodology for statistical inference tailored to modern experiments and observational studies in the biomedical and public health sciences.