Sequential Conditional Independence Testing with Machine Learning Models
Conditional independence testing is a ubiquitous problem in scientific discovery.
ProofPaper ↗
Key points
- Log-optimal e-variables have been studied in this setting, but it remains unclear how to incorporate machine learning models into their design.
- Other approaches test exchangeability directly, yielding an e-variable with lower power in theory but, surprisingly, higher power in practice.
- The decomposition shows that GRO e-variable estimates can be beaten because of their worse approximation and estimation errors, and we explore intermediate null hypotheses between model-X conditional independence and exchangeability to reduce these errors.
- We provide estimation error bounds that accommodate triple robustness results, achieving fast convergence rates.
Sources (1)
- [1]Sequential Conditional Independence Testing with Machine Learning ModelsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 8, 07:18 AM
Conditional independence testing is a ubiquitous problem in scientific discovery.
Log-optimal e-variables have been studied in this setting, but it remains unclear how to incorporate machine learning models into their design.
Extractive summary: sentences quoted from the sources.