Exact Calibration and Sharp Risk Geometry for Volume-Sampled Ridge Regression
We study ridge regression from exactly $s$ distinct rows of a fixed design.
ProofPaper ↗
Key points
- The determinant law and selected ridge fit share one positive definite penalty.
- Our main result concerns centered covariance risk normalized by full-data penalized loss.
- The balanced geometry yields a same-sample unbiased ridge--Horvitz--Thompson mixture with lower sharp risk and an exact mean-share improvement boundary.
- Under full recalibration after feature changes, we prove quadratic regret from searching the complete old maximizing space and a query-uniform bound on the mixture's risk gain.
Sources (1)
- [1]Exact Calibration and Sharp Risk Geometry for Volume-Sampled Ridge RegressionarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 6, 04:16 AM
We study ridge regression from exactly $s$ distinct rows of a fixed design.
The determinant law and selected ridge fit share one positive definite penalty.
Extractive summary: sentences quoted from the sources.