Abstract
In the Gaussian sequence model Y= θ + ϵ in Rn, we study the fundamental limit of statistical estimation when the signal θ0 belongs to a class Θn(d,d0,k) of (generalized) splines with free knots located at equally spaced design points. Here d is the degree of the spline, d0 is the order of differentiability at each inner knot, and k is the maximal number of pieces. We show that, given any integer d≥ 0 and d0{-1,0,⋯,d-1}, the minimax rate of estimation over Θn(d,d0,k) exhibits the following phase transition: (equation presented) The transition boundary k0, which takes the form (d+1)/(d-d0) + 1, demonstrates the critical role of the regularity parameter d0 in the separation between a faster log log (16n) and a slower log (en) rate. We further show that, once encouraging an additional ' d-monotonicity' shape constraint (including monotonicity for d = 0 and convexity for d=1), the above phase transition is removed and the faster k\log log (16n/k) rate can be achieved for all k. These results provide theoretical support for developing ℓ0 -penalized (shape-constrained) spline regression procedures as useful alternatives to ℓ1 - and ℓ2-penalized ones.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 4043-4069 |
| Number of pages | 27 |
| Journal | IEEE Transactions on Information Theory |
| Volume | 68 |
| Issue number | 6 |
| DOIs | |
| State | Published - Jun 1 2022 |
ASJC Scopus subject areas
- Information Systems
- Computer Science Applications
- Library and Information Sciences
Keywords
- Splines
- law of iterated logarithm
- minimax rate
- phase transition
- shape constraint
Fingerprint
Dive into the research topics of 'On a Phase Transition in General Order Spline Regression'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver