Skip to main navigation Skip to search Skip to main content

On a Phase Transition in General Order Spline Regression

Research output: Contribution to journal › Article › peer-review

Abstract

In the Gaussian sequence model Y= θ + ϵ in Rn, we study the fundamental limit of statistical estimation when the signal θ0 belongs to a class Θn(d,d0,k) of (generalized) splines with free knots located at equally spaced design points. Here d is the degree of the spline, d0 is the order of differentiability at each inner knot, and k is the maximal number of pieces. We show that, given any integer d≥ 0 and d0{-1,0,⋯,d-1}, the minimax rate of estimation over Θn(d,d0,k) exhibits the following phase transition: (equation presented) The transition boundary k0, which takes the form (d+1)/(d-d0) + 1, demonstrates the critical role of the regularity parameter d0 in the separation between a faster log log (16n) and a slower log (en) rate. We further show that, once encouraging an additional ' d-monotonicity' shape constraint (including monotonicity for d = 0 and convexity for d=1), the above phase transition is removed and the faster k\log log (16n/k) rate can be achieved for all k. These results provide theoretical support for developing ℓ0 -penalized (shape-constrained) spline regression procedures as useful alternatives to ℓ1 - and ℓ2-penalized ones.

Original languageEnglish (US)
Pages (from-to)4043-4069
Number of pages27
JournalIEEE Transactions on Information Theory
Volume68
Issue number6
DOIs
StatePublished - Jun 1 2022

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Keywords

  • Splines
  • law of iterated logarithm
  • minimax rate
  • phase transition
  • shape constraint

Fingerprint

Dive into the research topics of 'On a Phase Transition in General Order Spline Regression'. Together they form a unique fingerprint.

Cite this