Semi-Supervised Kernel Ridge Fr\'echet Regression

2026-10-04

AI Summary

This study addresses the challenge of predicting random object-valued responses in label-scarce settings. It proposes a semi-supervised hybrid framework that leverages unlabeled covariates to learn kernel spectral features and combines labeled responses to estimate the conditional Fréchet function via kernel ridge regression. Theoretically, error bounds distinguishing the roles of labeled and unlabeled samples are derived, alongside stability guarantees established within Hadamard spaces. By deeply integrating semi-supervised learning with Fréchet regression, this work extends the theoretical foundations of statistical learning in non-Euclidean spaces. Both simulation studies and an EEG application demonstrate that the proposed method significantly improves predictive performance over existing competitive baselines.

Abstract

Fr\'echet regression provides a framework for predicting random object-valued responses by minimizing the conditional expected squared distances. We propose semi-supervised kernel ridge Fr\'echet regression (SS-KRFR) to exploit unlabeled covariates when labeled samples are scarce. The method learns kernel spectral features from both labeled and unlabeled covariates, then uses labeled responses to estimate the conditional Fr\'echet function by ridge regression. We derive prediction error bounds that distinguish the roles of labeled and unlabeled samples, and establish polynomial convergence rates under suitable conditions. Under additional kernel assumptions, a sharper analysis relaxes the sample-size requirements for learning the features. We also develop hybrid methods that combine features, predictions, or both from models fitted with and without unlabeled covariates, and establish hybrid stability uniformly over mixing weights in Hadamard spaces at common tuning, with a separate rate guarantee for prediction mixing. Simulations and an EEG application show semi-supervised gain and improvements over competing Fr\'echet regression methods in several settings.

Problem

• Fréchet regression
• semi-supervised learning
• object-valued responses
• kernel ridge regression

Innovation

• Semi-supervised learning
• Fréchet regression
• Kernel ridge regression
• Spectral features
• Hadamard spaces