El0ps: An Exact L0-regularized Problems Solver

2025-06-04

AI Summary

L₀-regularized optimization remains computationally challenging for efficient solving and practical deployment in machine learning, statistical modeling, and signal processing. To address this, we propose the first customizable L₀ modeling framework, integrating high-performance exact solvers based on branch-and-bound, dynamic programming, and sparse optimization. Implemented as a modular Python toolbox, it enables flexible user specification of objective functions and constraints, and provides out-of-the-box machine learning pipelines. Empirical evaluation demonstrates substantial improvements in feature selection accuracy and model interpretability across diverse sparse modeling tasks, achieving state-of-the-art solution quality and runtime efficiency. The framework is open-source, designed for extensibility, and supports seamless integration into industrial-scale machine learning systems.

Technology Category

• Machine Learning: Optimization
• Constraint Satisfaction and Optimization: Solvers and Tools
• Search and Optimization: Non-convex Optimization

Application Category

• User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendation
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
• Search and Retrieval-Augmented AI: Large language models for search

Abstract

This paper presents El0ps, a Python toolbox providing several utilities to handle L0-regularized problems related to applications in machine learning, statistics, and signal processing, among other fields. In contrast to existing toolboxes, El0ps allows users to define custom instances of these problems through a flexible framework, provides a dedicated solver achieving state-of-the-art performance, and offers several built-in machine learning pipelines. Our aim with El0ps is to provide a comprehensive tool which opens new perspectives for the integration of L0-regularized problems in practical applications.

Problem

• Solves L0-regularized problems in machine learning
• Provides a flexible framework for custom problem instances
• Offers state-of-the-art solver for practical applications

Innovation

• Python toolbox for L0-regularized problems
• Flexible framework for custom problem instances
• State-of-the-art dedicated solver performance