Gene-R1: Reasoning with Data-Augmented Lightweight LLMs for Gene Set Analysis

2025-09-11

AI Summary

Gene set analysis (GSA) lacks lightweight, open-source large language models (LLMs), underexplores advanced reasoning strategies, and faces constraints in cost and data privacy. Method: We propose the first lightweight GSA framework integrating data augmentation and chain-of-thought (CoT) reasoning. Built upon open-source small language models, it employs an in-distribution/out-of-distribution joint evaluation protocol, enhances training data with synthetic biological knowledge, and introduces a stepwise functional reasoning parsing mechanism. Contribution/Results: On 1,508 in-distribution gene sets, our method surpasses existing open-source approaches and matches commercial LLMs in accuracy. On 106 out-of-distribution gene sets, it demonstrates robust generalization—significantly improving cross-dataset transferability. This work is the first to empirically validate that lightweight open-source LLMs can achieve high-accuracy, privacy-preserving, and cost-efficient functional annotation in GSA.

Technology Category

• Knowledge Representation and Reasoning: Computational Complexity of Reasoning
• Machine Learning: Large Multimodal Models (LMMs)
• Natural Language Processing: Generation

Application Category

• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs

Abstract

The gene set analysis (GSA) is a foundational approach for uncovering the molecular functions associated with a group of genes. Recently, LLM-powered methods have emerged to annotate gene sets with biological functions together with coherent explanatory insights. However, existing studies primarily focus on proprietary models, which have been shown to outperform their open-source counterparts despite concerns over cost and data privacy. Furthermore, no research has investigated the application of advanced reasoning strategies to the GSA task. To address this gap, we introduce Gene-R1, a data-augmented learning framework that equips lightweight and open-source LLMs with step-by-step reasoning capabilities tailored to GSA. Experiments on 1,508 in-distribution gene sets demonstrate that Gene-R1 achieves substantial performance gains, matching commercial LLMs. On 106 out-of-distribution gene sets, Gene-R1 performs comparably to both commercial and large-scale LLMs, exhibiting robust generalizability across diverse gene sources.

Problem

• Enabling lightweight open-source LLMs for gene set analysis
• Addressing cost and privacy concerns in proprietary LLM methods
• Applying advanced reasoning strategies to gene set annotation

Innovation

• Data-augmented learning framework for lightweight LLMs
• Step-by-step reasoning capabilities for gene analysis
• Open-source model matching commercial LLM performance