E2CB2former: Effecitve and Explainable Transformer for CB2 Receptor Ligand Activity Prediction

2025-02-15

AI Summary

Limited model interpretability hinders rational drug design for cannabinoid receptor type 2 (CB2) ligand activity prediction. Method: We propose the first interpretable deep learning framework integrating graph convolutional networks (GCNs) with Transformers, synergistically leveraging molecular graph representation learning and self-attention mechanisms to jointly achieve high-accuracy activity prediction and molecule-level interpretability—enabling, for the first time, attention-driven identification of critical pharmacophores. Results: On standard benchmark datasets, our model achieves R² = 0.685, RMSE = 0.675, and AUC = 0.940, significantly outperforming eight state-of-the-art baseline models. Visual interpretability analysis successfully identifies key substructural motifs governing CB2 activity. This work establishes a novel, interpretable AI paradigm for designing CB2-targeted anti-inflammatory, analgesic, and neuroprotective therapeutics.

Technology Category

• Machine Learning: Graph-based Machine Learning
• Natural Language Processing: Interpretability, Analysis, and Evaluation of NLP Models
• Reasoning under Uncertainty: Graphical Models

Application Category

• Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphs
• Semantics and Knowledge: Methods, algorithms and applications for the development of semantic models, knowledge graphs and other forms of structured data models with machine-interpretable semantics
• User Modeling, Personalization and Recommendation: Explainable and interpretable methods for personalization

Abstract

Accurate prediction of CB2 receptor ligand activity is pivotal for advancing drug discovery targeting this receptor, which is implicated in inflammation, pain management, and neurodegenerative conditions. Although conventional machine learning and deep learning techniques have shown promise, their limited interpretability remains a significant barrier to rational drug design. In this work, we introduce CB2former, a framework that combines a Graph Convolutional Network with a Transformer architecture to predict CB2 receptor ligand activity. By leveraging the Transformer's self attention mechanism alongside the GCN's structural learning capability, CB2former not only enhances predictive performance but also offers insights into the molecular features underlying receptor activity. We benchmark CB2former against diverse baseline models including Random Forest, Support Vector Machine, K Nearest Neighbors, Gradient Boosting, Extreme Gradient Boosting, Multilayer Perceptron, Convolutional Neural Network, and Recurrent Neural Network and demonstrate its superior performance with an R squared of 0.685, an RMSE of 0.675, and an AUC of 0.940. Moreover, attention weight analysis reveals key molecular substructures influencing CB2 receptor activity, underscoring the model's potential as an interpretable AI tool for drug discovery. This ability to pinpoint critical molecular motifs can streamline virtual screening, guide lead optimization, and expedite therapeutic development. Overall, our results showcase the transformative potential of advanced AI approaches exemplified by CB2former in delivering both accurate predictions and actionable molecular insights, thus fostering interdisciplinary collaboration and innovation in drug discovery.

Problem

• Predict CB2 receptor ligand activity accurately
• Enhance interpretability in drug design
• Identify key molecular substructures influencing activity

Innovation

• Combines Graph Convolutional Network
• Utilizes Transformer self attention
• Provides interpretable molecular insights