VedicTHG: Symbolic Vedic Computation for Low-Resource Talking-Head Generation in Educational Avatars

📅 2026-02-09
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the challenge of deploying talking-head generation in resource-constrained educational settings, where existing methods relying on GPUs, large datasets, or complex models are impractical. The authors propose a purely symbolic, CPU-oriented lightweight framework that first converts speech into a phoneme stream and maps it to a compact viseme set. Inspired by the Vedic sutra “Urdhva Tiryakbhyam,” they introduce symbolic coarticulation rules to generate smooth viseme trajectories. Mouth animation is then synthesized via region-of-interest (ROI) deformation and lightweight 2D rendering. This approach, the first to incorporate Vedic computational principles into talking-head generation, achieves high lip-sync accuracy, temporal stability, and identity consistency without deep learning. It operates efficiently on CPU-only systems, significantly reducing computational overhead and latency while outperforming existing CPU-feasible baselines.

Technology Category

Computer Vision: Computational Photography, Image & Video SynthesisNatural Language Processing: SpeechCognitive Modeling & Cognitive Systems: Computational Creativity

Application Category

User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systemsWeb Mining and Content Analysis: Large pretrained models with web dataSearch and Retrieval-Augmented AI: Multilingual and cross-lingual Web search
📝 Abstract
Talking-head avatars are increasingly adopted in educational technology to deliver content with social presence and improved engagement. However, many recent talking-head generation (THG) methods rely on GPU-centric neural rendering, large training sets, or high-capacity diffusion models, which limits deployment in offline or resource-constrained learning environments. A deterministic and CPU-oriented THG framework is described, termed Symbolic Vedic Computation, that converts speech to a time-aligned phoneme stream, maps phonemes to a compact viseme inventory, and produces smooth viseme trajectories through symbolic coarticulation inspired by Vedic sutra Urdhva Tiryakbhyam. A lightweight 2D renderer performs region-of-interest (ROI) warping and mouth compositing with stabilization to support real-time synthesis on commodity CPUs. Experiments report synchronization accuracy, temporal stability, and identity consistency under CPU-only execution, alongside benchmarking against representative CPU-feasible baselines. Results indicate that acceptable lip-sync quality can be achieved while substantially reducing computational load and latency, supporting practical educational avatars on low-end hardware. GitHub: https://vineetkumarrakesh.github.io/vedicthg
Problem

Research questions and friction points this paper is trying to address.

talking-head generation
low-resource
educational avatars
CPU-only execution
real-time synthesis
Innovation

Methods, ideas, or system contributions that make the work stand out.

Symbolic Vedic Computation
Talking-Head Generation
CPU-efficient Rendering
Viseme Coarticulation
Low-Resource Avatars
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
V
Vineet Kumar Rakesh
Engineering Sciences, Homi Bhabha National Institute, Training School Complex, Anushaktinagar, Mumbai, Maharashtra 400094, India; Computer and Informatics Group, Variable Energy Cyclotron Centre, 1/AF, Bidhannagar, Kolkata, West Bengal 700064, India
A
Ahana Bhattacharjee
Department of Computer Science and Business Systems, Gargi Memorial Institute of Technology, Baruipur, Kolkata, West Bengal 700144, India
Soumya Mazumdar
Soumya Mazumdar
University of Canberra
Public health & geographyBuilt EnvironmentRefugee health equityGISGreenspace
T
Tapas Samanta
Computer and Informatics Group, Variable Energy Cyclotron Centre, 1/AF, Bidhannagar, Kolkata, West Bengal 700064, India; Engineering Sciences, Homi Bhabha National Institute, Training School Complex, Anushaktinagar, Mumbai, Maharashtra 400094, India
H
Hemendra Kumar Pandey
Engineering Sciences, Homi Bhabha National Institute, Training School Complex, Anushaktinagar, Mumbai, Maharashtra 400094, India; Computer and Informatics Group, Variable Energy Cyclotron Centre, 1/AF, Bidhannagar, Kolkata, West Bengal 700064, India
A
Amitabha Das
School of Nuclear Studies and Application, Jadavpur University, Salt Lake City, Kolkata, West Bengal 700106, India
S
Sarbajit Pal
Mahatma Gandhi University, West Bengal, India