Institution profile

University of Siena

Academic institutioneurope · it
Official website
Research library91linked papers
Opportunities0open roles
Selected work

Representative Papers

Wearable Haptics for a Marionette-inspired Teleoperation of Highly Redundant Robotic Systems

May 13, 2024IEEE International Conference on Robotics and Automation

To address the challenges of motion-manipulation coupling, weak environmental perception, and low intuitiveness in teleoperation of highly redundant embodied robots (e.g., CENTAURO), this paper proposes a wearable haptic human–robot interface inspired by the marionette metaphor. Our approach uniquely integrates multimodal haptic feedback—vibrotactile and force cues—deeply into a closed-loop motion mapping framework, synergizing virtual physical interaction modeling with a real-time motion–sensor co-mapping algorithm. This enables natural, full-platform kinematic mapping from operator limb motions to robot motion while concurrently rendering proprioceptive and environmental contact states. Experimental evaluation demonstrates that novice users achieve a 37% reduction in task completion time, a 52% decrease in collision misclassification rate, and a 41% reduction in NASA-TLX subjective workload—significantly enhancing operational efficiency, safety, and immersion.

2 citationsRead paper

From Arabic Text to Puzzles: LLM-Driven Development of Arabic Educational Crosswords

Jan 19, 2025

Arabic language education has long suffered from a scarcity of high-quality interactive learning tools, constraining both learning efficacy and user engagement. To address this, we propose the first end-to-end Arabic educational crossword puzzle generation system. Our method introduces Arabic-Clue-Instruct—a novel, domain-specific clue instruction dataset comprising 52,000 high-quality examples—and a unified text-to-clue-to-grid generation framework. We employ multi-model collaborative reasoning using GPT-4-Turbo, GPT-3.5-Turbo, and Llama3-8B-Instruct, integrated with rule-based grid layout optimization and category-aware clue generation to ensure linguistic accuracy and pedagogical appropriateness. Empirical evaluation demonstrates significant improvements in vocabulary retention and learner engagement. All models, datasets, and source code are publicly released to foster reproducibility and community advancement.

1 citationsRead paper

Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Heads

Oct 14, 2024arXiv.org

Existing speech-driven 3D talking head methods are constrained by fixed mesh topologies, limiting generalization to arbitrary topologies—e.g., real-world scanned faces. To address this, we propose the first topology-agnostic speech-driven animation framework. Our method introduces: (i) a registration-free training paradigm eliminating reliance on point-to-point correspondences; (ii) a heat-diffusion-based feature prediction mechanism ensuring topology-robust geometric modeling across diverse meshes; (iii) an adaptive graph neural network that learns dynamic graph structures per input; and (iv) a multi-granularity lip-sync evaluation metric suite addressing shortcomings of conventional metrics in temporal alignment and semantic consistency. Experiments demonstrate high-fidelity animation on arbitrary-topology 3D faces—including unseen scanned data—outperforming fixed-topology baselines. We establish the first topology-independent benchmark for 3D talking heads.

1 citationsRead paper
Recent publications

Latest Papers