A framework for 3D interaction techniques

2025-07-02

AI Summary

Existing 3D interaction technologies (ITs) suffer from architectural rigidity, poor extensibility, and tight coupling between application logic and interaction mechanisms. Method: This paper proposes a modular, dataflow-driven object-oriented software framework. It models virtual input devices and abstracts scene-object information sources, connecting heterogeneous input devices, execution models, and ITs via pluggable filter components—enabling dynamic registration and composition. The framework is graphics-toolkit-agnostic and supports loose coupling between application-specific code and interaction logic. Contribution/Results: Experimental evaluation demonstrates significantly improved IT reusability and development efficiency. The framework’s scalability, flexibility, and cross-platform adaptability are validated across diverse 3D applications, including immersive visualization, collaborative design, and interactive simulation environments.

Technology Category

• Computer Vision: 3D Computer Vision
• Humans and AI: Interaction Techniques and Devices
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Data management and stream processing for Web, mobile and wireless applications
• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems
• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs

Abstract

This paper presents a software architecture for 3D interaction techniques (ITs) and an object oriented, toolkit-independent framework that implements such architecture. ITs are composed of basic filters connected in a dataflow, where virtual input devices and objects in the scene are sources of information. An execution model defines the general flow of information between filters. This framework has been designed to be extensible: new information types, new input devices, new execution models, or new interaction techniques can easily be added. Application specific code and application specific ITs are seamlessly integrated into this architecture.

Problem

• Develops a software architecture for 3D interaction techniques
• Creates an extensible framework for diverse interaction components
• Integrates application-specific code seamlessly into the architecture

Innovation

• Object-oriented toolkit-independent framework for 3D interaction
• Dataflow composition of basic filters for interaction techniques
• Extensible architecture supporting new inputs and models