Comprehending Spatio-temporal Data via Cinematic Storytelling using Large Language Models

2025-10-20

AI Summary

Traditional spatiotemporal data visualization suffers from high technical barriers and weak narrative coherence, impeding public comprehension and engagement. To address this, we propose MapMuse—a novel framework that conceptualizes geographic space as “characters” and mobility trajectories as “plotlines,” integrating cinematic storytelling principles with large language models (LLMs). Leveraging retrieval-augmented generation (RAG) and a multi-agent collaboration architecture, MapMuse automatically generates hierarchical, accurate, and emotionally resonant narratives—from macro-level heatmaps to micro-level trajectory stories. Empirical evaluation on taxi trajectory data demonstrates that MapMuse significantly reduces cognitive load while enhancing data accessibility and communicative impact. This work establishes a scalable, human-centered paradigm for democratizing spatiotemporal data interpretation and expression.

Technology Category

• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning
• Data Mining & Knowledge Management: Mining of Spatial, Temporal or Spatio-Temporal Data
• Planning, Routing, and Scheduling: Optimization of Spatio-temporal Systems

Application Category

• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Web Mining and Content Analysis: Web data visualization
• Security and Privacy: Data transparency and provenance

Abstract

Spatio-temporal data captures complex dynamics across both space and time, yet traditional visualizations are complex, require domain expertise and often fail to resonate with broader audiences. Here, we propose MapMuse, a storytelling-based framework for interpreting spatio-temporal datasets, transforming them into compelling, narrative-driven experiences. We utilize large language models and employ retrieval augmented generation (RAG) and agent-based techniques to generate comprehensive stories. Drawing on principles common in cinematic storytelling, we emphasize clarity, emotional connection, and audience-centric design. As a case study, we analyze a dataset of taxi trajectories. Two perspectives are presented: a captivating story based on a heat map that visualizes millions of taxi trip endpoints to uncover urban mobility patterns; and a detailed narrative following a single long taxi journey, enriched with city landmarks and temporal shifts. By portraying locations as characters and movement as plot, we argue that data storytelling drives insight, engagement, and action from spatio-temporal information. The case study illustrates how MapMuse can bridge the gap between data complexity and human understanding. The aim of this short paper is to provide a glimpse to the potential of the cinematic storytelling technique as an effective communication tool for spatio-temporal data, as well as to describe open problems and opportunities for future research.

Problem

• Transforming complex spatio-temporal data into narrative-driven experiences
• Bridging data complexity and human understanding through cinematic storytelling
• Generating comprehensive stories from spatio-temporal datasets using LLMs

Innovation

• Utilizes large language models with retrieval augmented generation
• Employs agent-based techniques for generating comprehensive stories
• Applies cinematic storytelling principles to spatio-temporal data