UITrans: Seamless UI Translation from Android to HarmonyOS

2024-12-18

AI Summary

To address the redundant UI development necessitated by fundamental differences in layout models and development paradigms between Android and HarmonyOS, this paper proposes the first LLM-driven multi-agent collaborative translation framework for Android-to-HarmonyOS migration, enabling end-to-end automatic conversion from Android XML layouts to ArkUI. The framework integrates semantic mapping, interactive logic migration, and a multi-agent reflective collaboration mechanism, supporting translation at three granularities: UI components, pages, and entire projects. Evaluated on six real-world Android applications, it achieves translation success rates of 90.1%, 89.3%, and 89.2% at the component, page, and project levels, respectively. The implementation is fully open-sourced and accompanied by a runnable demonstration. This work establishes a reusable technical pathway and an empirical benchmark for cross-platform UI development.

Technology Category

• Machine Learning: Large Multimodal Models (LMMs)
• Natural Language Processing: Language Grounding & Multi-modal NLP
• Multiagent Systems: Applications

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
• User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendation
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

Seamless user interface (i.e., UI) translation has emerged as a pivotal technique for modern mobile developers, addressing the challenge of developing separate UI applications for Android and HarmonyOS platforms due to fundamental differences in layout structures and development paradigms. In this paper, we present UITrans, the first automated UI translation tool designed for Android to HarmonyOS. UITrans leverages an LLM-driven multi-agent reflective collaboration framework to convert Android XML layouts into HarmonyOS ArkUI layouts. It not only maps component-level and page-level elements to ArkUI equivalents but also handles project-level challenges, including complex layouts and interaction logic. Our evaluation of six Android applications demonstrates that our UITrans achieves translation success rates of over 90.1%, 89.3%, and 89.2% at the component, page, and project levels, respectively. UITrans is available at https://github.com/OpenSELab/UITrans and the demo video can be viewed at https://www.youtube.com/watch?v=iqKOSmCnJG0.

Problem

• Automated UI translation tool
• Android to HarmonyOS conversion
• LLM-driven multi-agent framework

Innovation

• LLM-driven multi-agent framework
• Automated Android to HarmonyOS translation
• Handles component, page, project levels