Understanding the Role of Large Language Models in Software Engineering: Evidence from an Industry Survey

📅 2025-12-19
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
Despite growing adoption of large language models (LLMs) in software engineering, their real-world impact, benefits, and associated risks remain poorly understood. Method: We conducted a mixed-methods study with 46 industry practitioners from diverse technical backgrounds, combining structured surveys, open-ended interviews, and thematic analysis. Contribution/Results: This is the first systematic empirical investigation revealing LLM usage patterns—particularly in coding assistance, documentation generation, and system maintenance—alongside quantified benefits (e.g., +42% improvement in technical Q&A efficiency and enhanced documentation quality) and critical risks: credential leakage, overreliance, and knowledge atrophy. Notably, 68% of participants expressed concern about diminished programming autonomy. We propose the “supervised adoption” framework—a human-in-the-loop, incremental integration strategy—to guide responsible, secure, and sustainable LLM deployment in practice, grounded in empirical evidence and actionable insights.

Technology Category

Machine Learning: Large Multimodal Models (LMMs)Natural Language Processing: (Large) Language ModelsApplication Domains: Software Engineering

Application Category

User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendationEconomics, Online Markets and Human Computation: Cost models of using LLMs in production systemsSemantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
📝 Abstract
The rapid advancement of Large Language Models (LLMs) is reshaping software engineering by profoundly influencing coding, documentation, and system maintenance practices. As these tools become deeply embedded in developers' daily workflows, understanding how they are used has become essential. This paper reports an empirical study of LLM adoption in software engineering, based on a survey of 46 industry professionals with diverse educational backgrounds and levels of experience. The results reveal positive perceptions of LLMs, particularly regarding faster resolution of technical questions, improved documentation support, and enhanced source code standardization. However, respondents also expressed concerns about cognitive dependence, security risks, and the potential erosion of technical autonomy. These findings underscore the need for critical and supervised use of LLM-based tools. By grounding the discussion in empirical evidence from industry practice, this study bridges the gap between academic discourse and real-world software development. The results provide actionable insights for developers and researchers seeking to adopt and evolve LLM-based technologies in a more effective, responsible, and secure manner, while also motivating future research on their cognitive, ethical, and organizational implications.
Problem

Research questions and friction points this paper is trying to address.

Investigates LLM adoption in software engineering via industry survey
Examines benefits like faster issue resolution and documentation support
Identifies risks including cognitive dependence and security concerns
Innovation

Methods, ideas, or system contributions that make the work stand out.

Surveyed industry professionals on LLM adoption
Identified benefits like faster technical question resolution
Highlighted concerns about cognitive dependence and security
🔎 Similar Papers
No similar papers found.
V
Vítor Mateus de Brito
University of Vale do Rio dos Sinos, São Leopoldo, Rio Grande do Sul, Brazil
K
Kleinner Farias
University of Vale do Rio dos Sinos, São Leopoldo, Rio Grande do Sul, Brazil