A Multi-Surface Consistency Audit of Software Citation Metadata

📅 2026-08-17
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
研究通过审计117个开源科研软件项目的多个元数据表面,发现大部分项目存在核心字段冲突,影响软件引用一致性。
📝 Abstract
Research software projects describe themselves in many places at once: citation files in the repository, archive deposits, DOI registry records, package registries, and README text. We treat the software as the underlying object and these machine-readable self-descriptions as its surfaces: the points where people and automated systems read what the project declares about the software. Citation guidance, indexing services, and automated agents may read a different subset of these surfaces, so disagreement between them can silently fragment credit and provenance. This paper asks a simple question that has not been measured directly: when a project's own metadata surfaces are compared with each other, how often do they agree? We audited 117 open-source research software projects, comprising an 87-project high-performance computing and quantum computing corpus and a 30-project registered baseline drawn from the JOSS and pyOpenSci accepted-package lists, across up to seven machine-readable surfaces per project. Using a four-level verdict rubric across six metadata fields, with 98.5\% hand-verified verdict precision on a 338-row stratified sample, we found that 52 of the 62 projects exposing at least two comparable surfaces (83.9\%) contain at least one core-field conflict, a result that is insensitive to the fuzzy-matching threshold. Half of hand-adjudicated cross-surface conflicts trace to a single mechanism: surfaces describing the software's paper rather than the software itself. Among projects whose CITATION.cff includes a preferred citation, 28 of 32 route citations to a record that disagrees with the software's own metadata. The author lists and titles disagree the most, and the registry surfaces are the least aligned. We release the audit pipeline as an importable library, the corpus, the registered sampling protocol, all raw snapshots, and the complete verification log.
Problem

Research questions and friction points this paper is trying to address.

software citation
metadata consistency
research software
Innovation

Methods, ideas, or system contributions that make the work stand out.

software citation metadata
multi-surface consistency
research software projects
audit pipeline
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
P
Pengyin Shan
National Center for Supercomputing Applications, University of Illinois Urbana-Champaign