interactive model refinement

Designs and implements systems that present model predictions to human experts, collect corrections or annotations, and iteratively update the model’s structured representations or parameters based on those expert inputs. This includes building interactive interfaces and training pipelines to incorporate expert feedback in real time or through fine‑tuning to refine model behavior.

interactivemodelrefinement

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
0.01
Oct 01, 2026Oct 01, 2026
Career
Value
No comparison yet
$200K/year
Oct 01, 2026Oct 01, 2026

Must-Read Papers

Most classic and influential ideas
View more

Interactive Training: Feedback-Driven Neural Network Optimization

Oct 02, 2025
WZ
Wentao Zhang
🏛️ University of Waterloo | University of Wisconsin-Madison

Traditional neural network training relies on fixed optimization pipelines, rendering it inflexible in dynamically addressing training instability and anomalies. To address this limitation, we propose the first interactive training framework enabling real-time human–AI collaborative intervention. Our method employs a lightweight control server that integrates expert human directives with AI agent feedback to dynamically adjust hyperparameters, data sampling strategies, and model checkpoints during training. This framework introduces, for the first time, a closed-loop interactive paradigm into neural network training, establishing a scalable human–machine collaboration interface coupled with automated response mechanisms. Experimental results demonstrate significant improvements in training stability, reduced sensitivity to initial hyperparameter configurations, and enhanced real-time responsiveness to user-specified customization requirements. The effectiveness is validated across multiple benchmark tasks.

Allows dynamic adjustment of optimizer hyperparameters and training dataEnables real-time feedback-driven intervention during neural network trainingImproves training stability and adaptability to evolving user needs

One for All: Update Parameterized Knowledge Across Multiple Models

Jun 01, 2025
WM
Weitao Ma
🏛️ Harbin Institute of Technology | The University of Hong Kong

Large language models (LLMs) suffer from static knowledge and cumbersome updates, leading to factual hallucinations; existing knowledge editing methods are largely confined to single-model settings, exhibiting limited generalizability and efficiency. This paper proposes OnceEdit—the first plug-and-play framework enabling parameterized knowledge editing across diverse LLMs. Its core innovations are: (1) a dynamic weight token mechanism that injects learnable, lightweight editing signals into model parameters; and (2) an integrated enhancement mechanism that jointly optimizes editing stability and cross-model transferability via model ensembling, selective parameter freezing, and gradient reweighting. Evaluated on multiple LLM benchmarks, OnceEdit achieves a 12.6% improvement in editing accuracy and a 3.2× speedup in inference latency. Crucially, it enables zero-shot transfer of edits to unseen models—marking the first demonstration of cross-architecture knowledge editing and substantially advancing beyond the constraints of single-model editing paradigms.

Enhancing multi-model editing stability and adaptabilityReducing errors from outdated knowledge in LLMsUpdating knowledge across multiple LLMs efficiently

This work addresses the lack of a general, auditable dynamic control mechanism in existing training systems, which typically rely on framework-specific code. The authors propose the first cross-framework, open-source control plane that exposes training interfaces through a unified protocol, integrating declarative configuration, request validation, and secure control-point scheduling within the Aim workspace to enable metric monitoring, real-time intervention, and operational traceability. The system supports safe human and automated controller interventions during training while fully logging all operational trajectories. Experiments across five NLP and reinforcement learning tasks demonstrate its effectiveness, and the open-source implementation provides a foundation for reproducible human-in-the-loop training.

auditable trainingcontrol planehuman-in-the-loop

IMPROVE: Iterative Model Pipeline Refinement and Optimization Leveraging LLM Agents

Feb 25, 2025
EX
Eric Xue
🏛️ University of Toronto | University of Wisconsin - Madison | New York University | University of Illinois at Urbana-Champaign

Existing LLM-driven automated visual modeling approaches rely on global, one-shot optimization, resulting in poor attribution, slow convergence, low stability, and limited accessibility for non-experts. Method: We propose an “iterative single-component fine-tuning” strategy, inspired by expert human practice, wherein only one module in the pipeline is optimized per iteration. This is integrated with training-feedback-guided modular updates, zero-shot prompt engineering, and a multi-domain evaluation protocol to construct an end-to-end LLM agent framework. Contribution/Results: Our approach significantly enhances interpretability, stability, and convergence efficiency of optimization. Evaluated across multiple standard benchmarks and Kaggle datasets, it consistently outperforms state-of-the-art zero-shot LLM methods, achieving superior classification accuracy and generalization capability.

Automate computer vision model developmentEnhance model performance and stabilityIteratively refine ML pipeline components

A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning

Aug 13, 2024
PY
Prateek Yadav
🏛️ UNC-Chapel Hill | University of Toronto | Vector Institute | MIT-IBM Watson AI Lab | Microsoft Research | Mila

Efficiently reusing multiple domain- or task-specific fine-tuned expert models while achieving high performance and strong generalization remains challenging. Method: We propose MoErging—a unified methodology for model merging, Mixture of Experts (MoE), and multi-task learning—featuring input-aware dynamic routing, parameter-space fusion, learnable router design, and collaborative multi-expert inference. Contribution/Results: We introduce the first taxonomy of MoErging methods; develop an open-source toolchain and standardized evaluation benchmark; and construct the first multidimensional MoErging knowledge graph. Our analysis rigorously characterizes applicability boundaries and performance trade-offs across paradigms, establishing a theoretical framework and practical guidelines for collaborative model reuse.

Designing routers to select expert models for specific inputsRecycling expert models for improved performance or generalizationSurveying MoErging methods to compare and unify diverse approaches

Latest Papers

What's happening recently
View more

This study addresses the limitations of open-source large language models in automatically generating high-quality code review feedback, particularly in comparison to closed-source counterparts. Focusing on Java error feedback generation in programming education, it presents the first systematic comparison between parameter-efficient fine-tuning (PEFT) and prompt engineering. Leveraging the Code Llama model and a high-quality feedback dataset, the authors conduct a multidimensional evaluation using BLEU, ROUGE, BERTScore, and human assessment. Results demonstrate that PEFT substantially outperforms prompt engineering, with student evaluations indicating that the generated feedback achieves quality comparable to that of ChatGPT. These findings validate the feasibility of deploying open-source models at scale in educational programming contexts.

Automated Code ReviewFeedback GenerationModel Fine-Tuning

This study investigates how human-in-the-loop (HITL) feedback influences users’ perceptions of system accuracy and trust, highlighting the critical moderating role of task subjectivity. Through three controlled user experiments that systematically differentiate between objective and subjective task contexts, the research analyzes behavioral measures to assess the effects of feedback interaction. Findings reveal that in objective tasks, providing feedback significantly diminishes users’ trust in and perceived accuracy of the system, whereas this negative effect vanishes in subjective tasks. These results underscore task type as a pivotal factor shaping human–AI trust dynamics and offer important theoretical grounding and practical guidance for the design of HITL systems.

Human-in-the-Loopobjective feedbackperceived accuracy

Existing single-prompt agents in 3D modeling lack planning and reflective capabilities, struggling to simultaneously achieve high geometric accuracy, aesthetic quality, and task completion rates. This work proposes a Planner-Actor-Critic multi-agent framework that introduces, for the first time, a structured self-reflection mechanism. By integrating real-time human guidance with the Blender MCP toolchain, the framework establishes a collaborative closed loop among planning, execution, and critique. This approach enables synchronous human-AI co-modeling and significantly outperforms baseline methods across diverse scenarios, demonstrating marked improvements in geometric precision, aesthetic quality, and task success rate, along with a substantial reduction in error frequency.

3D modelingaesthetic qualityagent-based modeling

This study addresses the problem of "model collapse"—a degradation in performance arising when multiple models interactively learn from synthetic data generated by one another. By formalizing inter-model interactions as a directed graph, the work establishes, for the first time, necessary and sufficient conditions for model collapse in multi-model settings, thereby extending beyond prior analyses limited to single-model self-training. The theoretical framework integrates directed graph topology, finite-sample analysis of linear regression, and asymptotic theory of M-estimators to rigorously characterize the collapse mechanism. Extensive numerical experiments validate the theoretical findings and uncover an intrinsic relationship between the structure of the interaction graph and the extent of performance degradation across models.

generative modelsinteraction topologyinteractive learning

Hot Scholars

MV

Marcel van Gerven

Professor of Artificial Cognitive Systems, Donders Institute for Brain, Cognition and Behaviour
Artificial IntelligenceMachine LearningComputational Neuroscience
MH

Max Hinne

Associate professor, Radboud University Nijmegen
Bayesian StatisticsMachine LearningAINeuroscience
LG

Lin Gu

Research Scientist, RIKEN AIP, University of Tokyo
Computational PhotographyPhotoacoustic ImagingMedical ImageComputer Vision
RG

Randy Goebel

Professor of Computing Science, University of Alberta
artificial intelligencelogical reasoningvisualizationmachine learning
MW

Matthias Weiß

PhD Student, University of Stuttgart
Electrical EngineeringSoftware Engineering