Process Integrated Computer Vision for Real-Time Failure Prediction in Steel Rolling Mill

2025-10-30

AI Summary

To address the challenge of real-time early warning for equipment failures and process disruptions in steel hot-rolling—leading to high unplanned downtime costs—this paper proposes a lightweight vision-sensor fusion analytical framework. The method deploys industrial cameras to continuously capture video streams of mill status and strip motion; an edge-based anomaly detection model reduces PLC computational load, while a central video server fuses visual features with multi-source process data (e.g., temperature, current, vibration) to enable early fault identification and generate interpretable maintenance recommendations. Its key innovation lies in embedding anomaly detection directly into the production control loop, ensuring cross-line scalability and operational adaptability. Field validation at a major steel plant demonstrates a 32.7% reduction in unplanned downtime and a 24.5% decrease in maintenance costs, significantly enhancing production line reliability and operational efficiency.

Technology Category

Intelligent Robots: Multimodal Perception & Sensor FusionComputer Vision: Multi-modal VisionData Mining & Knowledge Management: Anomaly/Outlier Detection

Application Category

Economics, Online Markets and Human Computation: Cost models of using LLMs in production systemsSystems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applicationsResponsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

We present a long-term deployment study of a machine vision-based anomaly detection system for failure prediction in a steel rolling mill. The system integrates industrial cameras to monitor equipment operation, alignment, and hot bar motion in real time along the process line. Live video streams are processed on a centralized video server using deep learning models, enabling early prediction of equipment failures and process interruptions, thereby reducing unplanned breakdown costs. Server-based inference minimizes the computational load on industrial process control systems (PLCs), supporting scalable deployment across production lines with minimal additional resources. By jointly analyzing sensor data from data acquisition systems and visual inputs, the system identifies the location and probable root causes of failures, providing actionable insights for proactive maintenance. This integrated approach enhances operational reliability, productivity, and profitability in industrial manufacturing environments.

Problem

• Predicts equipment failures in steel rolling mills using real-time computer vision
• Integrates industrial cameras and deep learning for proactive maintenance insights
• Reduces unplanned breakdown costs by analyzing sensor and visual data jointly

Innovation

• Deep learning models process live video streams
• Integrated sensor and vision data for root cause analysis
• Centralized server minimizes PLC computational load