SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement

2026-09-17

AI Summary

本文介绍SeetaPsych v1.0，一个开源计算机视觉工具包，通过面部图像和视频提取心理信号，解决行为基础的心理测量问题。

Abstract

Automated visual analysis opens new avenues for behavior--based psychological measurement. Nevertheless, existing technological modules are typically scattered across task specific systems with heterogeneous interfaces and disparate deployment requirements. In this work, we present SeetaPsych v1.0, an open source, unified and extensible computer vision toolkit designed to extract psychologically relevant signals from facial images and/or face based videos. The current release encompasses four major core modules aiming at behavior--based physiological perception: unified face based emotion analysis (simultaneous facial expression recognition, facial action unit detection, and valence--arousal estimation), camera based heart rate estimation, screen point--of--gaze estimation, and scene gaze following. A suite of auxiliary preprocessing modules for human centric visual analysis is also included, comprising face detection, facial landmark detection, and head detection. These functionalities are encapsulated within a modular Pipeline/Runner architecture that automatically resolves attribute dependencies, constructs computation graphs, and support intermediate result sharing among modules. SeetaPsych provides standardized Python APIs to facilitate reproducible, large scale analyses, alongside an interactive WebUI for rapid, code--free method evaluation. Overall, SeetaPsych offers an integrated and accessible visual measurement platform for research in psychology, behavioral science, human computer interaction, and related fields.

Problem

• behavior-based psychological measurement
• computer vision toolkit
• facial images
• face based videos
• technological modules

Innovation

• behavior-based psychological measurement
• modular Pipeline/Runner architecture
• open-source toolkit