InterHier: Learning Interconnected Hierarchical Semantics for Open-Vocabulary Object Detection

2026-09-20

AI Summary

本文针对开放词汇目标检测中固定连接器的局限性，提出了一种通过可学习上下文引导的互连层次语义表示方法InterHier，优化了视觉和文本嵌入的对齐。

Abstract

In this paper, we investigate the limitations of fixed, hand-crafted connectors in hierarchical semantic representations for open-vocabulary object detection. Existing methods establish semantic relationships between base categories and unseen novel categories by placing a fixed connector between adjacent super-/sub-categories. However, such fixed connectors may not optimally capture the relationships within a semantic hierarchy. To address this limitation, we propose interconnected hierarchical semantic representations (InterHier), which utilize a prepended learnable context to globally guide the interpretation of prompts containing hierarchical relationships. InterHier operates in two main stages. First, it constructs a hierarchy-aware prompt by integrating super-/sub-categories and prepending a learnable context. Second, it optimizes this learnable context to align visual region embeddings and textual embeddings. InterHier consistently improves performance over methods that rely on fixed connectors and can be seamlessly integrated into existing open-vocabulary object detection models. Experiments on open-vocabulary object detection benchmarks demonstrate that InterHier achieves competitive performance against state-of-the-art methods.

Problem

• open-vocabulary object detection
• hierarchical semantic representations
• fixed connectors
• semantic relationships
• unseen novel categories

Innovation

• Interconnected Hierarchical Semantics
• Learnable Context
• Open-Vocabulary Object Detection
• Hierarchy-Aware Prompt