🤖 AI Summary
Hardware cache prefetching, memory scheduling, and channel interleaving obscure program context, hindering context-aware memory management. Method: This paper proposes a lightweight context-aware memory system that encodes program execution markers and object address ranges—i.e., contextual state—directly into standard memory read address streams as detectable metadata packets, requiring no privileged access or custom drivers. It integrates metadata injection, HMU-based telemetry hardware, and near-memory computing to enable bidirectional embedding and parsing of context within the address stream. Contribution/Results: A prototype demonstrates highly reliable metadata decoding from real address traces, enabling runtime fine-grained data scheduling, priority-aware memory management, and dynamic reconfiguration of memory devices. To our knowledge, this is the first end-to-end verifiable, zero-intrusion, fully user-space context-aware memory architecture.
📝 Abstract
Requests arriving at main memory are often different from what programmers can observe or estimate by using CPU-based monitoring. Hardware cache prefetching, memory request scheduling and interleaving cause a loss of observability that limits potential data movement and tiering optimizations. In response, memory-side telemetry hardware like page access heat map units (HMU) and page prefetchers were proposed to inform Operating Systems with accurate usage data. However, it is still hard to map memory activity to software program functions and objects because of the decoupled nature of host processors and memory devices. Valuable program context is stripped out from the memory bus, leaving only commands, addresses and data. Programmers have expert knowledge of future data accesses, priorities, and access to processor state, which could be useful hints for runtime memory device optimization. This paper makes context visible at memory devices by encoding any user-visible state as detectable packets in the memory read address stream, in a nondestructive manner without significant capacity overhead, drivers or special access privileges. We prototyped an end-to-end system with metadata injection that can be reliably detected and decoded from a memory address trace, either by a host processor, or a memory module. We illustrate a use case with precise code execution markers and object address range tracking. In the future, real time metadata decoding with near-memory computing (NMC) could provide customized telemetry and statistics to users, or act on application hints to perform functions like prioritizing requests, remapping data and reconfiguring devices.