When LLM-Inferred User Context Adds Value in Production Streaming Recommendation
This study addresses the unclear applicability of large language model (LLM)-generated profiles versus aggregated embeddings for streaming media recommendation by systematically evaluating both user representation strategies in a production environment. Methodologically, LLMs are leveraged to generate natural language summaries, while an attention mechanism integrates long- and short-term behavioral features. The findings reveal that representation effectiveness depends significantly on user consumption patterns: habitual users benefit more from aggregated profiles, whereas exploratory users gain greater advantages from the semantic context provided by LLMs. Accordingly, this work proposes a dynamic profile selection strategy conditioned on user consumption states. This approach effectively circumvents the limitations inherent in either method alone, yielding substantial improvements in overall recommendation performance.