Tactical Telemetry: Leveraging Replay Files with AI, for AI

Peter Xenopoulos

[Invited]

Presenter: Peter Xenopoulos

Replays, generated to the tune of hundreds of terabytes a day, are highly compressed, structured traces of competitive decision-making. While replay data has long existed, the interface between raw replay files and actionable insight remains painfully complex. Recent AI advances afford us the missing translation layer, capable of quickly decoding this raw tactical telemetry into deep, semantic understanding. In this presentation, we detail the tooling necessary to standardize, scale, and semanticize this data at scale. Finally, we examine how this AI-translated telemetry powers next-generation applications, from automated coaching and advanced anti-cheat to training AI agents through imitation learning.