Modern LLMs typically return answers through a token-by-token streaming process, where each token is packaged into a separate encrypted message. While the text itself is unreadable under TLS, the timing and size of packets can still be observed. The researchers show that this metadata follows consistent patterns tied to the content being generated, which creates a side channel for sensitive inference.
Encrypted or not, your AI chats aren’t private