The KV cache management is probably doing more work here, than most people will notice.

The KV cache management is probably doing more work here, than most people will notice. Continuity lives in memory, not only in pixels. Great project.