# Compressed Convolutional Attention (CCA)

> Attention computed directly in a compressed latent space, with convolutional mixing.

Category: Sparse & compressed attention

Where MLA uses a latent mainly as a compact cache format and decompresses it for attention, CCA performs the attention operation itself in the compressed space and adds convolutions to mix information.

ZAYA1-8B by Zyphra uses CCA together with grouped-query attention.

**Trade-off:** Saves both cache memory and attention FLOPs; still a young technique.

## Models using CCA (1)

- [ZAYA1-8B (8.4B)](https://llm-atlas-7or.pages.dev/models/zaya1-8b.md) — Zyphra, 2026-05-06

Full explainer with figures by Sebastian Raschka: https://sebastianraschka.com/llm-architecture-gallery/compressed-convolutional-attention/
Web page: https://llm-atlas-7or.pages.dev/concepts/compressed-convolutional-attention/