# Gated Residuals (GR)

> Gated read/write modules over four residual streams, without mHC's mixing matrix.

Category: Residual stream

Before a sublayer, a GR Read module normalises each of four residual streams, gates them element-wise and averages them into a normal-width input. Afterwards, GR Write adds the output back to all four streams with learned gates.

It was introduced with Qwen3.8-Flash-Next and is related in spirit to mHC.

**Trade-off:** Wider residual capacity with simple gating instead of a constrained mixing matrix.

## Models using GR (1)

- [Qwen3.8-Flash-Next (125B-A6B)](https://llm-atlas-7or.pages.dev/models/qwen3-8-flash-next-125b-a6b.md) — Alibaba Cloud, 2026-08-26

Full explainer with figures by Sebastian Raschka: https://sebastianraschka.com/llm-architecture-gallery/gated-residuals/
Web page: https://llm-atlas-7or.pages.dev/concepts/gated-residuals/