RetainCode: One-Bit Exact Gated-MLP Activation Compression from Retained Products DOI: https://doi.org/10.5281/zenodo.21698623
floating-point preprint swiglu memory-efficient-training activation-compression gated-mlp one-bit-encoding exact-gradients
-
Updated
Aug 19, 2026 - TeX