Implementation of Universal Transformer in Pytorch
-
Updated
Nov 19, 2018 - Python
#
universal-transformer
Here are 9 public repositories matching this topic...
The implementation of Adaptive Computation function used in RNN "https://arxiv.org/pdf/1603.08983.pdf" and Universal Transformer Network "https://arxiv.org/pdf/1807.03819.pdf"
-
Updated
Aug 30, 2018 - Python
Universal Transformers implementation in PyTorch
-
Updated
Jul 14, 2022 - Python
Awesome list of papers, code, models and blogs on Looped / recurrent-depth / weight-tied Transformers — depth as a third scaling axis
awesome-list universal-transformer large-language-models looped-transformers test-time-compute recurrent-depth latent-reasoning
-
Updated
Sep 5, 2026
Unofficial Implementation of Universal Transformer https://arxiv.org/abs/1807.03819
machine-learning deep-learning tensorflow adaptive-computation-time tensor2tensor self-attention universal-transformer
-
Updated
Oct 14, 2018 - Python
Does the Universal/Looped-Transformer trick (reuse one block N times instead of stacking N) work on Mamba? Weight-shared depth in a state-space model, with honest per-seed results.
deep-learning reproducible-research pytorch ssm mamba state-space-models weight-sharing universal-transformer sequence-modeling recurrent-depth parameter-efficiency looped-transformer associative-recall
-
Updated
Sep 10, 2026 - Python
Awesome list + deep-dive reports on looped / recurrent-depth transformers (2018-2026): the Loop technology behind GPT-6 Astra. 122 papers, ZH/EN reports, translated PDFs, survey, slides.
transformers awesome-list universal-transformer llm test-time-compute recurrent-depth latent-reasoning looped-transformer
-
Updated
Sep 8, 2026 - Python
Simple from-scratch implementations of transformer-based models that match the state of the art.
transformers transformer attention universal-transformer universal-transformers xlnet transformer-xl
-
Updated
Dec 8, 2022 - Python
Multi strategy logit fusion between Ouro-1.4B (Universal Transformer) and HRM-Text-1B (prefix-LM) for improved text generation
entropy transformers fusion benchmarks language-model kl-divergence perplexity universal-transformer logits llm ouro-1-4b hrm-text-1b js-div
-
Updated
Jul 1, 2026 - Python
Add this topic to your repo
To associate your repository with the universal-transformer topic, visit your repo's landing page and select "manage topics."