dynamic-sparse-training

Here are 9 public repositories matching this topic...

Shiweiliuiiiiiii / In-Time-Over-Parameterization

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

sparsity deep-learning generalization sparse-training over-parameterization overparameterization in-time-overparameterization dynamic-sparse-training in-time-over-parameterization

Updated Nov 11, 2023
Python

VITA-Group / Sparsity-Win-Robust-Generalization

Star

[ICLR 2022] "Sparsity Winning Twice: Better Robust Generalization from More Efficient Training" by Tianlong Chen*, Zhenyu Zhang*, Pengjun Wang*, Santosh Balachandra*, Haoyu Ma*, Zehao Wang, Zhangyang Wang

sparsity pruning generalization lottery-ticket-hypothesis robust-overfitting dynamic-sparse-training robust-generalization

Updated Mar 20, 2022
Python

VITA-Group / SMC-Bench

Star

[ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, AJAY KUMAR JAISWAL, Zhangyang Wang

benchmark sparsity deep-learning pruning sparse-neural-networks dynamic-sparse-training

Updated Aug 29, 2023
Python

DarshanFofadiya / sparselab

Star

Actually-sparse dynamic training for PyTorch. CPU-native, Apple Silicon first. Pluggable routers, drop-in SparseLinear.

deep-learning pytorch pybind11 sparse-neural-networks sparse-training apple-silicon neon-intrinsics dynamic-sparse-training cpu-optimization rigl

Updated May 19, 2026
Python

Shiweiliuiiiiiii / Selfish-RNN

Star

[ICML 2021] "Selfish Sparse RNN Training" by Shiwei Liu, Decebal Constantin Mocanu, Yulong Pei, Mykola Pechenizkiy

recurrent-neural-networks awd-lstm onlstm sparse-training dynamic-sparse-training awd-mos-lstm sparse-rnn-training

Updated Oct 8, 2021
Python

zahraatashgahi / NeuroFS

Star

[TMLR] Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks

python deep-learning keras efficiency high-dimensional-data feature-selection neural-networks sparse-neural-networks sparse-training dynamic-sparse-training

Updated Feb 12, 2023
Python

JafarBadour / Snack-SNN

Star

SNACK: truly sparse GPU layers with a custom COO SpMM CUDA kernel — NeurIPS 2026 (arXiv:2610.04093)

cuda pytorch gpu-acceleration sparse-neural-networks spmm dynamic-sparse-training neurips-2026

Updated Oct 9, 2026
Jupyter Notebook

ckirby04 / ANP

Star

Pre-registered study of dynamic sparse training in 3D medical segmentation (nnU-Net, BraTS-MEN). v1 pilot void by a design error found after it ran; v2 gates proposed and not in effect, no v2 arm run yet.

reproducible-research pytorch medical-imaging image-segmentation sparse-training nnunet dynamic-sparse-training