High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.
-
Updated
Jul 22, 2026 - Python
#
roofline-analysis
Here are 6 public repositories matching this topic...
JAX benchmarking, profiling and evaluation metrics for Flax NNX: a registry of pure-function metrics (regression, classification, calibration, uncertainty, forecasting, generative, image, text, audio, graph, fairness), XLA FLOP counting, roofline analysis, GPU and energy monitoring, regression detection, publication exports, W&B and MLflow.
python benchmarking machine-learning metrics calibration statistical-analysis profiling uncertainty-quantification evaluation-metrics model-evaluation jax energy-monitoring probabilistic-forecasting mlflow regression-detection flops wandb gpu-profiling flax-nnx roofline-analysis
-
Updated
Sep 11, 2026 - Python
Kernel-level profiling of batch-1 decode on consumer GPU to prove that decode is memory-bandwidth-bound against the hardware roofline, then beating the baseline with a fused dequant+GEMV CUDA kernel. (regime-aware attribution at the end)
-
Updated
May 30, 2026 - Python
ARM NEON SIMD optimizations on Apple Silicon for attention (31.88 GFLOPS/s, 11.1x speedup) and Black-Scholes (1.03x, proving SIMD fails on transcendental-heavy workloads). Roofline analysis predicts optimization potential before implementation. OpenMP parallelization.
performance-engineering openmp simd attention-mechanism black-scholes arm-neon apple-silicon roofline-analysis
-
Updated
May 24, 2026 - C++
Three measured notebooks on GPU inference optimization: roofline analysis, KV-cache decode optimization (4.21x), and CUDA-graph launch-overhead elimination (5.38x). Pure PyTorch.
gpu pytorch performance-optimization inference-optimization kv-cache llm-inference torch-compile roofline-analysis cuda-graphs
-
Updated
Jul 7, 2026 - Jupyter Notebook
High-performance computing project exploring CPU and GPU matrix multiplication optimization through OpenMP, CUDA, tiled kernels, and cuBLAS, with detailed performance analysis across large matrix sizes
-
Updated
May 6, 2026 - Cuda
Add this topic to your repo
To associate your repository with the roofline-analysis topic, visit your repo's landing page and select "manage topics."