All pull requests

Pull requests

• feat(rocm): run on RDNA3/RDNA4 with torch 2.14/2.15 and ROCm 7.14/10

  #587·zhangnju opened Oct 1, 2026·

  ·
  1

• refactor(hf): merge an override into the section's own dict, with no fallback

  #586·YevheniiKotyrlo opened Oct 1, 2026Contributor·

  ·

• perf(linear): run a single-row bf16 projection as one GEMV

  #585·YevheniiKotyrlo opened Sep 30, 2026Contributor·

  ·

• fix(engine): size memory pools against the VRAM other processes leave free on Windows

  #583·YevheniiKotyrlo opened Sep 30, 2026Contributor·

  ·
  1

• test(quant): skip declined local checkpoints and label cache paths portably

  #582·YevheniiKotyrlo opened Sep 30, 2026Contributor·

  ·

• fix(windows): read checkpoints without O_DIRECT, posix_fadvise or PROT_READ

  #581·YevheniiKotyrlo opened Sep 30, 2026Contributor·

  ·

• fix(windows): serve over loopback ZMQ and a selector event loop

  #580·YevheniiKotyrlo opened Sep 30, 2026Contributor·

  ·

• perf(moe): dequant nvfp4 prefill experts by bit placement and load activations contiguously

  #578·YevheniiKotyrlo opened Sep 30, 2026Contributor·

  ·

• feat(kvcache): keep prefill-chunk GDN checkpoints in a pinned host bank

  #577·skavans opened Sep 30, 2026·

  ·
  1

  1

• fix(windows): build the extensions and JIT kernels with MSVC

  #575·YevheniiKotyrlo opened Sep 29, 2026Contributor·

  ·

• feat(engine): --vram-reserve-mb keeps VRAM free at the largest prefill

  #574·YevheniiKotyrlo opened Sep 29, 2026Contributor·

  ·

• fix(server): keep a silent stream alive and notice a client that left

  #572·YevheniiKotyrlo opened Sep 29, 2026Contributor·

  ·
  1

• fix(ple): strict shard schema/geometry, nofollow + bounded discovery, mutation evidence, and pinned-bank admission/rollback

  #565·Avicennasis opened Sep 29, 2026·

  ·

• fix(server): do not auto-select qwen3 parser for instruct-2507

  #564·SanjayS45 opened Sep 28, 2026·

  ·
  1

• feat(moe): pin hot experts so fp8 qwen3.8-flash-next serves on a 48gb card

  #563·mmletgo opened Sep 28, 2026·

  ·
  8

• fix(engine): charge the attention workspace in moe-cache-auto sizing

  #562·Cyber-Marty opened Sep 28, 2026·

  ·
  1

• fix(kvcache): clone inserted radix keys to release request buffers

  #559·taking-lying-flat opened Sep 27, 2026Contributor·

  ·

• feat(server): --api-key flag for bearer token auth on the HTTP API

  #558·santanu20 opened Sep 27, 2026·

  ·

• feat(server): publish cumulative prefill and decode timing on /v1/stats

  #553·mgeldi opened Sep 25, 2026·

  ·
  1

• improve installation success rate with higher timeout and retries

  #551·jlisbz opened Sep 25, 2026·

  ·

• ci(rocm): add ROCm 10.0.0 Dockerfile and validation workflow

  #535·LZ-QWQ opened Sep 22, 2026Contributor·

  ·

• fix(server): clamp /v1/models context_length to the allocated KV pool

  #531·oscar-investmatic opened Sep 20, 2026·

  ·
  1

• fix(sampling): apply presence and frequency penalties

  #527·taking-lying-flat opened Sep 19, 2026Contributor·

  ·

• feat(kvcache): host-resident prefix tier for hybrid GDN models (snapshots + KV pages)

  #525·alvarorsouza-arch opened Sep 19, 2026·

  ·
  1

• feat(glm5_next): serve GLM-5.3-Flash with tensor parallelism

  #507·calvarado2004 opened Sep 17, 2026·

  ·