All pull requests

Pull requests

• Load single-file checkpoints once upfront during splitting and handle non-numeric shard names

  #380·ALANDVO opened Oct 12, 2026·

  ·

• Resume interrupted layer splitting without rewriting saved shards

  #378·mvanhorn opened Oct 11, 2026·2 tasks done·

  ·

• Add dry-run disk and VRAM estimates before weight download

  #377·mvanhorn opened Oct 11, 2026·4 tasks done·

  ·

• fix(mlx): respect rope_theta from HF config (fixes #368)

  #375·Lemniscate-world opened Oct 11, 2026·

  ·
  1

  1

• Enable ROCm inference with Strix Halo validation

  #373·sa-faizal opened Oct 6, 2026·

  ·
  1

  1

• feat: add automatic CUDA, MPS, and CPU device selection

  #372·hamzalgz opened Sep 28, 2026·

  ·
  1

• Fix typos in README

  #370·Londopy opened Sep 20, 2026·

  ·

• Carry rope_theta from the config in the MLX Llama path (fixes #368)

  #369·Hotragn opened Sep 17, 2026·

  ·
  1

• Pick the best available device instead of assuming CUDA (fixes #365, #355, #153)

  #366·Hotragn opened Sep 16, 2026·

  ·
  2

  1

• fix: accept PyTorch tokenizer inputs in MLX generate

  #363·Vaishnavi220506 opened Sep 9, 2026·

  ·
  1

• Add CLI and interactive terminal chat

  #358·prathamc00 opened Sep 4, 2026·4 tasks done·

  ·
  6

• feat: Add fixed-slot GPU expert streaming for PhiMoE

  #350·DevElCuy opened Aug 24, 2026·

  ·

• feat: support prequantized BitsAndBytes streaming with Transformers 5

  #347·DevElCuy opened Aug 23, 2026·

  ·

• Support nested Gemma 4 checkpoint layout

  #346·ousamabenyounes opened Aug 22, 2026·

  ·
  1

  2

• Don't use per-expert streaming when shards are compressed

  #344·Hotragn opened Aug 21, 2026·

  ·

• fix: robust layer-count parsing for nested checkpoint prefixes (complements #336)

  #339·HEETMEHTA18 opened Aug 9, 2026·

  ·
  1

  12

• fix: handle missing files gracefully in remove_real_and_linked_file (#297)

  #337·bhumitschaudhry opened Aug 7, 2026·

  ·
  1

  6

• docs: clarify compression performance tradeoffs

  #334·aryansk opened Aug 6, 2026·

  ·
  1

  3

• fix: critical bugs — unsafe torch.load (RCE), UnboundLocalError crash, thread leak, broken tests

  #333·Sunil56224972 opened Aug 5, 2026·

  ·
  1

• docs: add Russian README translation

  #332·MonteNegroX opened Aug 5, 2026·

  ·

• fix: avoid eager MLX LlamaForCausalLM import

  #329·maxitoon opened Aug 4, 2026·

  ·
  1

  1

• docs: list Kimi K3 in Supported Models (#316)

  #327·evanclan opened Aug 4, 2026·3 of 4 tasks·

  ·

• feat: AIRLLM_FULL_LOAD bypass — skip layer streaming when model fits in VRAM

  #324·he1074937561-a11y opened Aug 3, 2026·

  ·
  3

• feat: add lightweight CPU-only CI/test harness

  #322·ardiannurcahya opened Aug 2, 2026·

  ·
  1

• Fix the unit tests so they can actually run

  #315·Hotragn opened Jul 28, 2026·

  ·
  2