Repository navigation

Merge upstream - #4

Open

crusaderky wants to merge 384 commits into

ifm-ai:model/K2Horizonfrom

crusaderky:k2-merge-upstream

Open

Merge upstream#4
crusaderky wants to merge 384 commits into
ifm-ai:model/K2Horizonfrom
crusaderky:k2-merge-upstream

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 4, 2026
- docs : update maintainer PRs link and regenerate AUTHORS (#28365)
  ggerganov
  authored
  a529af9
- ggml : remove GGML_CUDA_PEER_MAX_BATCH_SIZE (#28177)
  angt
  authored
  24f5bf8
- ggml : don't crash when backend search path can't be read (#28271)
  angt
  authored
  4cbe8b0
- Don't use npx inside a package.json script (#28270)
  eapache
  authored
  d509cb1
- ggml : replace compile definitions with version.h.in (#28364)
  danbev
  authored
  86b351f
- metal : add remaining fa-vec tunings for M3 Max (#28373)
  nikwen
  authored
  8f83678
- model, mtmd: fix gemma4 vision handling (#28335)
  Xuan-Son Nguyen
  authored
  163a407
- sync : ggml (#28379)
  ggerganov
  authored
  64a155d
- llama.cpp : bump version to 0.4.0 (#28386)
  ggerganov
  authored
  5266f24
- model : add Tencent Hy 4 (hy_v4) preview architecture support (#28127)
  
  authored
  49c0dc8
- ui: export conversations from database instead of cached store (#27432)
  intel00000
  authored
  1863ac0
- ci : move more jobs to ccache-buckets (#28375)
  CISC
  authored
  8b4b355
- opencl: add Adreno xmem SDPA path (#26331)
  happyyzy
  authored
  4acf4a4
- opencl: extend the elementwise and data‐movement op coverage (#27633)
  wanghqc
  authored
  1548a24
- ui : fix MCP image attachments not displayed in tool block (#25789) (#28089)
  nachobh
  authored
  85d5703
- metal : add remaining fa-vec tunings for M3 (#28396)
  init-22
  authored
  427291b
Commits on Sep 5, 2026
Commits on Sep 6, 2026
- metal : add remaining fa-vec tunings for M2 Max (#28458)
  nikwen
  authored
  971595d
- ui : embed assets directly with CMake (#28445)
  angt
  authored
  c457e3b
- common: add --log-jsonl (#28437)
  Xuan-Son Nguyen
  authored
  7620399
- ui: Improve Chat Messages rendering performance (#28460)
  allozaur
  authored
  0afb805
- grammar : fix max repetition threshold (#28469)
  aldehir
  authored
  9e0e220
- cuda: fixes races in mmid and mmf (#28475)
  am17an
  authored
  73a43d1
- opencl: properly choose weights pack for q4_K, q5_K mul_mat (#28402)
  lhez
  authored
  d03efa5
- [Model] Support for Spark2_5ForCausalLM implementation (#27868)
  
  authored
  3ad1ba7
- models : fix GDN normalization from `max` to `rsqrt` (#28068)
  
  danielhanchen
  and
  ggerganov
  authored
  5fdfa62
- convert : add `--fuse-qkv` flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (#22780)
  JoursBleu
  authored
  465e49b
Commits on Sep 7, 2026
- vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (#27765)
  Anjielon
  authored
  8fe90e1
- ci : add container image checking and tagging (wip) (#28394)
  danbev
  authored
  2092353
- vulkan: rms_norm fusion opportunities (#28024)
  jeffbolznv
  authored
  9ac8c40
- ggml: allow backend inputs to not create another split (#28387)
  am17an
  authored
  992cb50
- ggml-cuda: fix divergent barrier in f16 flash attention (#27870)
  siavashnorouzi
  authored
  b74f590
- convert : write explicit recurrent_layers for Qwen3-Next / Qwen3.5 (#28208)
  
  devvexus
  and
  claude
  authored
  9a75705
- caps : recheck typed content if template checks for string (#28511)
  CISC
  authored
  5202104
- examples : print ggml_version and ggml_commit in test-cmake [no ci] (#28538)
  danbev
  authored
  1173700
- vulkan: support type-aligned GET_ROWS (#28253)
  
  jeffbolznv
  and
  AiChiTuDouPian
  authored
  0cae430
- CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (#26705)
  praneshgo
  authored
  73ab759
- convert : refactor Hy4-preview conversion - move HC tensor mapping to the global map (#28451)
  
  fairydreaming
  and
  sszymczy
  authored
  d23c47f
- ggml: add gfx90c HIP support (#26454)
  AuroraRAS
  authored
  4735997
- CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#24546)
  
  ravel7524
  and
  IMbackK
  authored
  0c96345
- vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (#26578)
  
  kh0pper
  and
  Kevin Hopper
  authored
  7a333e7
- sycl: add a batched L2_NORM kernel (#28222)
  Titaniumtown
  authored
  dbeb375
- server: fix LRU hang on multiple requests same model (#28539)
  
  Xuan-Son Nguyen
  and
  ServeurpersoCom
  authored
  160bd03
- webgpu: format the GET_ROWS case block (#28542)
  ServeurpersoCom
  authored
  c0b1871
- nix : update deprecated expressions (#28145)
  ZhaolunYin
  authored
  ccc3646
- Revert "CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#24546)" (#28551)
  pwilkin
  authored
  e71b805
- tests : initialize the L2_NORM batch array (#28553)
  ServeurpersoCom
  authored
  f114f91
- ci : bump ty to 0.0.78 (#28548)
  CISC
  authored
  67672dc
Commits on Sep 8, 2026
Commits on Sep 9, 2026
- Add IQ type handling for MoE (#28476)
  
  cwriter
  and
  cwriter
  authored
  304665f
- tests : use less threads for data initialization (#28325)
  ggerganov
  authored
  30b6a75
- vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1 (#27471)
  fish-jiang
  authored
  1945e09
- vulkan: add dedicated iq4_xs mat-vec shader (#28426)
  WakeUpMorty
  authored
  df750f7
- jinja: treat a null left operand of in as a plain lookup (#28620)
  ServeurpersoCom
  authored
  b31b71f
- mtmd: propagate video ID to bitmap (#28601)
  Xuan-Son Nguyen
  authored
  6de9cdb
- model: fix granite3 moe unknown parameter count (#28632)
  taronaeo
  authored
  e2d2c0d
- args: officially deprecate --mmap|mlock|dio (#28334)
  taronaeo
  authored
  14a9d09
- CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (#28079)
  
  pwilkin
  and
  JohannesGaessler
  authored
  5a4d0fe
- CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#28552)
  
  authored
  d4abd57
- llama : use int32_t for llama_sampler_chain_n return type (#28631)
  
  linsen458-spec
  and
  linsen
  authored
  4850c77
- py : bump numpy to 2.4.6 (#28649)
  CISC
  authored
  9cf3bf2
- py : lower numpy to 2.2.6 (#28654)
  CISC
  authored
  4b98ab8
- vulkan: Convert FILL to distribute workgroups in 2D to avoid exceeding maxComputeWorkGroupCount (#28592)
  rillomas
  authored
  22397c3
- hexagon: rope updates (#28628)
  
  tboinovski1
  and
  max-krasnyansky
  authored
  6d9c82e
- vulkan: use spec constant for matrix matrix multiplication A-type (#25773)
  0cc4m
  authored
  91f6a6c
- ci: fix sanitizer tests (#28583)
  netrunnereve
  authored
  434ddbb
Commits on Sep 10, 2026
Commits on Sep 11, 2026
Commits on Sep 12, 2026
- ggml-webgpu: Update to a recent version of Dawn (#28683)
  
  MendyBerger
  and
  yomaytk
  authored
  d3146f2
- hexagon: support for multi-device model split (aka row-split) (#28589)
  
  max-krasnyansky
  and
  alexlu-qc
  authored
  eafe15a
- webgpu: align tensor bindings to the type block size (#28382)
  ServeurpersoCom
  authored
  3f5e94d
- opencl: add bin kernel `kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin` (#28677)
  
  shaofeiqi
  and
  lhez
  authored
  07fc977
- opencl: fix several bugs where the backend aborts (#27630)
  wanghqc
  authored
  8a56aed
- server: frame the router child state command as a whole line (#28747)
  ServeurpersoCom
  authored
  c069aa7
- rpc : fix linking when compiling with BUILD_SHARED_LIBS=OFF (#28492)
  EAddario
  authored
  f3a33df
- syscl : Handle (fail gracefully) unsupported tq1_0 quants (#28681)
  mctylr-gh
  authored
  2a3005c
- vendor : update cpp-httplib to 0.56.0 (#28787)
  cabelo
  authored
  718f7b4
- server : add missing headers (#28795)
  angt
  authored
  e192abb
- ggml-cuda: hip add specific config table for AMD GCN (#27841)
  thelittlefireman
  authored
  c8edceb
- server : allow model downloads at model limit fix issue #26809 (#28530)
  chenmiaoming
  authored
  56381e4
- ui : add cache (#28802)
  angt
  authored
  3057bb6
- cmake: leave the timestamp out of precompiled headers on clang (#28816)
  ServeurpersoCom
  authored
  737e098
- jinja : support dot property integer literals (#28817)
  CISC
  authored
  ae9afff
- common : implement common_schema internal representation for JSON schemas (#28736)
  aldehir
  authored
  acecd56
- common: add LOG_JSON macro to log structured data (#28586)
  Xuan-Son Nguyen
  authored
  8e33095
Commits on Sep 13, 2026
Commits on Sep 14, 2026
- common : move llama_n_rs_seq to before llama_decode (#28749)
  danbev
  authored
  093a2f8
- sycl : fix oneDNN scratchpad breaking the pool free order (#28704)
  lslusarczyk
  authored
  661643e
- ci : remove gg_sum summary logic (#28857)
  ggerganov
  authored
  15d8f2d
- ci : trigger self-hosted CI on changes to ci/run.sh (#28859)
  ggerganov
  authored
  89fe242
- ggml-cpu : disable PCH and fix CACHE_LINE_SIZE ambiguity to fix heap corruption (#28882)
  ggerganov
  authored
  2f53959
- sycl: rfc: Use radix select for top_k (#28670)
  
  cwriter
  and
  cwriter
  authored
  21f6b0d
- llama: add Maple 20B-A1B ternary MoE architecture (CPU) (#27000)
  AlexGabbia
  authored
  3d10bcd
- tests(s390x): add non-vxe build to tests (#28776)
  taronaeo
  authored
  be2c6d7
- models : fix mimo2 swa pattern load (#28865)
  CISC
  authored
  1aca1f9
- models : fix incorrect uses of get_key_or_arr (#28868)
  CISC
  authored
  97e4ca7
- tests : add fusion baseline README and broaden fusion CI triggers (#28893)
  ggerganov
  authored
  bbdd9f2
- ggml : bump version to 0.24.0 (ggml/1627)
  ggerganov
  committed
  eeea731
- sync : ggml
  ggerganov
  committed
  d9e03f1
- llama.cpp : bump version to 0.4.1 (#28900)
  ggerganov
  authored
  b29c606
- scripts: Add script to verify API/ABI compatibility (#28579)
  ckastner
  authored
  dfe4516
- cmake : remove precompiled headers (#28892)
  danbev
  authored
  f3a184b
- release : added gfx1103 to ubuntu rocm build (#28423)
  apparle
  authored
  b4fa47d
- qwen4exp: enable rms_norm + mul fusion (#28896)
  am17an
  authored
  41abbfd
- ci : add ubuntu-cuda builds to release (#28186)
  
  ORippler
  and
  CISC
  authored
  391fac1
- HIP: fattn-mma: use fp32 accumulation on MFMA devices (#28576)
  IMbackK
  authored
  bfdc321
- CI: hip-quality-check: ignore spill added in bfdc32183d57f1e35bacf35c47d6311e2028bbbc (#28909)
  IMbackK
  authored
  96ffdc4
- ci : reuse build tag name when used instead of safe one (#28911)
  CISC
  authored
  7cf1c54
- webui: stop re-probing disabled /tools endpoint on every message (#28646)
  geckguy
  authored
  1bc7a5a
Commits on Sep 15, 2026
Commits on Sep 16, 2026
Commits on Sep 17, 2026
Commits on Sep 18, 2026
Commits on Sep 19, 2026

Commits

Commits on Sep 4, 2026

Commits on Sep 5, 2026

Commits on Sep 6, 2026

Commits on Sep 7, 2026

Commits on Sep 8, 2026

Commits on Sep 9, 2026

Commits on Sep 10, 2026

Commits on Sep 11, 2026

Commits on Sep 12, 2026

Commits on Sep 13, 2026