<?xml version="1.0" encoding="UTF-8"?>
<otherdata xmlns="http://linux.duke.edu/metadata/other" packages="20">
<package pkgid="0622f52e59775c9367ea25a071ed7817d8408dfeb541fb2fb4f3d81214b7678d0247d8986aa1120695d132ea4f39ffd047d570d4ab17a24d4841e366d45aae12" name="ggml-devel" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="e58c890a770bcc93fbc76fcde3a55e01f1355873772aedbae3bc2235cf59eecaa9a698a8b443bee3e67a5a1d6b2931661ee0bcaed550b9f05370cd8e0ede5ba6" name="libggml-base0" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="a3e3b4045f338efcb18476446bc26fb43f70ca51ceabf26aaacb81b0d69767e0fd69bea8f8e09182d5e30ed81c7d0b1b52814dacd0e5fe3a550c350ed9f914f0" name="libggml-base0-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="dda15bb7c87e36c338d396ef67aaae78e2b5862b0873ccb033984170db0e569af06209c974d08fd112a631d219365253618027fdedaff6b9bd47814769973425" name="libggml-cpu" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="b0a0bb80e06d6285f2ec66f39509320167def2fcd1f995753b20b3aabe045d9c41beb7e41087dad2db887cbf13e19e8ba4fa1da99ae201186bec6af6a9560a12" name="libggml-cpu-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="9cb5219f29adca632aee197f182220a5422f2a5c41c596d6d46c96d18f0b1a0fb5dd63631c2b5e14e918efb88dd5d15c0374f26c7f47332ff6890b93d89a1ebf" name="libggml-opencl" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="a2c2b8a3ccb63123e2990231b7633a24f401efe77049884898076ee3ee534ca7a7ce784a34b4bfd681421d7427ef529d7da48e914f1f15ead51aefaae4c8f382" name="libggml-opencl-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="a307067c867ace45020ef0e5c993a245bbb71b3e5477ecf7ba5b203f4b34ce863f7711351c5930cb05cbc852439b6e4e8e14b83d2e5ec1785ac9090d55883ee2" name="libggml-vulkan" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="5f2952dd23fd469d500f8f3950d09fcb11a638576a2c750d63e212250e4bfe5c162b4092e6b8f0b8173e96eec2a861ac2bfb32c3c82af97ca9ffd02e16beaffe" name="libggml-vulkan-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="bb2ea92c2c1c67be056cce5affcfb0216781eae87cd0f017811bff3feb8cbdc3f02f74fcb6d581b526214d40eb28791934fff044881f790fd9601e811a45813f" name="libggml0" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="a8aa6d86f34f20324e9bcef15773953d406a360b71294e71174ffb620cc425547a19d72b481001162b2462e38ac3b97a4b306c98b4ccce4b70ab7deccac8f916" name="libggml0-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="d66ff67454b3be7ab5467778dd27ea401c51dc038a3084562980c12c3522fe9637dd2cb7379640a28b55a77c8ceec6a23755d88cb23765bf875511280da02735" name="libllama0" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="dbbd6f7aad4195cee490ff23f93f2d958b0819db90de942fbfb9884596cdcbbc1ab4ef5776a854e497ed02297d7c5e96c60dd82b79e211e47dd01e8def1d1819" name="libllama0-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="ca586a0fa1d92c914af131ca5b6e39caf7bf077656ec50b9ad9cc587df34ab8af4a8825b72db5c8c3aa3ef01128ae008fe886496800ceb854b288f4ac2791160" name="libmtmd0" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="b0cf264d383ab2bf234020412c1ad661a190cbee0ea10a1cfa0d2c9bb3703f22aec7a6025d6768c6711c4031ade53fde2a69c1806b9d81e8ff2803fa3b46762a" name="libmtmd0-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="80d3ea0f6f40e2eb91349084e3d04841c7086d1ba6a2b5727ef22ceaf09409e49d9a5445aeed0fab99995295bc981cdcaa154bfd9af1c20fe363c8db2fe94eed" name="llamacpp" arch="src">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="16e85018c657ba7c7cc59747ae151ca262d208872c94b274ba0154401fa70c3c2a9679db0649c848b81cdff52e378e8729146a2da67c9cd77ca4ab5699abbc81" name="llamacpp" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="ac2a93d083ba2d6d010f37922a437b969d5ac30a6cf17a8c5a9f32625a8b318e97ce37f3501718c75e039a68c38e76824383c238ff69dba7536a1b458d0bffd3" name="llamacpp-debuginfo" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="0ef95584ad5b6742b20d2ceb2bf85005fe4ec4d8d6ca264b1a4f7c69cfbe9da9c66933f349ed02005871e9b6847c9e30456b93de41fbb80a5a0bfc81417c33f6" name="llamacpp-debugsource" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
<package pkgid="cdd550289bc64775c642bebfb40559766d22cac2a1b8aa76e70547a58cfa9635d5a65780842176ae648e9c9e050e908ed0d712bcaa553fc89ce60a6c905ea1df" name="llamacpp-devel" arch="x86_64">
  <version epoch="0" ver="8814" rel="75.1"/>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1750334400">- Update to 5699:
  * vocab : prevent integer overflow during load
    (bsc#1244714) (CVE-2025-49847)
  * batch : add LLAMA_BATCH_DEBUG environment variable
  * batch : auto-gen positions + verify multi-sequence input
  * common : suggest --jinja when autodetection fails
  * ggml-cpu: fix uncaught underscore terminators
  * kv-cache : fix use-after-move of defrag info
  * llama : rework embeddings logic
  * llama-chat : do not throw when tool parsing fails
  * llama-chat : fix multiple system message for gemma, orion
  * model : Add support for Arcee AI's upcoming AFM model
  * model : add dots.llm1 architecture support
  * model : add NeoBERT
  * server : When listening on a unix domain socket don't print
    http:// and port
  * quantize : change int to unsigned int for KV overrides
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5657...b5699</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1751544000">- Update to version 5812:
  * Mamba-2 Support: Initial integration of Mamba-2 architecture.
  * Added support for ERNIE 4.5 0.3B, NeoBERT, Arcee AI's AFM,
    Gemma3n text-only, and dots.llm1 architectures
  * Vulkan Improvements: Support for softmax/FlashAttention
    batch/broadcast, fused RMS_NORM+MUL, and better memory handling
  * GGML Backend: Added REGLU/GEGLU/SWIGLU ops, ggml_set_rows, and
    improved SYCL/OpenCL/Metal support
  * Server Improvements: Jinja template kwargs, draft model cache
    params, and Unix socket support
  * Quantization: User-defined layer pruning and KV override fixes
  * Optimizations: Batched Vulkan mul_mat_id splitting
    and ARM hsum reduction
  * Added GGML version function
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5699...b5812</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1752408000">- Add GGML_NATIVE=OFF build flag
- Update to version 5889:
  * Remove Kompute support
  * Prevent integer overflow in gguf tensor size calculation
    (bsc#1246377) (CVE-2025-53630) (GHSA-vgg9-87g3-85w8)
  * Improved build-time messaging for ggml_set_rows.
  * Enhanced test coverage for LFM2 and added LFM2 to
    documentation.
  * Synchronized ggml updates and improved Vulkan backend
    (bilinear interpolation, ggml_roll, SET_ROWS, optimizations).
  * Fixed pooled embedding output in server and improved prompt
    processing.
  * Added support for LiquidAI LFM2 hybrid family and Falcon-H1
    models.
  * Improved HIP, OpenCL, and SYCL backend compatibility
    and features.
  * Added new vocabularies and model support
    (midm-2.0, skt/A.X-4.0, SmolLM3, hunyuan moe, Granite Four).
  * Various bug fixes, optimizations, and documentation improvements
    across backends and models.
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5812...b5889</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753272000">- Update to version 5970:
  * batch: fix uninitialized has_cpl flag
  * ggml: Add initial WebGPU backend
  * ggml: adds CONV_2D op and direct GEMM Vulkan implementation
  * ggml: fix loongarch quantize_row_q8_1 error
  * ggml: model card yaml tab-&gt;2xspace
  * ggml: refactor llamafile_sgemm PPC code
  * gguf-py : dump bpw per layer and model in markdown mode
  * graph: avoid huge warm-up graphs for MoE models
  * graph: fix graph reuse reset of params
  * graph: pass the graph placeholder message in debug mode
  * graph: refactor context to not pass gf explicitly
  * imatrix: add option to display importance score statistics
  for a given imatrix file
  * imatrix: use GGUF to store importance matrices
  * kv-cache: fix k-shift for multiple streams
  * kv-cache: opt mask set input
  * llama: add high-throughput mode
  * llama: add jinja template for rwkv-world
  * llama: add LLAMA_API to deprecated llama_kv_self_seq_div
  * llama: add model type detection for rwkv7 7B&amp;14B
  * llama: fix parallel processing for lfm2
  * llama: fix parallel processing for plamo2
  * llama: fix parameter order for hybrid memory initialization
  * llama: fix `--reverse-prompt` crashing issue
  * llama: reuse compute graphs
  * llama-context: add ability to get logits
  * memory: handle saving/loading null layers in recurrent memory
  * metal: fuse add, mul + add tests
  * model: add Ernie 4.5 MoE support
  * model: add EXAONE 4.0 support
  * model: add Kimi-K2 support
  * model: add PLaMo-2 support
  * model: fix build after merge conflict
  * model: support output bias for qwen2
  * model: support diffusion models: Add Dream 7B
  * mtmd: add a way to select device for vision encoder
  * opencl: add conv2d kernel (#14403)
  * opencl: fix `im2col` when `KW!=KH`
  * opencl: remove unreachable `return`
  * parallel: add option for different RNG seeds
  * quantize: fix minor logic flaw in --tensor-type
  * scripts: benchmark for HTTP server throughput
  * scripts: synthetic prompt mode for server-bench.py
  * server: add parse_special option to /tokenize endpoint
  * server: allow setting `--reverse-prompt` arg
  * server: fix handling of the ignore_eos flag
  * server: pre-calculate EOG logit biases
  * vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info
  * vulkan: add RTE variants for glu/add/sub/mul/div
  * vulkan/cuda: Fix im2col when KW!=KH
  * culkan: Fix fprintf format-security warning
  * vulkan: fix noncontig check for mat_mul_id splitting
  * vulkan: fix rms_norm_mul to handle broadcasting dim0
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b5889...b5970</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1753876800">- Update to version 6038:
  * chat : fix kimi-k2 chat template (#14852)
  * common : avoid logging partial messages (which can contain
    broken UTF-8 sequences) (#14937)
  * context : perform output reorder lazily upon access after sync
    (#14853)
  * context : restore preemptive sched reset when LLAMA_SET_ROWS=0
    (#14870)
  * convert : text-only support for GLM-4.1V-9B-Thinking (#14823)
  * embeddings: fix extraction of CLS pooling results (#14927)
  * ggml-cpu : deduplicate scalar implementations (#14897)
  * ggml-cpu : disable GGML_NNPA by default due to instability
    (#14880)
  * ggml-cpu : remove stdlib include from repack.cpp (ggml/1276)
  * ggml : remove invalid portPos specifiers from dot files
    (#14838)
  * graph : fix stack-use-after-return (#14960)
  * llama-bench : use local GPUs along with RPC servers
    (#14917)
  * llama : clarify comment about pp and tg graphs [no ci]
    (#14895)
  * llama : fix kq_scale for the attention layers of PLaMo2
    (#14892)
  * llama : fix MiniCPM inference after Granite Four changes
    (#14850)
  * metal : fix fusion across different encoders (#14849)
  * metal: SSM_SCAN performance (#14743)
  * model : add support for SmallThinker series (#14898)
  * model : make rope_yarn_log_mul optional for deepseek2
    (#14896)
  * mtmd : add support for Voxtral (#14862)
  * mtmd : fix 32-bit narrowing issue in export-lora and mtmd
    clip (#14503)
  * opencl: add fused `rms_norm_mul` (#14841)
  * opencl : add ops docs (#14910)
  * quantize : fix using combined imatrix GGUFs
    (multiple datasets) (#14973)
  * quantize : update README.md (#14905)
  * rpc : check for null buffers in get/set/copy tensor
    endpoints (#14868)
  * sched : fix multiple evaluations of the same graph with
    pipeline parallelism (#14855)
  * server : add support for `embd_normalize` parameter (#14964)
  * server-bench: make seed choice configurable (#14929)
  * vulkan : add fp16 support for the conv_2d kernel (#14872)
  * vulkan: add ops docs (#14900)
  * vulkan : fix 32-bit builds (ggml/1313)
  * vulkan: skip empty set_rows to avoid invalid API usage
    (#14860)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754481600">- Drop 0001-dl-load-path.patch: use GGML_BACKEND_DIR instead
- Enable loading backends dynamically
- Update to version 6100:
  * llama : add gpt-oss (#15091)
  * llama : add --n-cpu-moe option (#15077)
  * llama : enable LLAMA_SET_ROWS=1 by default (#14959)
  * server : add openai-style logit_bias support (#14946)
  * server : implement universal assisted decoding (#12635)
  * mtmd : support MiniCPM-V 4.0 (#14983)
  * opencl: add f16 for `add`, `sub`, `mul`, `div` (#14984)
  * model : add hunyuan dense (#14878)
  * model : add text-only support for Kimi-VL
  * model: support GLM 4.5 family of models (#14939)
  * model : support Qwen3-Embedding (#15023)
  * graph : Optimize graph operations
  * vulkan: various bug fixes and optimizations
  * Various bug fixes</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1754654400">- Update to version 6121:
  * Support intern-s1
  * opencl: add swiglu_oai and add_id
  * vulkan: support fattn sinks
  * vulkan: Add env var to disable host visible vidmem
  * ggml: Skip backend library linking code when GGML_BACKEND_DL=ON
  * ggml : fix fallback to CPU for ununsupported ops
  * Various bug fixes
  * Full changelog:
    https://github.com/ggml-org/llama.cpp/compare/b6100...b6121</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1755000000">- Add LLAMA_BUILD_NUMBER and LLAMA_VERSION to the build</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755000001">- Update to version 6139:
  * opencl: allow mixed f16/f32 `add` (#15140)
  * mtmd : Fix MinicpmV model converter and clip to avoid using
    hardcode. (#14750)
  * chat : hotfix gpt-oss jinja raising an exception (#15243)
  * server : allow specifying reasoning_format in HTTP request
    (#15238)
  * kv-cache : fix seq_rm with seq_id == -1 (#15226)
  * kv-cache : log (debug) all streams in find_slot (#15176)
  * convert : improve Mistral models integration (#14737)
  * kleidiai: fix unsigned overflow bug (#15150)</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1755432000">- Update to version 6188:
  * Vulkan backend improvements: larger workgroups, optimized
    argsort, fused adds, bounds checking, out-of-bounds and compile
    warning fixes, performance logging.
  * OpenCL backend: initial FA and mxfp4 support.
  * Model support: vision LiquidAI LFM2-VL family, 18-layer Gemma
    3-270m model type.
  * Common: fixed double BOS, improved chat templates, added
    override-tensor and CPU MoE draft parameters.
  * GGML: initial IBM zDNN backend, rope_multi update, conv_1d_dw
    bug fix, block_iq4_nlx8 repack, improved Mistral integration.
  * Server: SWA checkpoints, -td/-tbd parameters, harmony thought
    message filtering.
  * Perplexity: improved error hints and constraint reporting.
  * GPT-OSS: harmony parsing implemented.</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1756123200">- Update to version 6269:
  * Model and conversion: support for Seed-OSS, GPT-OSS
  response_format, interns1-mini, Ernie 4.5, gpt-oss type
  strings, improved Mistral templates, new model conversion
  tool/example with torch-cpu.
  * Vulkan backend: multiple optimizations (rms_norm, mul_mat_id,
    synchronization, conv2d, subgroup ops), new ops (exp,
    conv_2d_dw f16, ggml_mean).
  * GGML/CPU: added conv3d op, WebGPU quantization support,
  Q5_0/Q5_1 on s390x, mxfp4 intrinsics on ppc64le.
  * Server and chat: multimodal completion and embeddings
  JSON support, improved OpenAI API compatibility and usage
  statistics, disabled context shift by default, fixed ordering
  of tasks, webui issues, debug assertions, clarified
  reasoning_format.
  * KV cache: unified handling improvements, support for reuse,
  removal of deprecated APIs, simplifications.
  * Miscellaneous: fixed logging of non-ASCII characters, removed
  deprecated or unused code and build artifacts.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6188...b6269</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1757419200">- Update to version 6428
  * Added support for DeepSeek V3.1, Nemotron, and Seed OSS
    thinking &amp; tool calling.
  * Fixed crashes and tool_call parsing issues.
  * CLI improvements: better warnings and enhanced bash completion.
  * Improved context handling (n_outputs, graph stats, reserve fixes).
  * KV-cache optimizations and fixes for slot handling, SWA checks,
    and batching.
  * New support for EmbeddingGemma 300M and fixes for Gemma 270M.
  * General stability and correctness fixes across evaluation,
    initialization, and buffer management.
  * Major updates for aarch64 (SVE F16), RVV support, and
    s390x cleanup.
  * New ops: WAN video model, WebGPU transpose/reshape, Vulkan
    im2col_3d, pad_ext, integer dot products.
  * Optimizations for RVV kernels, OpenCL fused ops, and Vulkan
    matmul paths.
  * Expanded casting, exponential functions, and memory
    improvements.
  * Upgraded kleidiai to v1.13.0.
  * Refactored gguf_writer, improved byte-swapping, and fixed
    metadata entries.
  * Python bindings cleanup and fixes.
  * Added flags, templates, debugging tools, QAT-Q4 quantization,
    and mmproj targets.
  * Fixed errors, added missing scripts, and removed hardcoded
    shebangs.
  * New support for jina-embeddings-v3, MiniCPM-V 4.5, Kimi VL, and
    extended embedding options.
  * Improved defaults for GPU usage and attention.
  * Added documentation and parameters (parallel_tool_calls,
    exceed_context_size_error).
  * Security improvements (/slots enabled by default).
  * Optimized sampling strategies.
  * New logging/coloring options.
  * JSON schema improvements (enum handling).
  * Multiple bug fixes across graph, presets, mtmd, and thinking models.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1758974400">- Update to b6605:
  * Added docker protocol support and resumable downloads for
    llama-server
  * New models: LLaDA-7b-MoE, Grok-2, GroveMoE, OLMo3, LiquidAI
    LFM2-2.6B
  * Added conversion support for GraniteHybrid (non-hybrid attn)
    and Llama4ForCausalLM
  * llama: support for qwen3 reranker, T5 unequal encoder-decoder
    layers, seq limit bumped 64 → 256
  * Bench improvements: list devices, multiple devices, n-cpu-moe
  * Vulkan: conv_transpose_2d, GET_ROWS, iGPU device selection,
    buffer optimizations, shader fixes, OOM handling
  * ggml: semantic versioning, backend/device extensions,
    optimizations, fixes for embedding, quantization, padding
  * ggml-cpu: SIMD support (MXFP4 for s390x), cpumask respect,
    ARM INT8 checks
  * Common: fixes for memory corruption, offline mode without curl,
    switch to cpp-httplib
  * Server: SSE/OpenAI error handling, usage stats opt-in, external
    test server, removed LLAMA_SERVER_SSL
  * WebUI: migrated to SvelteKit, hash-based routing, chunk
    handling fixes
  * Fixes across model-conversion, rpc, media, devops, embedding
    docs, typos
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6269...b6428</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1759579200">- Update to version 6690:
  * ggml: bump to v0.9.4; fix graph reallocation and multi-chunk
    dependencies
  * ggml webgpu: add soft_max op; optimize rms_norm; extend
    operator support
  * ggml-riscv: add Spacemit backend
  * vulkan: improve shader threading and incremental builds
  * vulkan: fix FA coopmat1 array indexing and quantized flash
    attention
  * vulkan: replace maxMemoryAllocationSize, improve header
    compatibility
  * vulkan: add bounds checks in flash attention; 64-bit im2col
    support
  * rpc: add multi-device support; validate src buffer copies
  * server: add context checkpointing for hybrid and recurrent
    models
  * chat: add Magistral thinking support; fix missing sibling
    messages
  * webui: fix payloads and routing; improve mobile and dialog
    behavior
  * model: implement Apertus; support GLM 4.6
  * llama: fix shapes for BERT/MPT q/k norm; improve PLaMo2
    loading
  * common: introduce http.h client; disable progress bar without
    tty
  * common: remove common_has_curl(); simplify etag tracking
  * opencl: support pad_ext and ne3 in get_rows
  * various minor fixes for scrolling, sampling, and chat block
    handling
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6605...b6690</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1762171200">- Update to version 6937:
  * New model: Janus Pro
  * New model: Minimax M2
  * New model: Granite Hybrid nano types
  * New model: support for qwen3vl series
  * New model: support for CogVLM model
  * New model: LightOnOCR-1B model
  * New model: BailingMoeV2 support
  * New model: Granite Hybrid types
  * New model: Support home-cooked Mistral Small Omni
  * New model: Support LiquidAI LFM2-MoE hybrid model
  * New model: Granite docling + Idefics3 preprocessing (SmolVLM)
  * New model: EmbeddingGemma Adding Support for
    SentenceTransformers Dense Modules
  * Server improvements, OpenAI API compatibility, optimizations,
    and bug fixes
  * Vulkan backend improvements, optimizations, and bug fixes
  * OpenCL backend fixes
  * CPU backend optimizations
  * Multimodal (mtmd) improvements
  * WebUI enhancements
  * Architecture-specific improvements
  * llama core improvements
  * Memory management improvements
  * Conversion and quantization tools enhancements
  * Grammar and sampling improvements
  * Chat and prompts enhancements
  * General fixes and improvements
  * RPC improvements and bug fixes
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6690...b6937</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1764849600">- Switch to .so versioning, following upstream
- Update to version 7266:
  * Added support for several new and updated models including
    Ministral3, Qwen3 Next, RND1 Diffusion LM, AfmoeForCausalLM,
    openPangu-Embedded, and improved detection for
    GigaChat3-10-A1.8B.
  * Server improvements: multi-model API, Anthropic Messages API,
    task generator API, HTTP interface split, jinja enabled by
    default.
  * Chat and parsing improvements: generalized XML-style tool-call
    parsing, composable PEG parser combinators.
  * WebUI enhancements: restored HTML in Markdown tables, rehype
    plugin improvements, attachment-handling UX improvements,
    Harmony tool-call visualization, new keyboard shortcuts,
    clickability fixes, autoscroll toggle, and new “Continue”
    action.
  * CUDA backend improvements: FP16 restrictions, memory bandwidth
    improvements, stream-based concurrency, MMQ and fusion fixes,
    rope fusion corrections, improved handling of nb00/nb02, and
    various stability fixes.
  * Vulkan backend improvements: new operators, improved FA and
    MMVQ support, async graph_compute, conv2d spec constants, i32 copy
    support.
  * GGML and CPU backend updates: expanded RVV, ARM64, RISC-V
    feature detection; new CPU intrinsic implementations; improved
    GEMM/GEMV repack kernels; ops additions.
  * OpenCL, SYCL, HIP, MUSA, and Hexagon improvements: expanded
    operator support, new kernels, fallback logic for older SoCs,
    buffer handling fixes.
  * MTMD (multimodal) improvements: warmup toggles, CLI log-noise
    reduction, image embedding size fixes and audio model patch
    fixes.
  * General performance, stability, and correctness improvements
    across CPU, GPU, schedulers, memory management, kv-cache,
    async behavior, thread safety, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b6937...b7266</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1766750400">- Update to version 7540:
  * Major CUDA improvements including Blackwell native build fixes,
    experimental MXFP4 support, optimized CUMSUM paths, new ops
    (FILL, DIAG, TRI, CUMSUM), FA/MMA overflow fixes, better GPU
    utilization defaults, and multiple correctness and stability
    fixes.
  * Significant Vulkan backend work with new operators, faster
    FA/MMV/MMVQ paths, async tensor and event support, rope and MoE
    improvements, reduced data races, better logging, and numerous
    performance optimizations.
  * CPU and GGML backend enhancements covering ARM64, RVV, RISC-V,
    ZenDNN, and Hexagon, with new and optimized kernels, improved
    repack logic, allocator fixes, graph reuse, and better error
    handling.
  * Expanded support and fixes across Metal, HIP, SYCL, OpenCL,
    CANN, WebGPU, and Hexagon backends.
  * Added and improved support for many models and architectures
    including Qwen3-Next, Nemotron v2/v3, Llama 4 scaling, GLM4V,
    MiMo-V2-Flash, Granite Embeddings, KORMo, Rnj-1, LFM2 text/
    audio/MoE, Mistral and Mistral-Large variants, DeepSeek
    variants, ASR conformer models, and multimodal pipelines.
  * Fixed multiple model issues such as missing tensors,
    division-by-zero errors, rope scaling regressions, MoE edge
    cases, bidirectional architectures, and multimodal loading
    errors.
  * Server and router improvements including safer multithreading,
    race-condition fixes, multi-model routing, preset cascading,
    startup model loading, auto-sleep on idle, improved speculative
    decoding, better RPC validation, and friendlier error handling.
  * CLI and argument-parsing improvements with new flags, negated
    argument support, environment overrides, clearer defaults,
    and improved diagnostics.
  * WebUI enhancements improving chat usability, attachment
    editing, copy-to-clipboard behavior, streaming selection,
    layout and sidebar behavior, statistics display, mobile
    responsiveness, and general UX polish.
  * Model conversion and tooling improvements including better
    ftype heuristics, rope handling refactors, embedding
    verification fixes, batching and multimodal support, safer
    read-only workflows, and additional debugging and verbosity
    options.
  * Broad performance, stability, and correctness improvements
    across memory management, kv-cache handling, async behavior,
    graph optimization, numerical stability, and operator fusion.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7266...b7540</changelog>
  <changelog author="Eyad Issa &lt;eyadlorenzo@gmail.com&gt;" date="1768996800">- Update to version 7789:
  * CUDA: multiple fixes and cleanups, improved Blackwell and RDNA
    support, FA/MMA correctness fixes, reduced debug output, and
    improved compatibility with older toolchains.
  * Vulkan: performance optimizations, new and extended operators,
    improved handling of large tensors, and driver-specific
    workarounds for AMD and Intel.
  * GGML: new operators, backend sampling support, allocator and
    graph improvements, WebGPU enhancements, and better error
    handling.
  * CPU and accelerator backends: fixes and optimizations across
    OpenCL, HIP, SYCL, CANN, Hexagon, Metal, and Power
    architectures.
  * Models and conversion: added and fixed support for multiple
    models including GLM-4 variants, EXAONE MoE, Qwen3 Next,
    Gemma 3, Granite,LFM2, Youtu-VL, and others.
  * Server and CLI: scheduling, memory, and KV-cache fixes,
    improved defaults, new options, and stability improvements.
  * Jinja templates: correctness fixes, feature completion, and
    improved test coverage.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7540...b7789</changelog>
  <changelog author="Robert Munteanu &lt;rombert@apache.org&gt;" date="1772452800">- Update to version 8189:
  * CUDA: CDNA3 MFMA support for FA MMA kernel, improved CUDA graph
    capture, dequantization optimizations, and grid.y cap fix in
    non-contiguous kernels.
  * Vulkan: Intel/AMD tuning, FA scalar and coopmat1 refactors,
    new ops (L2_NORM, GGML_OP_SET), overlap check before fusion,
    and correctness fixes for rope, fp16 FA, and mul_mat_id.
  * CPU and GGML: mxfp4 repack, SVE/RVV kernel additions, q5_K and
    q6_K repack with dotprod and i8mm, tiled FA for prompt
    processing, s390x optimizations, and extended bin bcast.
  * Accelerator backends: new ops and optimizations across OpenCL,
    Metal, WebGPU, SYCL, CANN, HIP/ROCm, Hexagon, ZenDNN, and a
    new VirtGPU backend for Virglrenderer API remoting.
  * Models and conversion: added Kimi-K2.5, Kimi Linear (MLA KV
    cache), Jina Embeddings v5 Nano, Kanana-2, JAIS-2, PaddleOCR-VL,
    GLM-OCR, GLM MoE DSA, Tiny Aya, full modern BERT, Step3.5-Flash,
    Qwen3.5 series, and Devstral-2; graph deduplication and
    conversion fixes across multiple architectures.
  * Server: /v1/responses mirroring, multi-model alias support,
    multi-modal prompt caching and context checkpoints,
    max_completion_tokens property, and various stability fixes.
  * KV cache, MTMD, and Jinja: M-RoPE shift fix, V-less cache
    support, hybrid model size fix, multimodal tiling and padding
    fixes, and multiple Jinja correctness and feature additions.
  * WebUI: full-height code blocks, raw LLM output switcher, system
    message injection, router mode fixes, and Svelte update.
  * Misc: self-speculative decoding without a draft model, NetBSD
    support, ggml bumped to 0.9.7, gguf-py to 0.18.0, updated
    miniaudio, cpp-httplib, and BoringSSL.
  * Full commit log:
    https://github.com/ggml-org/llama.cpp/compare/b7789...b8189</changelog>
  <changelog author="Adrian Schr&#xF6;ter &lt;adrian@suse.de&gt;" date="1776427200">- Update to version 8814:
  - Quantization: Introduced 1-bit (Q1_0) quantization support
  across CPU, CUDA, Vulkan, Metal, and SYCL backends.
  - Model Support: Added support for Gemma 4 (text, vision, and
  audio), Qwen 3 (Omni, ASR, and Next), DeepSeek v3.2,
  HunyuanOCR, Phi-4, and Granite 4.0.
  - Hardware Acceleration: Implemented 128-bit RISC-V Vector
  (RVV) and SIMD kernels for enhanced CPU performance.
  - GPU Backends: Added AMD CDNA4 (gfx950) support in HIP and
  optimized Flash Attention for CUDA, Metal, and WebGPU.
  - WebGPU: Significant updates including compute pass batching,
  JIT operator porting, and f32 accumulation for register tiling.
  - Multimodal: Expanded audio/vision support, including Gemma 4
  Conformer encoders and DeepSeekOCR integration.
  - Server/API: Added OpenAI-compatible audio transcriptions API
  support and improved router mode for multi-model management.
  - WebUI: Introduced MCP (Model Context Protocol) diagnostics,
  conversation branching, and dedicated reasoning content
  rendering.
  - RPC Backend: Implemented native RDMA (RoCEv2) transport for
  high-performance remote procedure calls.
  - DevOps: Updated core dependencies including BoringSSL to
  0.20260413.0 and added KleidiAI-enabled ARM release artifacts.</changelog>
</package>
</otherdata>