Search results

vulkan: disable spirv-opt for bfloat16 shaders

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 15352

#15352 In ggml-org/llama.cpp;

· jeffbolznv opened on Aug 15, 2025

sched : copy only the used experts when offloading prompt processing

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 15346

#15346 In ggml-org/llama.cpp;

· slaren opened on Aug 15, 2025

vulkan: Support mul_mat_id with f32 accumulators

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 15337

#15337 In ggml-org/llama.cpp;

· jeffbolznv opened on Aug 15, 2025

CANN: optimize the rope ops

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 15335

#15335 In ggml-org/llama.cpp;

· YangShuai52 opened on Aug 15, 2025

vulkan: Add missing bounds checking to scalar/coopmat1 mul_mat_id

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 15334

#15334 In ggml-org/llama.cpp;

· jeffbolznv opened on Aug 14, 2025

CANN: fix ggml_cann_rms_norm

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 15331

#15331 In ggml-org/llama.cpp;

· yuchuan-cao opened on Aug 14, 2025

OpenCL: add fused group_norm/norm, mul, add

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 15314

#15314 In ggml-org/llama.cpp;

· rmatif opened on Aug 14, 2025

Add OpenVINO backend

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 15307

#15307 In ggml-org/llama.cpp;

· wine99 opened on Aug 14, 2025

64 bit CUDA copy routines via GGML_CUDA_ALLOW_LARGE_TENSORS

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 15298

#15298 In ggml-org/llama.cpp;

· createthis opened on Aug 13, 2025

ggml: riscv: add riscv spacemit backend

buildCompilation issuesCompilation issues

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 15288

#15288 In ggml-org/llama.cpp;

· alex-spacemit opened on Aug 13, 2025

vulkan: optimize rms_norm, and allow the work to spread across multiple SMs

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Draft (not ready).

ggml-org/llama.cppnumber 15281

#15281 In ggml-org/llama.cpp;

· jeffbolznv opened on Aug 13, 2025

arm64: add i8mm route with SVE ggml_vec_dot_q4_K_q8_K and ggml_vec_dot_q6_K_…

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 15277

#15277 In ggml-org/llama.cpp;

· fj-y-saito opened on Aug 13, 2025