Search results

64 bit CUDA copy routines via GGML_CUDA_ALLOW_LARGE_TENSORS

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 15298

#15298 In ggml-org/llama.cpp;

· createthis opened on Aug 13, 2025

WIP: ggml-cuda: Add bf16 cuda support to fattn (Flash Attention)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

Status: Open (in progress).

ggml-org/llama.cppnumber 15261

#15261 In ggml-org/llama.cpp;

· eous opened on Aug 12, 2025

musa: fix build warnings

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 15258

#15258 In ggml-org/llama.cpp;

· yeahdongcn opened on Aug 12, 2025

CUDA/HIP: ssm-scan: switch from shared memory to reisters, fixes indexing problem on warp64 devices

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 15101

#15101 In ggml-org/llama.cpp;

· IMbackK opened on Aug 5, 2025

CUDA: add set

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 14980

#14980 In ggml-org/llama.cpp;

· jeemzz147 opened on Jul 31, 2025

Implementation of GGML_NUMA_MIRROR for inferencing performance gain on numa systems

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 14969

#14969 In ggml-org/llama.cpp;

· dbsanfte opened on Jul 30, 2025

Add Pad Reflect 1D CUDA support

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 14659

#14659 In ggml-org/llama.cpp;

· YavorGIvanov opened on Jul 13, 2025

Add CUDA non-contiguous Unary Ops support

buildCompilation issuesCompilation issues

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 14639

#14639 In ggml-org/llama.cpp;

· YavorGIvanov opened on Jul 11, 2025

cuda: fix CMAKE_CUDA_COMPILER not found error (#13528)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 13625

#13625 In ggml-org/llama.cpp;

· lizhenneng opened on May 19, 2025

cuda: set cuda compiler path (#13527)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 13528

#13528 In ggml-org/llama.cpp;

· lizhenneng opened on May 14, 2025

CUDA: update build CTK version to 12.8

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 13360

#13360 In ggml-org/llama.cpp;

· thevishalagarwal opened on May 7, 2025

llama : try loading tensors with pre-computed hashes

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Komputehttps://github.com/KomputeProject/kompute/https://github.com/KomputeProject/kompute/

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 13106

#13106 In ggml-org/llama.cpp;

· rgerganov opened on Apr 25, 2025