Files

.devops
.github
ci
cmake
common
docs
examples
ggml-cuda
ggml-sycl
gguf-py
grammars
kompute
kompute-shaders
media
models
pocs
prompts
requirements
scripts
spm-headers
tests
vulkan-shaders
- add.comp
- argsort.comp
- clamp.comp
- copy.comp
- dequant_f32.comp
- dequant_funcs.comp
- dequant_head.comp
- dequant_q2_k.comp
- dequant_q3_k.comp
- dequant_q4_0.comp
- dequant_q4_1.comp
- dequant_q4_k.comp
- dequant_q5_0.comp
- dequant_q5_1.comp
- dequant_q5_k.comp
- dequant_q6_k.comp
- dequant_q8_0.comp
- diag_mask_inf.comp
- div.comp
- gelu.comp
- generic_binary_head.comp
- generic_head.comp
- generic_unary_head.comp
- get_rows.comp
- get_rows_quant.comp
- mul.comp
- mul_mat_split_k_reduce.comp
- mul_mat_vec.comp
- mul_mat_vec_base.comp
- mul_mat_vec_nc.comp
- mul_mat_vec_p021.comp
- mul_mat_vec_q2_k.comp
- mul_mat_vec_q3_k.comp
- mul_mat_vec_q4_k.comp
- mul_mat_vec_q5_k.comp
- mul_mat_vec_q6_k.comp
- mul_mm.comp
- norm.comp
- relu.comp
- rms_norm.comp
- rope_head.comp
- rope_neox.comp
- rope_norm.comp
- scale.comp
- silu.comp
- soft_max.comp
- square.comp
- sum_rows.comp
- types.comp
.clang-tidy
.dockerignore
.ecrc
.editorconfig
.flake8
.gitignore
.gitmodules
.pre-commit-config.yaml
AUTHORS
CMakeLists.txt
CMakePresets.json
CONTRIBUTING.md
LICENSE
Makefile
Package.swift
README-sycl.md
README.md
SECURITY.md
convert-hf-to-gguf-update.py
convert-hf-to-gguf.py
convert-llama-ggml-to-gguf.py
flake.lock
flake.nix
ggml-alloc.c
ggml-alloc.h
ggml-backend-impl.h
ggml-backend.c
ggml-backend.h
ggml-blas.cpp
ggml-blas.h
ggml-common.h
ggml-cuda.cu
ggml-cuda.h
ggml-impl.h
ggml-kompute.cpp
ggml-kompute.h
ggml-metal.h
ggml-metal.m
ggml-metal.metal
ggml-quants.c
ggml-quants.h
ggml-rpc.cpp
ggml-rpc.h
ggml-sycl.cpp
ggml-sycl.h
ggml-vulkan-shaders.hpp
ggml-vulkan.cpp
ggml-vulkan.h
ggml.c
ggml.h
ggml_vk_generate_shaders.py
llama.cpp
llama.h
mypy.ini
pyrightconfig.json
requirements.txt
sgemm.cpp
sgemm.h
unicode-data.cpp
unicode-data.h
unicode.cpp
unicode.h

vulkan-shaders

0cc4m

Refactor Vulkan backend to allow multiple contexts (ggml-org#7961 )

Jun 23, 2024

45c0e2e · Jun 23, 2024

History

This branch is 25 commits ahead of, 2058 commits behind ggml-org/llama.cpp:master.

Name	Name	Last commit message	Last commit date
parent directory ..
add.comp	add.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
argsort.comp	argsort.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
clamp.comp	clamp.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
copy.comp	copy.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_f32.comp	dequant_f32.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_funcs.comp	dequant_funcs.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_head.comp	dequant_head.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q2_k.comp	dequant_q2_k.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q3_k.comp	dequant_q3_k.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q4_0.comp	dequant_q4_0.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q4_1.comp	dequant_q4_1.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q4_k.comp	dequant_q4_k.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q5_0.comp	dequant_q5_0.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q5_1.comp	dequant_q5_1.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q5_k.comp	dequant_q5_k.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q6_k.comp	dequant_q6_k.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
dequant_q8_0.comp	dequant_q8_0.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
diag_mask_inf.comp	diag_mask_inf.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
div.comp	div.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
gelu.comp	gelu.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
generic_binary_head.comp	generic_binary_head.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
generic_head.comp	generic_head.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
generic_unary_head.comp	generic_unary_head.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
get_rows.comp	get_rows.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
get_rows_quant.comp	get_rows_quant.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
mul.comp	mul.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
mul_mat_split_k_reduce.comp	mul_mat_split_k_reduce.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
mul_mat_vec.comp	mul_mat_vec.comp	Refactor Vulkan backend to allow multiple contexts (ggml-org#7961 )	Jun 23, 2024
mul_mat_vec_base.comp	mul_mat_vec_base.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
mul_mat_vec_nc.comp	mul_mat_vec_nc.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
mul_mat_vec_p021.comp	mul_mat_vec_p021.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
mul_mat_vec_q2_k.comp	mul_mat_vec_q2_k.comp	Refactor Vulkan backend to allow multiple contexts (ggml-org#7961 )	Jun 23, 2024
mul_mat_vec_q3_k.comp	mul_mat_vec_q3_k.comp	Refactor Vulkan backend to allow multiple contexts (ggml-org#7961 )	Jun 23, 2024
mul_mat_vec_q4_k.comp	mul_mat_vec_q4_k.comp	Refactor Vulkan backend to allow multiple contexts (ggml-org#7961 )	Jun 23, 2024
mul_mat_vec_q5_k.comp	mul_mat_vec_q5_k.comp	Refactor Vulkan backend to allow multiple contexts (ggml-org#7961 )	Jun 23, 2024
mul_mat_vec_q6_k.comp	mul_mat_vec_q6_k.comp	Refactor Vulkan backend to allow multiple contexts (ggml-org#7961 )	Jun 23, 2024
mul_mm.comp	mul_mm.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
norm.comp	norm.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
relu.comp	relu.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
rms_norm.comp	rms_norm.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
rope_head.comp	rope_head.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
rope_neox.comp	rope_neox.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
rope_norm.comp	rope_norm.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
scale.comp	scale.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
silu.comp	silu.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
soft_max.comp	soft_max.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
square.comp	square.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
sum_rows.comp	sum_rows.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024
types.comp	types.comp	Vulkan Shader Refactor, Memory Debugging Option (ggml-org#7947 )	Jun 16, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Files

vulkan-shaders

vulkan-shaders

Files

vulkan-shaders

Directory actions

More options

Directory actions

More options

Latest commit

History

vulkan-shaders

Folders and files

parent directory