Files

 master

/

scripts

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

jaime-m-p

tokenizer : BPE fixes (ggml-org#7530)

Jun 18, 2024

37bef89 · Jun 18, 2024

History

History

This branch is 25 commits ahead of, 2055 commits behind ggml-org/llama.cpp:master.

/

scripts

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
LlamaConfig.cmake.in		LlamaConfig.cmake.in	ggml : remove OpenCL (ggml-org#7735)	Jun 4, 2024
build-info.cmake		build-info.cmake	cmake : fix issue with version info not getting baked into LlamaConfi…	Nov 27, 2023
build-info.sh		build-info.sh	build : link against build info instead of compiling against it (ggml…	Nov 2, 2023
check-requirements.sh		check-requirements.sh	Move convert.py to examples/convert-legacy-llama.py (ggml-org#7430)	May 30, 2024
ci-run.sh		ci-run.sh	ci : add model tests + script wrapper (ggml-org#4586)	Jan 26, 2024
compare-commits.sh		compare-commits.sh	llama-bench : allow using a different printer for stderr with -oe (gg…	Jun 4, 2024
compare-llama-bench.py		compare-llama-bench.py	ggml : remove OpenCL (ggml-org#7735)	Jun 4, 2024
convert-gg.sh		convert-gg.sh	Move convert.py to examples/convert-legacy-llama.py (ggml-org#7430)	May 30, 2024
debug-test.sh		debug-test.sh	Added a single test function script and fix debug-test.sh to be more …	May 17, 2024
gen-authors.sh		gen-authors.sh	license : update copyright notice + add AUTHORS (ggml-org#6405)	Apr 9, 2024
gen-build-info-cpp.cmake		gen-build-info-cpp.cmake	cmake : fix issue with version info not getting baked into LlamaConfi…	Nov 27, 2023
gen-unicode-data.py		gen-unicode-data.py	tokenizer : BPE fixes (ggml-org#7530)	Jun 18, 2024
get-flags.mk		get-flags.mk	build : pass all warning flags to nvcc via -Xcompiler (ggml-org#5570)	Feb 18, 2024
get-hellaswag.sh		get-hellaswag.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
get-pg.sh		get-pg.sh	scripts : improve get-pg.sh (ggml-org#4838)	Jan 9, 2024
get-wikitext-103.sh		get-wikitext-103.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
get-wikitext-2.sh		get-wikitext-2.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
get-winogrande.sh		get-winogrande.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
hf.sh		hf.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
install-oneapi.bat		install-oneapi.bat	support SYCL backend windows build (ggml-org#5208)	Jan 31, 2024
pod-llama.sh		pod-llama.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
qnt-all.sh		qnt-all.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
run-all-perf.sh		run-all-perf.sh	scripts : add pipefail	Aug 29, 2023
run-all-ppl.sh		run-all-ppl.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
run-with-preset.py		run-with-preset.py	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
server-llm.sh		server-llm.sh	build: rename main → llama-cli, server → llama-server, llava-cli → …	Jun 12, 2024
sync-ggml-am.sh		sync-ggml-am.sh	ggml : remove OpenCL (ggml-org#7735)	Jun 4, 2024
sync-ggml.last		sync-ggml.last	ggml : sync	Jun 18, 2024
sync-ggml.sh		sync-ggml.sh	ggml : remove OpenCL (ggml-org#7735)	Jun 4, 2024
verify-checksum-models.py		verify-checksum-models.py	convert.py : add python logging instead of print() (ggml-org#6511)	May 3, 2024
xxd.cmake		xxd.cmake	build: generate hex dump of server assets during build (ggml-org#6661)	Apr 21, 2024
View all files