Packages

Native Erlang/OTP wrapper around llama.cpp with token-exact tiered KV cache; cache more warm state than fits in RAM

Retired package: Renamed - Renamed to barrel_inference: https://github.com/barrel-platform/barrel_inference

Current section

Files

Jump to
erllama c_src llama.cpp src llama-quant.h
Raw

c_src/llama.cpp/src/llama-quant.h

#pragma once