Packages

erllama

0.3.0
0.8.0 retired 0.7.0 retired 0.6.2 retired 0.6.1 retired 0.6.0 retired 0.5.1 retired 0.5.0 retired 0.4.0 retired 0.3.0 retired 0.2.0 retired 0.1.2 retired 0.1.1 retired 0.1.0 retired

Native Erlang/OTP wrapper around llama.cpp with token-exact tiered KV cache; cache more warm state than fits in RAM

Retired package: Renamed - Renamed to barrel_inference: https://github.com/barrel-platform/barrel_inference
HexDocs

Current section

Files

Jump to
Readme
13 Versions
0 Dependencies
Dependants
Files
Activity
erllama c_src llama.cpp ggml include ggml-blas.h
Raw

c_src/llama.cpp/ggml/include/ggml-blas.h 

#pragma once



#include "ggml.h"

#include "ggml-backend.h"





#ifdef  __cplusplus

extern "C" {

#endif



// backend API

GGML_BACKEND_API ggml_backend_t ggml_backend_blas_init(void);



GGML_BACKEND_API bool ggml_backend_is_blas(ggml_backend_t backend);



// number of threads used for conversion to float

// for openblas and blis, this will also set the number of threads used for blas operations

GGML_BACKEND_API void ggml_backend_blas_set_n_threads(ggml_backend_t backend_blas, int n_threads);



GGML_BACKEND_API ggml_backend_reg_t ggml_backend_blas_reg(void);





#ifdef  __cplusplus

}

#endif