Packages

erllama

0.6.2
0.8.0 retired 0.7.0 retired 0.6.2 retired 0.6.1 retired 0.6.0 retired 0.5.1 retired 0.5.0 retired 0.4.0 retired 0.3.0 retired 0.2.0 retired 0.1.2 retired 0.1.1 retired 0.1.0 retired

Native Erlang/OTP wrapper around llama.cpp with token-exact tiered KV cache; cache more warm state than fits in RAM

Retired package: Renamed - Renamed to barrel_inference: https://github.com/barrel-platform/barrel_inference
HexDocs

Current section

Files

Jump to
Readme
13 Versions
0 Dependencies
Dependants
Files
Activity
erllama c_src llama.cpp ggml src ggml-cpu spacemit ime.h
Raw

c_src/llama.cpp/ggml/src/ggml-cpu/spacemit/ime.h 

#pragma once



#include "ggml-alloc.h"



#ifdef __cplusplus

extern "C" {

#endif



ggml_backend_buffer_type_t ggml_backend_cpu_riscv64_spacemit_buffer_type(void);



void ggml_backend_cpu_riscv64_spacemit_set_numa_thread_affinity(int thread_n);



void ggml_backend_cpu_riscv64_spacemit_clear_numa_thread_affinity_threaded(int thread_n);



void * ggml_backend_cpu_riscv64_spacemit_alloc_shared(size_t size, size_t alignment);



void ggml_backend_cpu_riscv64_spacemit_free_shared(void * ptr);



#ifdef __cplusplus

}

#endif