Packages

erllama

0.5.0
0.8.0 retired 0.7.0 retired 0.6.2 retired 0.6.1 retired 0.6.0 retired 0.5.1 retired 0.5.0 retired 0.4.0 retired 0.3.0 retired 0.2.0 retired 0.1.2 retired 0.1.1 retired 0.1.0 retired

Native Erlang/OTP wrapper around llama.cpp with token-exact tiered KV cache; cache more warm state than fits in RAM

Retired package: Renamed - Renamed to barrel_inference: https://github.com/barrel-platform/barrel_inference
HexDocs

Current section

Files

Jump to
Readme
13 Versions
0 Dependencies
Dependants
Files
Activity
erllama c_src llama.cpp ggml src ggml-cuda argsort.cuh
Raw

c_src/llama.cpp/ggml/src/ggml-cuda/argsort.cuh 

#include "common.cuh"



void ggml_cuda_op_argsort(ggml_backend_cuda_context & ctx, ggml_tensor * dst);



#ifdef GGML_CUDA_USE_CUB

void argsort_f32_i32_cuda_cub(ggml_cuda_pool & pool,

                              const float *    x,

                              int *            dst,

                              const int        ncols,

                              const int        nrows,

                              ggml_sort_order  order,

                              cudaStream_t     stream);

#endif  // GGML_CUDA_USE_CUB

void argsort_f32_i32_cuda_bitonic(const float *   x,

                                  int *           dst,

                                  const int       ncols,

                                  const int       nrows,

                                  ggml_sort_order order,

                                  cudaStream_t    stream);