tokenizers | Hex

tokenizers 0.5.1

Bindings to Hugging Face Tokenizers for Elixir

Links

License

Apache-2.0

Downloads

64 091 64 091
this version
844 844
yesterday
3 934 3 934
last 7 days
439.8K 439 755
all time

Versions (10)

0.5.1 Oct 02, 2024
0.5.0 Apr 24, 2024
0.4.0 Aug 09, 2023
0.3.2 Apr 19, 2023
0.3.1 Apr 06, 2023

Show All Versions

Dependencies (3)

castore ~> 0.1 or ~> 1.0
rustler >= 0.0.0 (optional)
rustler_precompiled ~> 0.6

Recent Activity

Feb 18, 2025 Remove level full owner philip
Oct 02, 2024 Publish documentation for release 0.5.1
Oct 02, 2024 Publish release 0.5.1
Apr 24, 2024 Publish documentation for release 0.5.0
Apr 24, 2024 Publish release 0.5.0
Aug 09, 2023 Publish documentation for release 0.4.0
Aug 09, 2023 Publish release 0.4.0
Apr 19, 2023 Publish documentation for release 0.3.2
Apr 19, 2023 Publish release 0.3.2
Apr 06, 2023 Publish documentation for release 0.3.1

Show All Activities

Config

mix.exs

rebar.config

erlang.mk

Checksum

Build Tools

mix

Owners

elixir_nx

Publisher

Dependents (1)

bumblebee, show all...