iree_tokenizers

0.8.13

Fast Hugging Face tokenizer.json, OpenAI tiktoken, and SentencePiece model bindings for Elixir via the IREE tokenizer runtime

Current section

0 Dependants

Jump to

Packages depending on iree_tokenizers

0 packages

No packages depend on iree_tokenizers yet.

mix.exs

rebar.config

Gleam

erlang.mk

Downloads Last 30 days, all versions

this version

52

yesterday

2

last 7 days

96

all time

1 863

Last Updated

Sep 01, 2026

License

Apache-2.0

Build Tools

mix

Publisher

Type any of these into the search box. They can be combined with free text which searches package names and descriptions.

Operator	Description	Example
name:	Match package name. Supports * wildcards and repo/package form	name:phx* or name:hexpm/phoenix
description:	Full-text search of package descriptions	description:auth
depends:	Packages depending on a given package. Supports repo:package form	depends:ecto or depends:hexpm:ecto
build_tool:	Filter by build tool	build_tool:mix
updated_after:	Packages updated after an ISO8601 datetime	updated_after:2025-01-01T00:00:00Z
extra:	Match custom metadata (key,value). Nested keys are separated by commas	extra:license,MIT

Wrap values in double quotes to include spaces, e.g. name:"my package".