Packages

tiktoken_ex

0.2.0

0.2.0 0.1.0

Pure-Elixir TikToken-style byte-level BPE tokenizer, with helpers for Kimi K2 encodings.

HexDocs

Current section

2 Versions

Jump to

Readme 2 Versions 1 Dependency 2 Dependants Files Activity

Versions

Compare versions

0.2.0

December 29, 2025

0.1.0

December 13, 2025

Version	Publish Date	Note	Actions
0.2.0	December 29, 2025
0.1.0	December 13, 2025

2 versions of 2 total

Checksum

Dependency Config

mix.exs

rebar.config

Gleam

erlang.mk

Package Details

Downloads Last 30 days, all versions

this version

112

yesterday

0

last 7 days

10

all time

213

Last Updated

Dec 29, 2025

License

MIT

Build Tools

mix

Publisher

nshkrdotcom

Links

Docs
GitHub

Owners

nshkrdotcom

Search filters

Type any of these into the search box. They can be combined with free text which searches package names and descriptions.

Operator	Description	Example
name:	Match package name. Supports * wildcards and repo/package form	name:phx* or name:hexpm/phoenix
description:	Full-text search of package descriptions	description:auth
depends:	Packages depending on a given package. Supports repo:package form	depends:ecto or depends:hexpm:ecto
build_tool:	Filter by build tool	build_tool:mix
updated_after:	Packages updated after an ISO8601 datetime	updated_after:2025-01-01T00:00:00Z
extra:	Match custom metadata (key,value). Nested keys are separated by commas	extra:license,MIT

Wrap values in double quotes to include spaces, e.g. name:"my package".