phiat

Pure Elixir BPE tokenizer compatible with OpenAI's tiktoken. Supports cl100k_base (GPT-4, GPT-3.5) and o200k_base (GPT-4o) encodings. No NIFs, no Python, no external dependencies.

Last Updated: 1 month ago

Operator	Description	Example
name:	Match package name. Supports * wildcards and repo/package form	name:phx* or name:hexpm/phoenix
description:	Full-text search of package descriptions	description:auth
depends:	Packages depending on a given package. Supports repo:package form	depends:ecto or depends:hexpm:ecto
build_tool:	Filter by build tool	build_tool:mix
updated_after:	Packages updated after an ISO8601 datetime	updated_after:2025-01-01T00:00:00Z
extra:	Match custom metadata (key,value). Nested keys are separated by commas	extra:license,MIT