Current section
Files
Jump to
Current section
Files
lib/expug/tokenizer_tools/state.ex
defmodule Expug.TokenizerTools.State do
@moduledoc """
The state used by the tokenizer.
%{ tokens: [], source: "...", position: 0, options: ... }
## Also see
- `Expug.TokenizerTools`
"""
defstruct [:tokens, :source, :position, :options]
end