Packages

meeseeks

0.9.3
0.18.0 0.17.0 0.16.1 0.16.0 0.15.1 0.15.0 0.14.0 0.13.1 0.13.0 0.12.0 0.11.2 0.11.1 0.11.0 0.10.1 0.10.0 0.9.5 0.9.4 0.9.3 0.9.2 0.9.1 0.9.0 0.8.0 0.7.7 0.7.6 0.7.5 0.7.4 0.7.3 0.7.2 0.7.1 0.7.0 0.6.0 0.5.0 0.4.1 0.4.0 0.3.1 0.3.0 0.2.1 0.2.0 0.1.0

Meeseeks is a library for parsing and extracting data from HTML and XML with CSS or XPath selectors.

HexDocs

Current section

Files

Jump to
Readme
39 Versions
1 Dependency
Dependants
Files
Activity
meeseeks src css_selector_tokenizer.xrl
Raw

src/css_selector_tokenizer.xrl 

Definitions.



NMSTART = [A-Za-z_]

NMCHAR = [-A-Za-z0-9_]

NL = \n|\r\n|\r|\f

STRING1 = \"([\t\s\!\#\$\%&\(-~]|\\{NL}\|\')*\"

STRING2 = \'([\t\s\!\#\$\%&\(-~]|\\{NL}\|\")*\'

IDENT = (\-)?{NMSTART}{NMCHAR}*

NAME = {NMCHAR}+

INT = [0-9]+

STRING = {STRING1}|{STRING2}

W = [\s\t\r\n\f]*

AB_FORMULA = ([\+\-]{W})?{INT}?[nN]({W}[\+\-]{W}{INT})?



Rules.



\[{W} : {token, "["}.

{W}\] : {token, "]"}.

{W}\) : {token, ")"}.



~= : {token, value_includes}.

\|= : {token, value_dash}.

\$= : {token, value_suffix}.

\^= : {token, value_prefix}.

\*= : {token, value_contains}.

= : {token, value}.



{IDENT}\({W} : {token, {function, trim_and_drop_last(TokenChars)}}.

{AB_FORMULA} : {token, {ab_formula, TokenChars}}.

\+{INT} : {token, {int, drop_first(TokenChars)}}.

{INT} : {token, {int, TokenChars}}.

{STRING} : {token, {string, remove_quotes(TokenChars)}}.

{IDENT} : {token, {ident, TokenChars}}.



\.{IDENT} : {token, {class, drop_first(TokenChars)}}.

#{NAME} : {token, {id, drop_first(TokenChars)}}.





\:{W} : {token, ":"}.

\*{W} : {token, "*"}.



{W}\^{W} : {token, "^"}.

{W}\|{W} : {token, "|"}.

{W}\,{W} : {token, ","}.



{W}>{W} : {token, ">"}.

{W}~{W} : {token, "~"}.

{W}\+{W} : {token, "+"}.

[\s\f]+ : {token, space}.



Erlang code.



drop_first([_|Rest]) ->

    Rest.



trim_and_drop_last(Chars) ->

    Trimmed = string:strip(Chars),

    Len = string:len(Trimmed),

    string:substr(Trimmed, 1, Len - 1).



remove_quotes(Chars) ->

    Len = string:len(Chars),

    string:substr(Chars, 2, Len - 2).