tokenizer2

tokenizer2

NPMNPM
NPMwww.npmjs.com
GitHubgithub.com
Releases7
Frequency5 months 2 weeks
Last Release
tokenize any text stream given some basic regex rules to match tokens
Log in to subscribe

Linked projects

smallhelm/tokenizer2
tokenize any text stream given some basic regex rules to match tokens
smallhelm/tokenizer2.git