add bzick/tokenizer (#4238)

Add https://github.com/bzick/tokenizer
This commit is contained in:
Ivan Shalganov 2022-06-01 19:17:25 +03:00 committed by GitHub
parent 46d8aba042
commit 6750953322
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -2326,6 +2326,7 @@ See also [Natural Language Processing](#natural-language-processing) and [Text A
- [parth](https://github.com/codemodus/parth) - URL path segmentation parsing.
- [sdp](https://github.com/gortc/sdp) - SDP: Session Description Protocol [[RFC 4566](https://tools.ietf.org/html/rfc4566)].
- [sh](https://github.com/mvdan/sh) - Shell parser and formatter.
- [tokenizer](https://github.com/bzick/tokenizer) — Parse any string, slice or infinite buffer to any tokens.
- [when](https://github.com/olebedev/when) - Natural EN and RU language date/time parser with pluggable rules.
- [xj2go](https://github.com/stackerzzq/xj2go) - Convert xml or json to go struct.