Adriane Boyd 0e7f94b247 Update Tokenizer.explain with special matches (#7749) ... * Update Tokenizer.explain with special matches Update `Tokenizer.explain` and the pseudo-code in the docs to include the processing of special cases that contain affixes or whitespace. * Handle optional settings in explain * Add test for special matches in explain Add test for `Tokenizer.explain` for special cases containing affixes.		2021-04-19 19:08:20 +10:00
..
api	assemble CLI command (#7783)	2021-04-19 18:39:11 +10:00
images	Update pipeline design docs [ci skip]	2021-04-06 14:13:22 +10:00
models	Add more link anchors [ci skip]	2021-04-06 14:15:21 +10:00
usage	Update Tokenizer.explain with special matches (#7749)	2021-04-19 19:08:20 +10:00
index.md	💫 Update website (#3285)	2019-02-17 19:31:19 +01:00
styleguide.md	Update styleguide [ci skip]	2020-09-14 11:25:57 +02:00