Ines Montani
644074b954
Merge branch 'develop' into master-tmp
2020-07-20 14:58:04 +02:00
Adriane Boyd
39ebcd9ec9
Refactor Chinese tokenizer configuration ( #5736 )
...
* Refactor Chinese tokenizer configuration
Refactor `ChineseTokenizer` configuration so that it uses a single
`segmenter` setting to choose between character segmentation, jieba, and
pkuseg.
* replace `use_jieba`, `use_pkuseg`, `require_pkuseg` with the setting
`segmenter` with the supported values: `char`, `jieba`, `pkuseg`
* make the default segmenter plain character segmentation `char` (no
additional libraries required)
* Fix Chinese serialization test to use char default
* Warn if attempting to customize other segmenter
Add a warning if `Chinese.pkuseg_update_user_dict` is called when
another segmenter is selected.
2020-07-19 13:34:37 +02:00
Adriane Boyd
cd5af72c9a
Update pkuseg version ( #5774 )
...
* Update pkuseg version in Chinese tokenizer warnings
* Update pkuseg version in `Makefile`
* Remove warning about python3.8 wheels in docs
2020-07-19 11:09:49 +02:00
Ines Montani
872938ec76
Merge pull request #5747 from explosion/feature/refactor-config-args
2020-07-14 00:00:22 +02:00
Ines Montani
5f6f4ff594
Remove object subclassing
2020-07-12 14:03:23 +02:00
Ines Montani
3f948b9c74
Update docs
2020-07-12 12:32:28 +02:00
Ines Montani
7b5717cac3
Merge branch 'develop' into feature/refactor-config-args
2020-07-10 22:50:07 +02:00
Ines Montani
e6a6587a9a
Update projects.md [ci skip]
2020-07-10 22:41:27 +02:00
Ines Montani
f2cd982e7b
Update training.md
2020-07-10 22:34:27 +02:00
Ines Montani
52e9b5b472
Fix formatting
2020-07-09 23:25:58 +02:00
Ines Montani
28cdae898a
Update projects.md
2020-07-09 22:35:54 +02:00
Ines Montani
7bcf9f7cfb
Document new features
2020-07-09 21:10:36 +02:00
Ines Montani
ea01831f6a
Update projects docs etc.
2020-07-09 19:43:25 +02:00
Ines Montani
2298e129e6
Update example and training docs
2020-07-07 20:30:12 +02:00
svlandeg
2b60e894cb
fix component constructors, update, begin_training, reference to GoldParse
2020-07-07 19:17:19 +02:00
Ines Montani
bb3ee38cf9
Update WIP
2020-07-06 22:22:37 +02:00
Ines Montani
44790c1c32
Update docs and add keyword-only tag
2020-07-06 18:14:57 +02:00
Ines Montani
a35236e5f0
Update v3 docs WIP [ci skip]
2020-07-06 15:57:44 +02:00
Ines Montani
63247cbe87
Update v3 docs [ci skip]
2020-07-05 16:11:16 +02:00
Ines Montani
dc8c9d912f
Update docs [ci skip]
2020-07-04 16:47:24 +02:00
Ines Montani
1e0d54edd1
Update docs
2020-07-04 14:23:10 +02:00
Ines Montani
06f1ecb308
Update v3 docs
2020-07-03 16:48:21 +02:00
Ines Montani
b5268955d7
Update matcher usage examples [ci skip]
2020-07-02 15:39:45 +02:00
Ines Montani
fe4cfd0632
Start updating website for v3 [ci skip]
2020-07-01 21:26:39 +02:00
Ines Montani
26df4efa94
Add new in v3.0
2020-07-01 13:02:17 +02:00
Ines Montani
414dc7ace1
Merge branch 'spacy.io' into spacy.io-develop
2020-07-01 11:47:47 +02:00
Matthias Hertel
305221f3e5
Website: fixed the token span in the text about the rule-based matching example ( #5669 )
...
* fixed token span in pattern matcher example
* contributor agreement
2020-06-30 19:58:55 +02:00
Matthias Hertel
8b0f749606
Website: fixed the token span in the text about the rule-based matching example ( #5669 )
...
* fixed token span in pattern matcher example
* contributor agreement
2020-06-30 19:58:23 +02:00
Adriane Boyd
d777d9cc38
Extend v2.3 migration guide ( #5653 )
...
* Extend preloaded vocab section
* Add section on tag maps
2020-06-26 14:13:01 +02:00
Adriane Boyd
c4d0209472
Extend v2.3 migration guide ( #5653 )
...
* Extend preloaded vocab section
* Add section on tag maps
2020-06-26 14:12:29 +02:00
Adriane Boyd
a2660bd9c6
Fix backslashes in warnings config diff ( #5640 )
...
Fix backslashes in warnings config diff in v2.3 migration section.
2020-06-24 10:26:57 +02:00
Adriane Boyd
fd4287c178
Fix backslashes in warnings config diff ( #5640 )
...
Fix backslashes in warnings config diff in v2.3 migration section.
2020-06-24 10:26:12 +02:00
Adriane Boyd
4f73ced914
Extend what's new in v2.3 with vocab / is_oov ( #5635 )
2020-06-23 16:50:43 +02:00
Adriane Boyd
7ce451c211
Extend what's new in v2.3 with vocab / is_oov ( #5635 )
2020-06-23 16:48:59 +02:00
Adriane Boyd
fcdecefacf
Add warnings example in v2.3 migration guide ( #5627 )
2020-06-22 14:38:06 +02:00
Adriane Boyd
bc1cb30b21
Add warnings example in v2.3 migration guide ( #5627 )
2020-06-22 14:37:24 +02:00
Ines Montani
52728d8fa3
Merge branch 'develop' into master-tmp
2020-06-20 15:52:00 +02:00
Adriane Boyd
66889de166
Warning for sudachipy 0.4.5 ( #5611 )
2020-06-19 13:45:23 +02:00
Adriane Boyd
931d80de72
Warning for sudachipy 0.4.5 ( #5611 )
2020-06-19 12:43:41 +02:00
Ines Montani
6d712f3e06
Merge pull request #5599 from adrianeboyd/docs/v2.3.0-minor
2020-06-16 13:49:25 -07:00
Adriane Boyd
02369f91d3
Fix spacy convert argument
2020-06-16 20:41:17 +02:00
Adriane Boyd
f0fd77648f
Change example title to Dr.
...
Change example title to Dr. so the current model does exclude the title
in the initial example.
2020-06-16 20:36:21 +02:00
Adriane Boyd
a6abdfbc3c
Fix numpy.zeros() dtype for Doc.from_array
2020-06-16 20:35:45 +02:00
Adriane Boyd
9aff317ca7
Update POS in tagging example
2020-06-16 20:26:57 +02:00
Adriane Boyd
457babfa0c
Update alignment example for new gold.align
2020-06-16 20:22:03 +02:00
Ines Montani
44af53bdd9
Add pkuseg warnings and auto-format [ci skip]
2020-06-16 17:13:35 +02:00
Adriane Boyd
d5110ffbf2
Documentation updates for v2.3.0 ( #5593 )
...
* Update website models for v2.3.0
* Add docs for Chinese word segmentation
* Tighten up Chinese docs section
* Merge branch 'master' into docs/v2.3.0 [ci skip]
* Merge branch 'master' into docs/v2.3.0 [ci skip]
* Auto-format and update version
* Update matcher.md
* Update languages and sorting
* Typo in landing page
* Infobox about token_match behavior
* Add meta and basic docs for Japanese
* POS -> TAG in models table
* Add info about lookups for normalization
* Updates to API docs for v2.3
* Update adding norm exceptions for adding languages
* Add --omit-extra-lookups to CLI API docs
* Add initial draft of "What's New in v2.3"
* Add new in v2.3 tags to Chinese and Japanese sections
* Add tokenizer to migration section
* Add new in v2.3 flags to init-model
* Typo
* More what's new in v2.3
Co-authored-by: Ines Montani <ines@ines.io>
2020-06-16 15:37:35 +02:00
Ines Montani
810fce3bb1
Merge branch 'develop' into master-tmp
2020-06-03 14:36:59 +02:00
Ines Montani
262d306eaa
unicode -> str consistency
2020-05-24 17:23:00 +02:00
Ines Montani
5d3806e059
unicode -> str consistency
2020-05-24 17:20:58 +02:00
