spaCy/spacy
idoshr b10c7bc56e
Hebrew like num (#5952)
* Update stop_words.py

Hebrew STOP WORDS

* Update stop_words.py

* contributor

* contributor

* add some common domain extentions
support human number 1K/1M....

* support human number 1K/1M....

* hebrew number tokenize
1K/1M implement in EN

* test human tokenize fix

* test

* heb like num
revert human number change

* heb like num
2020-08-24 14:30:05 +02:00
..
cli Remove hard-coded GPU ID from pretrain (#5808) 2020-07-24 09:26:26 +02:00
data Make spacy/data a package 2017-03-18 20:04:22 +01:00
displacy Fix on EntityRendered to support break lines (after last entity) (closes #5838) 2020-07-29 18:48:39 +02:00
lang Hebrew like num (#5952) 2020-08-24 14:30:05 +02:00
matcher Add warning when Matcher subpattern is discarded (#5873) 2020-08-05 14:56:14 +02:00
ml Experimental character-based pretraining (#5700) 2020-07-05 15:48:39 +02:00
pipeline Add Armenian sentence-final verchaket, Greek question mark and Arabic question mark to default punct (#5910) 2020-08-12 15:36:14 +02:00
syntax Improve warnings around normalization tables (#5794) 2020-07-22 16:04:58 +02:00
tests Hebrew like num (#5952) 2020-08-24 14:30:05 +02:00
tokens Allow Doc.char_span to snap to token boundaries (#5849) 2020-08-04 13:36:32 +02:00
__init__.pxd * Seems to be working after refactor. Need to wire up more POS tag features, and wire up save/load of POS tags. 2014-10-24 02:23:42 +11:00
__init__.py Simplify warnings 2020-04-28 13:37:37 +02:00
__main__.py Use latest wasabi 2019-11-04 02:38:45 +01:00
_ml.py Experimental character-based pretraining (#5700) 2020-07-05 15:48:39 +02:00
about.py Set version to 2.3.2 (#5756) 2020-07-13 14:55:56 +02:00
analysis.py Simplify warnings 2020-04-28 13:37:37 +02:00
attrs.pxd Reduce stored lexemes data, move feats to lookups (#5238) 2020-05-19 15:59:14 +02:00
attrs.pyx Reduce stored lexemes data, move feats to lookups (#5238) 2020-05-19 15:59:14 +02:00
compat.py Replace function registries with catalogue (#4584) 2019-11-07 11:45:22 +01:00
errors.py Add warning when Matcher subpattern is discarded (#5873) 2020-08-05 14:56:14 +02:00
glossary.py Update tag maps and docs for English and German (#4501) 2019-10-24 12:56:05 +02:00
gold.pxd Merge changes from master 2019-08-21 14:18:52 +02:00
gold.pyx Updates to docstrings (#5589) 2020-06-15 14:58:36 +02:00
kb.pxd Tidy up and avoid absolute spacy imports in core 2020-05-21 20:05:03 +02:00
kb.pyx Merge pull request #5264 from lfiedler/issue-5230 2020-05-22 00:31:07 +02:00
language.py Include git commit in package and model meta (#5694) 2020-07-02 17:10:27 +02:00
lemmatizer.py Fix lemmatizer is_base_form for python2.7 (#5734) 2020-07-09 22:11:24 +02:00
lexeme.pxd Reduce stored lexemes data, move feats to lookups (#5238) 2020-05-19 15:59:14 +02:00
lexeme.pyx Fix polarity of Token.is_oov and Lexeme.is_oov (#5634) 2020-06-23 13:29:51 +02:00
lookups.py Reduce memory usage of Lookup's BloomFilter (#5606) 2020-06-26 14:09:10 +02:00
morphology.pxd annotate kb_id through ents in doc 2019-03-22 11:36:44 +01:00
morphology.pyx Improve tag map initialization and updating (#5768) 2020-07-19 11:13:39 +02:00
parts_of_speech.pxd Add support for Universal Dependencies v2.0 2017-03-03 13:17:34 +01:00
parts_of_speech.pyx Tidy up rest 2017-10-27 21:07:59 +02:00
scorer.py Fix GoldParse init when token count differs (#5191) 2020-03-26 10:46:23 +01:00
strings.pxd Try to fix StringStore clean up (see #1506) 2017-11-11 03:11:27 +03:00
strings.pyx Merge branch 'master' into feature/lemmatizer 2019-03-16 13:44:22 +01:00
structs.pxd Reduce stored lexemes data, move feats to lookups (#5238) 2020-05-19 15:59:14 +02:00
symbols.pxd Reduce stored lexemes data, move feats to lookups (#5238) 2020-05-19 15:59:14 +02:00
symbols.pyx Reduce stored lexemes data, move feats to lookups (#5238) 2020-05-19 15:59:14 +02:00
tokenizer.pxd Rename to url_match 2020-05-22 12:41:03 +02:00
tokenizer.pyx Rename to url_match 2020-05-22 12:41:03 +02:00
typedefs.pxd Work on changing StringStore to return hashes. 2017-05-28 12:36:27 +02:00
typedefs.pyx Tidy up rest 2017-10-27 21:07:59 +02:00
util.py Skip vocab in component config overrides (#5624) 2020-06-23 23:21:11 +02:00
vectors.pyx fix deserialization order 2020-05-30 12:53:32 +02:00
vocab.pxd Reduce stored lexemes data, move feats to lookups (#5238) 2020-05-19 15:59:14 +02:00
vocab.pyx Updates to docstrings (#5589) 2020-06-15 14:56:51 +02:00