1
1
mirror of https://github.com/explosion/spaCy.git synced 2025-01-18 21:44:12 +03:00
Commit Graph

3 Commits

Author SHA1 Message Date
Ines Montani
3d8fd4b461 Revert 2019-09-29 17:32:12 +02:00
Ines Montani
c9cd516d96 Move tests out of package ()
* Move tests out of package

* Fix typo
2019-09-28 18:05:00 +02:00
Sofie
9745b0d523 Improve Italian & Urdu tokenization accuracy ()
## Description

1. Added the same infix rule as in French (`d'une`, `j'ai`) for Italian (`c'è`, `l'ha`), bringing F-score on `it_isdt-ud-train.txt` from 96% to 99%. Added unit test to check this behaviour.

2. Added specific Urdu punctuation character as suffix, improving F-score on `ur_udtb-ud-train.txt` from 94% to 100%. Added unit test to check this behaviour.

### Types of change
Enhancement of Italian & Urdu tokenization

## Checklist
- [x] I have submitted the spaCy Contributor Agreement.
- [x] I ran the tests, and all new and existing tests passed.
- [x] My changes don't require a change to the documentation, or if they do, I've added all required information.
2019-02-04 22:39:25 +01:00