5 Commits

Author	SHA1	Message	Date
BreakBB	d8573ee715	Update error raising for CLI pretrain to fix #3840 (#3843) ... * Add check for empty input file to CLI pretrain * Raise error if JSONL is not a dict or contains neither `tokens` nor `text` key * Skip empty values for correct pretrain keys and log a counter as warning * Add tests for CLI pretrain core function make_docs. * Add a short hint for the `tokens` key to the CLI pretrain docs * Add success message to CLI pretrain * Update model loading to fix the tests * Skip empty values and do not create docs out of it	2019-06-16 13:22:57 +02:00
Ryan Ford	00842d7f1b	Merging conversion scripts for conll formats (#3405) ... * merging conllu/conll and conllubio scripts * tabs to spaces * removing conllubio2json from converters/__init__.py * Move not-really-CLI tests to misc * Add converter test using no-ud data * Fix test I broke * removing include_biluo parameter * fixing read_conllx * remove include_biluo from convert.py	2019-03-15 18:14:46 +01:00
Ines Montani	c62d06ea5c	Port over #2949	2018-11-26 18:54:27 +01:00
ines	2324788970	Remove bad tests	2017-05-08 16:15:27 +02:00
ines	83f66947dc	Rename test_download to test_cli	2017-04-23 21:06:50 +02:00