Gyorgy Orosz 8c0b4b850e Fixed emoji handling for Hungarian		2017-05-30 21:34:46 +02:00
..
__init__.py	add __init__.py to empty package dirs	2016-03-14 11:28:03 +01:00
sun.txt	Move text file back to tokenizer tests directory	2017-01-12 02:10:23 +01:00
test_exceptions.py	Fixed emoji handling for Hungarian	2017-05-30 21:34:46 +02:00
test_tokenizer.py	Remove unused utf8open util and replace os.path with ensure_path	2017-04-16 20:37:45 +02:00
test_urls.py	Fix xpassing URL test case	2017-04-07 17:36:05 +02:00
test_whitespace.py	Move non-English-specific tests back to general tokenizer tests	2017-01-05 18:09:29 +01:00