spaCy/spacy/tests/regression/test_issue351.py

# coding: utf-8
from __future__ import unicode_literals

import pytest


def test_issue351(en_tokenizer):
    doc = en_tokenizer("   This is a cat.")
    assert doc[0].idx == 0
    assert len(doc[0]) == 3
    assert doc[1].idx == 3
Tidy up regression tests 2017-01-10 21:24:10 +03:00			`# coding: utf-8`
Move regression test for #351 to own file 2017-01-04 02:47:11 +03:00			`from __future__ import unicode_literals`
Tidy up regression tests 2017-01-10 21:24:10 +03:00
Move regression test for #351 to own file 2017-01-04 02:47:11 +03:00			`import pytest`


			`def test_issue351(en_tokenizer):`
			`doc = en_tokenizer(" This is a cat.")`
			`assert doc[0].idx == 0`
			`assert len(doc[0]) == 3`
			`assert doc[1].idx == 3`