spaCy/tests/test_tokens_from_list.py

from __future__ import unicode_literals
import pytest

from spacy.en import English


@pytest.fixture
def EN():
    return English()


def test1(EN):
    words = ['JAPAN', 'GET', 'LUCKY']
    tokens = EN.tokenizer.tokens_from_list(words)
    assert len(tokens) == 3
    assert tokens[0].string == 'JAPAN'
* Commit outstanding tests 2014-11-12 15:24:32 +03:00			`from __future__ import unicode_literals`
* Tests passing except for morphology/lemmatization stuff 2014-12-23 03:40:32 +03:00			`import pytest`
* Commit outstanding tests 2014-11-12 15:24:32 +03:00
* Tests passing except for morphology/lemmatization stuff 2014-12-23 03:40:32 +03:00			`from spacy.en import English`
* Commit outstanding tests 2014-11-12 15:24:32 +03:00
* Tests passing except for morphology/lemmatization stuff 2014-12-23 03:40:32 +03:00
			`@pytest.fixture`
			`def EN():`
			`return English()`


			`def test1(EN):`
* Commit outstanding tests 2014-11-12 15:24:32 +03:00			`words = ['JAPAN', 'GET', 'LUCKY']`
* Tests passing except for morphology/lemmatization stuff 2014-12-23 03:40:32 +03:00			`tokens = EN.tokenizer.tokens_from_list(words)`
* Commit outstanding tests 2014-11-12 15:24:32 +03:00			`assert len(tokens) == 3`
			`assert tokens[0].string == 'JAPAN'`