3227 Commits

Author	SHA1	Message	Date
Matthew Honnibal	920887f4e4	Specify order of vocab deserialization	2017-05-29 13:04:40 +02:00
Matthew Honnibal	f4aafca222	Merge changes to test_misc	2017-05-29 12:26:02 +02:00
Matthew Honnibal	a318f0cae1	Add to/from disk/bytes methods for tokenizer	2017-05-29 12:24:41 +02:00
Matthew Honnibal	ff26aa6c37	Work on to/from bytes/disk serialization methods	2017-05-29 11:45:45 +02:00
ines	df920ba0e7	Add tests for displaCy and util functions and fix util typo	2017-05-29 10:51:19 +02:00
ines	c5714d4fb2	xfail matcher test for now until setting norm via Span.merge works	2017-05-29 10:51:02 +02:00
Matthew Honnibal	6b019b0540	Update to/from bytes methods	2017-05-29 10:14:20 +02:00
Matthew Honnibal	c91b121aeb	Move serialization functions to util	2017-05-29 10:13:42 +02:00
Matthew Honnibal	1fa2bfb600	Add model_to_bytes and model_from_bytes helpers. Probably belong in thinc.	2017-05-29 09:27:04 +02:00
Matthew Honnibal	6dad4117ad	Work on serialization for models	2017-05-29 01:37:57 +02:00
ines	7b1ddcc04d	Add test for vocab serialization	2017-05-29 01:09:52 +02:00
ines	00b2094dc3	Fix typos, long integers and tests	2017-05-29 01:09:52 +02:00
ines	804dbb8d25	Add StringStore test for API docs	2017-05-29 01:09:52 +02:00
Matthew Honnibal	6cd5730ee7	Fix lex struct setters for strings	2017-05-29 01:05:09 +02:00
Matthew Honnibal	2edd96ce47	Draft Vocab to/from disk/bytes	2017-05-28 23:34:12 +02:00
Matthew Honnibal	4ddff020c3	Fix compile error	2017-05-28 23:30:40 +02:00
Matthew Honnibal	6d3caeadd2	Fix type check for long	2017-05-28 23:22:45 +02:00
Matthew Honnibal	92dbf28c1e	Hack a fixture in the vectors tests, for xfail	2017-05-28 20:28:32 +02:00
Matthew Honnibal	9239f06ed3	Fix german noun chunks iterator	2017-05-28 20:13:03 +02:00
Matthew Honnibal	fd9b6722a9	Fix noun chunks iterator for new stringstore	2017-05-28 20:12:10 +02:00
ines	414193e9ba	Update docs to reflect StringStore changes	2017-05-28 18:19:11 +02:00
Matthew Honnibal	7996d21717	Fixes for new StringStore	2017-05-28 11:09:27 -05:00
Matthew Honnibal	8a24c60c1e	Merge branch 'develop' of https://github.com/explosion/spaCy into develop	2017-05-28 08:12:05 -05:00
Matthew Honnibal	bc97bc292c	Fix __call__ method	2017-05-28 08:11:58 -05:00
Matthew Honnibal	5cf47b847b	Handle iob with no tag in converter	2017-05-28 08:11:39 -05:00
Matthew Honnibal	fe11564b8e	Finish stringstore change. Also xfail vectors tests	2017-05-28 15:10:22 +02:00
Matthew Honnibal	b007a2b0d3	Update stringstore tests	2017-05-28 14:08:09 +02:00
Matthew Honnibal	84e66ca6d4	WIP on stringstore change. 27 failures	2017-05-28 14:06:40 +02:00
Matthew Honnibal	fe4a746300	Accomodate symbols in new string scheme	2017-05-28 13:03:16 +02:00
Matthew Honnibal	f51e6a6c16	Adjust lexeme sizing for attr_t being 64 bit	2017-05-28 12:51:09 +02:00
Matthew Honnibal	a5606c3eda	Work on changing StringStore to return hashes.	2017-05-28 12:36:27 +02:00
Matthew Honnibal	39293ab2ee	Merge branch 'develop' of https://github.com/explosion/spaCy into develop	2017-05-28 11:46:57 +02:00
Matthew Honnibal	dd052572d4	Update arc eager for SBD changes	2017-05-28 11:46:51 +02:00
Matthew Honnibal	3ea98e2043	Remove vector member from lexeme	2017-05-28 11:46:24 +02:00
Matthew Honnibal	2445707f3c	Re-delegate vectors to vocab	2017-05-28 11:46:10 +02:00
Matthew Honnibal	6863d01361	Remove vectors from lexeme	2017-05-28 11:45:48 +02:00
Matthew Honnibal	15f6efc127	Remove vectors from vocab	2017-05-28 11:45:32 +02:00
Matthew Honnibal	c1263a844b	Merge branch 'develop' of https://github.com/explosion/spaCy into develop	2017-05-27 18:32:57 -05:00
Matthew Honnibal	9e711c3476	Divide d_loss by batch size	2017-05-27 18:32:46 -05:00
Matthew Honnibal	b082f76494	Randomize pipeline order during training	2017-05-27 18:32:21 -05:00
Matthew Honnibal	a1d4c97fb7	Improve correctness of minibatching	2017-05-27 17:59:00 -05:00
ines	84189c1cab	Add 'xx' language ID for multi-language support ... Allows models to specify their language ID as 'xx'.	2017-05-28 00:58:59 +02:00
ines	33e332e67c	Remove unused export	2017-05-28 00:57:59 +02:00
ines	c1983621fb	Update util functions for model loading	2017-05-28 00:22:40 +02:00
ines	c8543c8237	Fix formatting and docstrings and remove deprecated function	2017-05-28 00:22:40 +02:00
Matthew Honnibal	49235017bf	Merge branch 'develop' of https://github.com/explosion/spaCy into develop	2017-05-27 16:34:28 -05:00
Matthew Honnibal	7ebd26b8aa	Use ordered dict to specify transitions	2017-05-27 15:52:20 -05:00
Matthew Honnibal	3eea5383a1	Add move_names property to parser	2017-05-27 15:51:55 -05:00
Matthew Honnibal	8de9829f09	Don't overwrite model in initialization, when loading	2017-05-27 15:50:40 -05:00
Matthew Honnibal	99316fa631	Use ordered dict to specify actions	2017-05-27 15:50:21 -05:00