Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							f7283a5067
							
						
					 | 
					
						
						
							
							* Fix vectors bugs for OOV words
						
						
						
						
						
					 | 
					
						2015-09-22 02:10:25 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							f32927efbf
							
						
					 | 
					
						
						
							
							* Raise exceptions if attempt to access parse, but data is not installed. This partly but not fully addresses Issue #97. Still need exceptions on the various Token attributes that access the parse tree, e.g. token.head, token.lefts, token.rights, etc. Exceptions should be centralized, too.
						
						
						
						
						
					 | 
					
						2015-09-21 18:35:40 +10:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							77856c4fcd
							
						
					 | 
					
						
						
							
							* Try giving Doc and Span objects vector and vector_norm attributes, and .similarity functions. Turns out to be bad idea.
						
						
						
						
						
					 | 
					
						2015-09-17 11:50:11 +10:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							60c26b2dfa
							
						
					 | 
					
						
						
							
							* Fix slicing when start or stop is None
						
						
						
						
						
					 | 
					
						2015-09-15 14:43:10 +10:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							65dc0d1dfb
							
						
					 | 
					
						
						
							
							* Extend word vectors support, with .similarity() function, vector_norm property, and rename repvec to vector. Keep repvec name as well for now for backwards compatibility.
						
						
						
						
						
					 | 
					
						2015-09-14 17:49:58 +10:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							c08f10083c
							
						
					 | 
					
						
						
							
							* Add test and test_with_ws attributes.
						
						
						
						
						
					 | 
					
						2015-09-13 10:27:42 +10:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							9e7bfe8449
							
						
					 | 
					
						
						
							
							* Fix space at end of merged token
						
						
						
						
						
					 | 
					
						2015-09-10 14:45:17 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							31ccf494e6
							
						
					 | 
					
						
						
							
							Merge branch 'develop' of https://github.com/honnibal/spaCy into develop
						
						
						
						
						
					 | 
					
						2015-09-09 14:33:38 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							07686470a9
							
						
					 | 
					
						
						
							
							* Don't consider a coordinated NP a base chunk
						
						
						
						
						
					 | 
					
						2015-09-09 14:32:28 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							0e24d099a1
							
						
					 | 
					
						
						
							
							* Fix L/R edge bug, by ensuring l_edge and r_edge are preset, and fixing the way the edge update in del_arc. Bugs keep arising here because the edges are absolute positions, where everything else is relative. I'm also not 100% convinced that del_arc is handled correctly. Do we need to update the parents?
						
						
						
						
						
					 | 
					
						2015-09-09 03:40:44 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							86c888667f
							
						
					 | 
					
						
						
							
							* Merge in changes from de branch
						
						
						
						
						
					 | 
					
						2015-09-06 19:49:28 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							d2fc104a26
							
						
					 | 
					
						
						
							
							* Begin merge of Gazetteer and DE branches
						
						
						
						
						
					 | 
					
						2015-09-06 19:45:15 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							fd1eeb3102
							
						
					 | 
					
						
						
							
							* Add POS attribute support in get_attr
						
						
						
						
						
					 | 
					
						2015-09-06 04:13:03 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							c2307fa9ee
							
						
					 | 
					
						
						
							
							* More work on language-generic parsing
						
						
						
						
						
					 | 
					
						2015-08-28 02:02:33 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							6f1743692a
							
						
					 | 
					
						
						
							
							* Work on language-independent refactoring
						
						
						
						
						
					 | 
					
						2015-08-23 20:49:18 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							b0f5c39084
							
						
					 | 
					
						
						
							
							* Fix handling of exclusion entities
						
						
						
						
						
					 | 
					
						2015-08-06 17:28:43 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							10d869d102
							
						
					 | 
					
						
						
							
							* Don't allow conjunction between NPs in base NP chunks
						
						
						
						
						
					 | 
					
						2015-08-06 16:31:53 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							9c1724ecae
							
						
					 | 
					
						
						
							
							* Gazetteer stuff working, now need to wire up to API
						
						
						
						
						
					 | 
					
						2015-08-06 00:35:40 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							eb7138c761
							
						
					 | 
					
						
						
							
							* Add attr relation in base NP detection
						
						
						
						
						
					 | 
					
						2015-08-01 00:34:40 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							4988356cf0
							
						
					 | 
					
						
						
							
							* Fix dependency type bug from merged tokens
						
						
						
						
						
					 | 
					
						2015-08-01 00:33:24 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							78a9068319
							
						
					 | 
					
						
						
							
							* Fix spacy attr on merged tokens
						
						
						
						
						
					 | 
					
						2015-07-30 04:25:58 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							430e2edb96
							
						
					 | 
					
						
						
							
							* Fix noun_chunks issue
						
						
						
						
						
					 | 
					
						2015-07-30 03:51:50 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							74d8cb3980
							
						
					 | 
					
						
						
							
							* Add noun_chunks iterator, and fix left/right child setting in Doc.merge
						
						
						
						
						
					 | 
					
						2015-07-30 02:29:49 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							b5132bed7d
							
						
					 | 
					
						
						
							
							* Set left and right children when loading parse from byte string
						
						
						
						
						
					 | 
					
						2015-07-28 21:03:18 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							aa7a964a4f
							
						
					 | 
					
						
						
							
							* Add a type declaration for doc.from_array
						
						
						
						
						
					 | 
					
						2015-07-27 22:57:22 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							2060935cdb
							
						
					 | 
					
						
						
							
							* Remove explicit bytes type in doc.from_bytes, to accept bytearray
						
						
						
						
						
					 | 
					
						2015-07-24 04:54:13 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							0bb839d299
							
						
					 | 
					
						
						
							
							* Fix string coercion for Python 3
						
						
						
						
						
					 | 
					
						2015-07-24 03:49:30 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							a0e36e8efc
							
						
					 | 
					
						
						
							
							* Add working to/from bytes API to Doc
						
						
						
						
						
					 | 
					
						2015-07-23 01:14:45 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							4d61239eac
							
						
					 | 
					
						
						
							
							* Reorganize the serialization functions on Doc
						
						
						
						
						
					 | 
					
						2015-07-22 04:53:01 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							8743a8c084
							
						
					 | 
					
						
						
							
							* Update Doc serialization for new Packer interface
						
						
						
						
						
					 | 
					
						2015-07-20 01:38:04 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							317cbbc015
							
						
					 | 
					
						
						
							
							* Serialization round trip now working with decent API, but with rough spots in the organisation and requiring vocabulary to be fixed ahead of time.
						
						
						
						
						
					 | 
					
						2015-07-19 15:18:17 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							6b13e7227c
							
						
					 | 
					
						
						
							
							* Remove duplicate get_lex_attr method from doc.pyx
						
						
						
						
						
					 | 
					
						2015-07-18 22:46:07 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							ced59ab9ea
							
						
					 | 
					
						
						
							
							* Make minor efficiency improvement in Doc.__iter__
						
						
						
						
						
					 | 
					
						2015-07-18 04:10:53 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							cf0c788892
							
						
					 | 
					
						
						
							
							* Tests passing on round-trip pack/unpack on basic example
						
						
						
						
						
					 | 
					
						2015-07-17 21:20:48 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							dfdf19f6a9
							
						
					 | 
					
						
						
							
							* Draft a from_orth method for Doc
						
						
						
						
						
					 | 
					
						2015-07-17 16:39:54 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							db9dfd2e23
							
						
					 | 
					
						
						
							
							* Major refactor of serialization. Nearly complete now.
						
						
						
						
						
					 | 
					
						2015-07-17 01:27:54 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							a6f401580d
							
						
					 | 
					
						
						
							
							* Add from_array function to Doc.
						
						
						
						
						
					 | 
					
						2015-07-16 17:46:11 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							e2133d990e
							
						
					 | 
					
						
						
							
							* Move serialization functionality out into a Serializer object
						
						
						
						
						
					 | 
					
						2015-07-16 11:21:44 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							01fab6bb90
							
						
					 | 
					
						
						
							
							* Improve de/serialize functions
						
						
						
						
						
					 | 
					
						2015-07-16 01:26:35 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							0e07c1ed2a
							
						
					 | 
					
						
						
							
							* draft de/serialization functions in doc.pyx
						
						
						
						
						
					 | 
					
						2015-07-16 01:16:33 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							9d956b07e9
							
						
					 | 
					
						
						
							
							* Fix import of attrs in doc.pyx, and update the get_token_attr function.
						
						
						
						
						
					 | 
					
						2015-07-16 01:15:34 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							935ac53ee3
							
						
					 | 
					
						
						
							
							* Extend count_by method
						
						
						
						
						
					 | 
					
						2015-07-14 03:20:09 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							81aa4e6dcc
							
						
					 | 
					
						
						
							
							* Go back to having token reference doc, instead of complicated gymnastics. Rename the attr 'doc', to expose it in the API
						
						
						
						
						
					 | 
					
						2015-07-14 00:10:11 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							8214b74eec
							
						
					 | 
					
						
						
							
							* Restore _py_tokens cache, to handle orphan tokens.
						
						
						
						
						
					 | 
					
						2015-07-13 22:28:10 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							67641f3b58
							
						
					 | 
					
						
						
							
							* Refactor tokenizer, to set the 'spacy' field on TokenC instead of passing a string
						
						
						
						
						
					 | 
					
						2015-07-13 21:46:02 +02:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Matthew Honnibal
							
						 
					 | 
					
						
						
						
						
							
						
						
							3ea8756c24
							
						
					 | 
					
						
						
							
							* Add spacy/tokens/doc.pyx, for Doc class in its own file
						
						
						
						
						
					 | 
					
						2015-07-13 19:58:26 +02:00 | 
					
					
						
						
							
							
							
						
					 |