| 
							
							
								 Matthew Honnibal | 88095666dc | * Remove Lexeme struct, preparing to rename Word to Lexeme. | 2014-08-24 19:24:42 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | ce59526011 | * Add Word classes | 2014-08-24 18:14:08 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 3b793cf4f7 | * Tests passing for new Word object version | 2014-08-24 18:13:53 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 9815c7649e | * Refactor around Word objects, adapting tests. Tests passing, except for string views. | 2014-08-23 19:55:06 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 4f01df9152 | * Moving to Word objects in place of the Lexeme struct. | 2014-08-22 17:32:16 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 782806df08 | * Moving to Word objects in place of the Lexeme struct. | 2014-08-22 17:28:23 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 47fbd0475a | * Replace the use of dense_hash_map with Python dict | 2014-08-22 17:13:09 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 6f83dca218 | * Fix import for ptb tokenization test | 2014-08-22 17:05:44 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | e289896603 | * Fix ptb3 module | 2014-08-22 16:36:17 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | a22101404a | * Move en_ptb data | 2014-08-22 04:28:51 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 89d6faa9c9 | * Move en_ptb to ptb3 | 2014-08-22 04:24:05 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 4bcdd6d31c | * Further improvements to spacy docs, tweaks to code. | 2014-08-22 04:20:24 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 4eb9c2b30f | * Add overview doc | 2014-08-22 03:38:05 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 07ecf5d2f4 | * Fixed group_by, removed idea of general attr_of function. | 2014-08-22 00:02:37 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 811b7a6b91 | * Struggling with arbitrary attr access... | 2014-08-21 23:49:14 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 314658b31c | * Improve module docstring | 2014-08-21 18:42:47 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 8bcd07dbae | * More docs work | 2014-08-21 17:05:28 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | d10993f41a | * More docs work | 2014-08-21 16:37:13 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | d5403a6fe3 | * More docs work | 2014-08-21 16:37:06 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 248cbb6d07 | * Update doc strings | 2014-08-21 03:29:15 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | cbda38e2d9 | * Improving docs | 2014-08-20 21:09:39 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | cab7f63fc2 | * Temporarily remove sparsehash requirement | 2014-08-20 17:12:19 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | c289867d1f | * Add draft sphinx docs files | 2014-08-20 17:05:18 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | bebfd7940d | * Upd gitignore | 2014-08-20 17:04:33 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 76afbd7d69 | * Remove compiled orthography file | 2014-08-20 17:04:07 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | f39dcb1d89 | * Add orthography | 2014-08-20 17:03:44 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | d42cdbb446 | * Compile orthography.latin.pyx | 2014-08-20 17:03:19 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 0c4c47b074 | * Add docs requirements | 2014-08-20 17:02:54 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | bd51742fbd | * Remove MurmurHash headers | 2014-08-20 17:02:47 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 416a324bcf | * Add documentation building to fabfile | 2014-08-20 17:02:32 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | a78ad4152d | * Broken version being refactored for docs | 2014-08-20 13:39:39 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 5fddb8d165 | * Working refactor, with updated data model for Lexemes | 2014-08-19 04:21:20 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 3379d7a571 | * Reforming data model for lexemes | 2014-08-19 02:40:37 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | e091b6a241 | * Base master on temp branch | 2014-08-18 23:29:21 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 85df22c379 | * Remove murmurhash from requirements | 2014-08-18 23:26:20 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | ab9b0daabf | * Whitespace | 2014-08-18 23:21:49 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | a2047fa5aa | * Add 's suffix to tokenization table | 2014-08-18 23:21:37 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 1b71cbfe28 | * Roll back to using unicode, and never Py_UNICODE. No dependence on murmurhash either. | 2014-08-18 20:48:48 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | bbf9a2c944 | * Working version that uses arrays for chunks, which should be more memory efficient | 2014-08-18 20:23:54 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 8d3f6082be | * Working version, adding improvements | 2014-08-18 19:59:59 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 01469b0888 | * Refactor spacy so that chunks return arrays of lexemes, so that there is properly one lexeme per word. | 2014-08-18 19:14:00 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | b94c9b72c9 | * WordTree in use. Need to reform the way chunks are handled. Should be properly one Lexeme per word, with split points being the things that are cached. | 2014-08-16 20:10:22 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 34b68a18ab | * Progress to getting WordTree working. Tests pass, but so far it's slower. | 2014-08-16 19:59:38 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 865cacfaf7 | * Remove dependence on murmurhash | 2014-08-16 17:37:09 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 515d41d325 | * Restore string saving to spacy | 2014-08-16 16:09:24 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 36073b89fe | * Restore unicode, work on improving string storage. | 2014-08-16 14:35:34 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | a225ca5b0d | * Refactoring tokenizer | 2014-08-16 03:22:03 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 213a440ffc | * Add string decode and encode helpers to string_tools | 2014-08-15 23:57:27 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 7fd9b2f1f8 | * Add murmurhash to setup while we figure out cython includes | 2014-08-15 23:56:57 +02:00 |  | 
			
				
					| 
							
							
								 Matthew Honnibal | 3ada25b92d | * Shifting to WordTree instead of dense_hash_map for storage. | 2014-08-15 23:06:46 +02:00 |  |