explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-11-04 01:48:04 +03:00
Code Issues Packages Projects Releases Wiki Activity
15,970 Commits 75 Branches 180 Tags 267 MiB
649c146e2c
Commit Graph

15970 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Matthew Honnibal
cc3971ce5c * Fix error in tokenization rules 2014-07-07 05:09:34 +02:00
Matthew Honnibal
997551241f * Upd ptb tokenization rules 2014-07-07 05:09:22 +02:00
Matthew Honnibal
dc20500920 * Remove cpp files 2014-07-07 05:09:05 +02:00
Matthew Honnibal
25849fc926 * Generalize tokenization rules to capitals 2014-07-07 05:07:21 +02:00
Matthew Honnibal
df0458001d * Begin work on full PTB-compatible English tokenization 2014-07-07 04:29:24 +02:00
Matthew Honnibal
0c1be7effe * Compile string_tools module 2014-07-07 04:24:00 +02:00
Matthew Honnibal
e4263a241a * Tests passing for reorganized version 2014-07-07 04:23:46 +02:00
Matthew Honnibal
12f8a0e3c2 * Tests passing for reorganized version 2014-07-07 04:23:20 +02:00
Matthew Honnibal
d5bef02c72 * Reorganized, moving language-independent stuff to spacy. The functions in spacy ask for the dictionaries and split function on input, but the language-specific modules are curried versions that use the globals 2014-07-07 04:21:06 +02:00
Matthew Honnibal
a62c38e1ef * Working tokenization. en doesn't match PTB perfectly. Need to reorganize before adding more schemes. 2014-07-07 01:15:59 +02:00
Matthew Honnibal
4e79446dc2 * Reading in tokenization rules correctly. Passing tests. 2014-07-07 00:02:55 +02:00
Matthew Honnibal
9bef797afe * Rejigged tests. Working possessives, but no other contractions 2014-07-06 20:02:00 +02:00
Matthew Honnibal
72159e7011 * Fixes to tokenization. Now segment sequences of the same punctuation. 2014-07-06 19:28:42 +02:00
Matthew Honnibal
e98e97d483 * Possessive test passing 2014-07-06 18:35:55 +02:00
Matthew Honnibal
556f6a18ca * Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc. 2014-07-05 20:51:42 +02:00
Matthew Honnibal
5c1705d5be * Add ext stuff, while I figure out how to get it working as a different project 2014-07-05 20:51:04 +02:00
Matthew Honnibal
81f6491cb4 * Add gitignore 2014-07-05 20:50:01 +02:00
Matthew Honnibal
0f923fa37d * Add initial docs stuff 2014-07-05 20:49:46 +02:00
Matthew Honnibal
ca7045f3f2 * Add build/setup stuff 2014-07-05 20:49:34 +02:00
honnibal
e3fad681c5 Initial commit 2014-07-04 01:15:40 +10:00