89 Commits

Author	SHA1	Message	Date
Matthew Honnibal	541c62c126	* Remove import of removed read_docparse_file function	2015-05-24 20:05:13 +02:00
Matthew Honnibal	bfeb29ebd1	* Tmp commit	2015-05-24 02:50:14 +02:00
Matthew Honnibal	f35503018e	* Tmp commit of train, while I move to better alignment in gold standard	2015-05-23 17:21:25 +02:00
Matthew Honnibal	3d6b3fc6fb	* Restore shuffling, and remove print statements from train.py	2015-05-12 20:27:56 +02:00
Matthew Honnibal	e167355505	* Use JSON docs for training and evaluation. Currently a bug that is costing 0.6 acc	2015-05-12 20:27:56 +02:00
Jordan Suchow	3a8d9b37a6	Remove trailing whitespace	2015-04-19 13:01:38 -07:00
Jordan Suchow	5f0f940a1f	Remove unused imports	2015-04-19 01:05:22 -07:00
Matthew Honnibal	adcad4f353	* Clean up train.py	2015-04-15 06:02:04 +02:00
Matthew Honnibal	a6ac92f077	* Respect the model_dir input parameter to train.py	2015-04-08 22:48:26 +02:00
Matthew Honnibal	e775e05313	* Use merge_mwe=False in evaluation in train.py	2015-04-08 00:35:19 +02:00
Matthew Honnibal	cd054c6c9f	* Remove stray print statement	2015-03-27 15:20:42 +01:00
Matthew Honnibal	ee385b439a	* Ensure StringStore is dumped during training	2015-03-26 16:44:47 +01:00
Matthew Honnibal	e854ba0a13	* Remove support for force_gold flag from GreedyParser, since it's not so useful, and it's clutter	2015-03-26 16:44:47 +01:00
Matthew Honnibal	221f43c370	* Ensure better separation between score printing and training in train.py	2015-03-26 16:44:46 +01:00
Matthew Honnibal	6d49f8717b	* Move scoring away from training. Does not support scoring on gold preproc.	2015-03-26 16:44:46 +01:00
Matthew Honnibal	52429625f0	* Add write_parses function	2015-03-26 16:44:46 +01:00
Matthew Honnibal	0c91dd9e15	* Re-enable entity training	2015-03-26 16:44:46 +01:00
Matthew Honnibal	9061bbaf61	* Move to fixing up ent_strings and dep_strings passing	2015-03-26 16:44:45 +01:00
Matthew Honnibal	8f7eeb1c2d	* Add verbose flag for Scorer, for debugging, and fix ent_strings bug	2015-03-26 16:44:45 +01:00
Matthew Honnibal	8057a95f20	* NER seems to be working, scoring 69 F. Need to add decision-history features --- currently only use current word, 2 words context. Need refactoring.	2015-03-26 16:44:44 +01:00
Matthew Honnibal	ae235e07b9	* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc.	2015-03-26 16:44:44 +01:00
Matthew Honnibal	4539c70542	* Work on updating train script for named entity recognition	2015-03-26 16:44:44 +01:00
Matthew Honnibal	7a1a333f04	* Allow gold tokenization training, for debugging	2015-03-26 16:44:43 +01:00
Matthew Honnibal	f5f15a1ef2	* Tmp commit	2015-03-26 16:44:43 +01:00
Matthew Honnibal	34215de61b	* Upd train script, moving lots of functionality to new GoldParse class	2015-03-26 16:44:42 +01:00
Matthew Honnibal	8715101239	* Merge changes from stash	2015-03-26 16:44:42 +01:00
Matthew Honnibal	3a302ae6f2	* Merge train.py	2015-03-26 16:44:41 +01:00
Matthew Honnibal	053814ffc8	* Report LAS in train script	2015-03-03 04:35:11 -05:00
Matthew Honnibal	1019939c7a	* Whitespace	2015-02-24 23:03:02 -05:00
Matthew Honnibal	ee33be31dd	* Fix parser training script	2015-02-09 03:57:56 -05:00
Matthew Honnibal	27986d7f5c	* Fix standard conll file reading. Script needs refactoring.	2015-02-02 23:02:48 +11:00
Matthew Honnibal	543fe5a280	* Comment training function back in	2015-01-31 16:37:57 +11:00
Matthew Honnibal	df749f257d	* Upd train script	2015-01-31 13:44:37 +11:00
Matthew Honnibal	ca7577d8a9	* Allow parsers and taggers to be trained on text without gold pre-processing.	2015-01-30 16:36:24 +11:00
Matthew Honnibal	b38093237e	* More debug prints	2015-01-30 11:15:54 +11:00
Matthew Honnibal	11ed65b93c	* Work on alignment, for evaluation with non-gold preprocessing	2015-01-30 10:31:03 +11:00
Matthew Honnibal	b4348ce1c3	* Messily use unsegmented sentences to train the parser	2015-01-29 04:21:13 +11:00
Matthew Honnibal	72ff9c5082	* Update parser training script for tweaked parser API	2015-01-25 02:20:49 +11:00
Matthew Honnibal	61904e590f	* Add parser training script	2015-01-10 04:53:26 +11:00