Raphael Mitsch c0fd8a2e71 find-threshold: CLI command for multi-label classifier threshold tuning (#11280) ... * Add foundation for find-threshold CLI functionality. * Finish first draft for find-threshold. * Add tests. * Revert adjusted import statements. * Fix mypy errors. * Fix imports. * Harmonize arguments with spacy evaluate command. * Generalize component and threshold handling. Harmonize arguments with 'spacy evaluate' CLI. * Fix Spancat test. * Add beta parameter to Scorer and PRFScore. * Make beta a component scorer setting. * Remove beta. * Update nlp.config (workaround). * Reload pipeline on threshold change. Adjust tests. Remove confection reference. * Remove assumption of component being a Pipe object or having a .cfg attribute. * Adjust test output and reference values. * Remove beta references. Delete universe.json. * Reverting unnecessary changes. Removing unused default values. Renaming variables in find-cli tests. * Update spacy/cli/find_threshold.py Co-authored-by: Adriane Boyd <adrianeboyd@gmail.com> * Remove adding labels in tests. * Remove unused error * Undo changes to PRFScorer * Change default value for n_trials. Log table iteratively. * Add warnings for pointless applications of find_threshold(). * Fix imports. * Adjust type check of TextCategorizer to exclude subclasses. * Change check of if there's only one unique value in scores. * Update spacy/cli/find_threshold.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Incorporate feedback. * Fix test issue. Update docstring. * Update docs & docstring. * Update spacy/tests/test_cli.py Co-authored-by: Adriane Boyd <adrianeboyd@gmail.com> * Add examples to docs. Rename _nlp to nlp in tests. * Update spacy/cli/find_threshold.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Update spacy/cli/find_threshold.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> Co-authored-by: Adriane Boyd <adrianeboyd@gmail.com> Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>		2022-11-25 11:44:55 +01:00
..
project	prevent rewriting an already raw URL (#11810)	2022-11-15 14:15:00 +01:00
templates	Add transformer recommendation for ca (#11819)	2022-11-18 08:15:27 +01:00
__init__.py	find-threshold: CLI command for multi-label classifier threshold tuning (#11280)	2022-11-25 11:44:55 +01:00
_util.py	debug data Spancat Table Improvements (#11504)	2022-09-28 17:16:05 +02:00
assemble.py	Tidy up with flake8: imports, comparisons, etc.	2021-06-28 12:08:15 +02:00
convert.py	Minor fixes to convert CLI (#9465)	2021-10-14 18:37:34 +02:00
debug_config.py	Fix references to config file in the docs & UX (#9961)	2022-01-04 14:31:26 +01:00
debug_data.py	debug data Spancat Table Improvements (#11504)	2022-09-28 17:16:05 +02:00
debug_diff.py	Add debug diff command in spaCy CLI (#10502)	2022-04-07 10:48:45 +02:00
debug_model.py	Tidy up with flake8: imports, comparisons, etc.	2021-06-28 12:08:15 +02:00
download.py	Add a way to get the URL to download a pipeline to the CLI (#11175)	2022-09-02 11:58:21 +02:00
evaluate.py	🏷 Add Mypy check to CI and ignore all existing Mypy errors (#9167)	2021-10-14 15:21:40 +02:00
find_threshold.py	find-threshold: CLI command for multi-label classifier threshold tuning (#11280)	2022-11-25 11:44:55 +01:00
info.py	Auto-format code with black (#11468)	2022-09-09 11:21:17 +02:00
init_config.py	Workaround for Typer optional default values with Python calls (#10788)	2022-06-17 12:15:36 +02:00
init_pipeline.py	Add support for floret vectors (#8909)	2021-10-27 14:08:31 +02:00
package.py	Allow overriding spacy_version in spacy package meta (#11552)	2022-09-29 10:44:06 +02:00
pretrain.py	Add parent argument (#11210)	2022-07-26 14:35:18 +02:00
profile.py	🏷 Add Mypy check to CI and ignore all existing Mypy errors (#9167)	2021-10-14 15:21:40 +02:00
train.py	Add docs section for spacy.cli.train.train (#9545)	2021-10-29 10:36:34 +02:00
validate.py	🏷 Add Mypy check to CI and ignore all existing Mypy errors (#9167)	2021-10-14 15:21:40 +02:00