mirror of
https://github.com/explosion/spaCy.git
synced 2024-12-28 19:06:33 +03:00
5e297aa20e
* Add `TrainablePipe.{distill,get_teacher_student_loss}`
This change adds two methods:
- `TrainablePipe::distill` which performs a training step of a
student pipe on a teacher pipe, giving a batch of `Doc`s.
- `TrainablePipe::get_teacher_student_loss` computes the loss
of a student relative to the teacher.
The `distill` or `get_teacher_student_loss` methods are also implemented
in the tagger, edit tree lemmatizer, and parser pipes, to enable
distillation in those pipes and as an example for other pipes.
* Fix stray `Beam` import
* Fix incorrect import
* Apply suggestions from code review
Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
* TrainablePipe.distill: use `Iterable[Example]`
* Add Pipe.is_distillable method
* Add `validate_distillation_examples`
This first calls `validate_examples` and then checks that the
student/teacher tokens are the same.
* Update distill documentation
* Add distill documentation for all pipes that support distillation
* Fix incorrect identifier
* Apply suggestions from code review
Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
* Add comment to explain `is_distillable`
Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
|
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_analysis.py | ||
| test_annotates_on_update.py | ||
| test_attributeruler.py | ||
| test_edit_tree_lemmatizer.py | ||
| test_entity_linker.py | ||
| test_entity_ruler.py | ||
| test_functions.py | ||
| test_initialize.py | ||
| test_lemmatizer.py | ||
| test_models.py | ||
| test_morphologizer.py | ||
| test_pipe_factories.py | ||
| test_pipe_methods.py | ||
| test_sentencizer.py | ||
| test_senter.py | ||
| test_span_ruler.py | ||
| test_spancat.py | ||
| test_tagger.py | ||
| test_textcat.py | ||
| test_tok2vec.py | ||