spaCy/website/api
Ines Montani f37863093a 💫 Replace ujson, msgpack and dill/pickle/cloudpickle with srsly (#3003)
Remove hacks and wrappers, keep code in sync across our libraries and move spaCy a few steps closer to only depending on packages with binary wheels 🎉

See here: https://github.com/explosion/srsly

    Serialization is hard, especially across Python versions and multiple platforms. After dealing with many subtle bugs over the years (encodings, locales, large files) our libraries like spaCy and Prodigy have steadily grown a number of utility functions to wrap the multiple serialization formats we need to support (especially json, msgpack and pickle). These wrapping functions ended up duplicated across our codebases, so we wanted to put them in one place.

    At the same time, we noticed that having a lot of small dependencies was making maintainence harder, and making installation slower. To solve this, we've made srsly standalone, by including the component packages directly within it. This way we can provide all the serialization utilities we need in a single binary wheel.

    srsly currently includes forks of the following packages:

        ujson
        msgpack
        msgpack-numpy
        cloudpickle



* WIP: replace json/ujson with srsly

* Replace ujson in examples

Use regular json instead of srsly to make code easier to read and follow

* Update requirements

* Fix imports

* Fix typos

* Replace msgpack with srsly

* Fix warning
2018-12-03 01:28:22 +01:00
..
_annotation 💫 Port master changes over to develop (#2979) 2018-11-29 16:30:29 +01:00
_cython 💫 Document Cython API (#2433) 2018-06-11 17:47:46 +02:00
_top-level 💫 Replace ujson, msgpack and dill/pickle/cloudpickle with srsly (#3003) 2018-12-03 01:28:22 +01:00
_data.json 💫 Document Cython API (#2433) 2018-06-11 17:47:46 +02:00
annotation.jade Update and simplify other annotation scheme data 2017-11-05 16:09:48 +01:00
cli.jade 💫 New JSON helpers, training data internals & CLI rewrite (#2932) 2018-11-30 20:16:14 +01:00
cython-classes.jade 💫 Document Cython API (#2433) 2018-06-11 17:47:46 +02:00
cython-structs.jade 💫 Document Cython API (#2433) 2018-06-11 17:47:46 +02:00
cython.jade 💫 Document Cython API (#2433) 2018-06-11 17:47:46 +02:00
dependencyparser.jade Add notes on pipe template inheritance in docs 2017-10-26 12:57:32 +02:00
doc.jade 💫 Port master changes over to develop (#2979) 2018-11-29 16:30:29 +01:00
entityrecognizer.jade Add notes on pipe template inheritance in docs 2017-10-26 12:57:32 +02:00
goldcorpus.jade Port over docs changes [ci skip] 2018-03-24 17:12:48 +01:00
goldparse.jade Update goldparse.jade 2018-01-03 17:25:21 +05:30
index.jade 💫 Document Cython API (#2433) 2018-06-11 17:47:46 +02:00
language.jade 💫 Port master changes over to develop (#2979) 2018-11-29 16:30:29 +01:00
lemmatizer.jade Document lemmatizer 2017-10-24 16:00:56 +02:00
lexeme.jade 💫 Port master changes over to develop (#2979) 2018-11-29 16:30:29 +01:00
matcher.jade Port over docs changes [ci skip] 2018-03-24 17:12:48 +01:00
phrasematcher.jade Fixes typo in PhraseMatcher API docs 2018-01-11 17:35:59 +01:00
pipe.jade Port over docs changes [ci skip] 2018-03-24 17:12:48 +01:00
span.jade 💫 Port master changes over to develop (#2979) 2018-11-29 16:30:29 +01:00
stringstore.jade Update API documentation 2017-10-03 14:27:22 +02:00
tagger.jade Add notes on pipe template inheritance in docs 2017-10-26 12:57:32 +02:00
textcategorizer.jade Don't document the tensorizer for now 2017-11-01 19:49:04 +01:00
token.jade 💫 Port master changes over to develop (#2979) 2018-11-29 16:30:29 +01:00
tokenizer.jade Update API documentation 2017-10-03 14:27:22 +02:00
top-level.jade Move CLI docs to own page 2017-10-30 19:39:26 +01:00
vectors.jade Document Vectors.resize() and update v2 incompatibilities (resolves #1514) 2017-11-08 17:11:11 +01:00
vocab.jade Change clear_vectors to reset_vectors (resolves #1516) 2017-11-08 18:11:23 +01:00