2018-12-03 04:41:05 +03:00
|
|
|
# Our libraries
|
💫 Use Blis for matrix multiplications (#2966)
Our epic matrix multiplication odyssey is drawing to a close...
I've now finally got the Blis linear algebra routines in a self-contained Python package, with wheels for Windows, Linux and OSX. The only missing platform at the moment is Windows Python 2.7. The result is at https://github.com/explosion/cython-blis
Thinc v7.0.0 will make the change to Blis. I've put a Thinc v7.0.0.dev0 up on PyPi so that we can test these changes with the CI, and even get them out to spacy-nightly, before Thinc v7.0.0 is released. This PR also updates the other dependencies to be in line with the current versions master is using. I've also resolved the msgpack deprecation problems, and gotten spaCy and Thinc up to date with the latest Cython.
The point of switching to Blis is to have control of how our matrix multiplications are executed across platforms. When we were using numpy for this, a different library would be used on pip and conda, OSX would use Accelerate, etc. This would open up different bugs and performance problems, especially when multi-threading was introduced.
With the change to Blis, we now strictly single-thread the matrix multiplications. This will make it much easier to use multiprocessing to parallelise the runtime, since we won't have nested parallelism problems to deal with.
* Use blis
* Use -2 arg to Cython
* Update dependencies
* Fix requirements
* Update setup dependencies
* Fix requirement typo
* Fix msgpack errors
* Remove Python27 test from Appveyor, until Blis works there
* Auto-format setup.py
* Fix murmurhash version
2018-11-27 02:44:04 +03:00
|
|
|
cymem>=2.0.2,<2.1.0
|
2019-09-28 23:23:24 +03:00
|
|
|
preshed>=3.0.2,<3.1.0
|
2020-08-07 15:41:35 +03:00
|
|
|
thinc>=8.0.0a23,<8.0.0a30
|
2019-08-25 14:50:47 +03:00
|
|
|
blis>=0.4.0,<0.5.0
|
2020-01-29 19:06:46 +03:00
|
|
|
ml_datasets>=0.1.1
|
💫 Use Blis for matrix multiplications (#2966)
Our epic matrix multiplication odyssey is drawing to a close...
I've now finally got the Blis linear algebra routines in a self-contained Python package, with wheels for Windows, Linux and OSX. The only missing platform at the moment is Windows Python 2.7. The result is at https://github.com/explosion/cython-blis
Thinc v7.0.0 will make the change to Blis. I've put a Thinc v7.0.0.dev0 up on PyPi so that we can test these changes with the CI, and even get them out to spacy-nightly, before Thinc v7.0.0 is released. This PR also updates the other dependencies to be in line with the current versions master is using. I've also resolved the msgpack deprecation problems, and gotten spaCy and Thinc up to date with the latest Cython.
The point of switching to Blis is to have control of how our matrix multiplications are executed across platforms. When we were using numpy for this, a different library would be used on pip and conda, OSX would use Accelerate, etc. This would open up different bugs and performance problems, especially when multi-threading was introduced.
With the change to Blis, we now strictly single-thread the matrix multiplications. This will make it much easier to use multiprocessing to parallelise the runtime, since we won't have nested parallelism problems to deal with.
* Use blis
* Use -2 arg to Cython
* Update dependencies
* Fix requirements
* Update setup dependencies
* Fix requirement typo
* Fix msgpack errors
* Remove Python27 test from Appveyor, until Blis works there
* Auto-format setup.py
* Fix murmurhash version
2018-11-27 02:44:04 +03:00
|
|
|
murmurhash>=0.28.0,<1.1.0
|
2020-07-22 14:42:59 +03:00
|
|
|
wasabi>=0.7.1,<1.1.0
|
2020-06-22 12:57:46 +03:00
|
|
|
srsly>=2.1.0,<3.0.0
|
2019-11-07 13:45:22 +03:00
|
|
|
catalogue>=0.0.7,<1.1.0
|
2020-07-01 21:20:04 +03:00
|
|
|
typer>=0.3.0,<0.4.0
|
2018-12-03 04:41:05 +03:00
|
|
|
# Third party dependencies
|
|
|
|
|
numpy>=1.15.0
|
|
|
|
|
requests>=2.13.0,<3.0.0
|
2019-12-16 15:12:19 +03:00
|
|
|
tqdm>=4.38.0,<5.0.0
|
2020-02-25 17:46:39 +03:00
|
|
|
pydantic>=1.3.0,<2.0.0
|
2020-07-06 18:39:31 +03:00
|
|
|
pytokenizations
|
2020-07-26 13:15:00 +03:00
|
|
|
smart_open>=2.0.0,<3.0.0
|
2020-05-30 15:59:55 +03:00
|
|
|
# Official Python utilities
|
|
|
|
|
setuptools
|
|
|
|
|
packaging
|
|
|
|
|
importlib_metadata>=0.20; python_version < "3.8"
|
💫 Tidy up and auto-format .py files (#2983)
<!--- Provide a general summary of your changes in the title. -->
## Description
- [x] Use [`black`](https://github.com/ambv/black) to auto-format all `.py` files.
- [x] Update flake8 config to exclude very large files (lemmatization tables etc.)
- [x] Update code to be compatible with flake8 rules
- [x] Fix various small bugs, inconsistencies and messy stuff in the language data
- [x] Update docs to explain new code style (`black`, `flake8`, when to use `# fmt: off` and `# fmt: on` and what `# noqa` means)
Once #2932 is merged, which auto-formats and tidies up the CLI, we'll be able to run `flake8 spacy` actually get meaningful results.
At the moment, the code style and linting isn't applied automatically, but I'm hoping that the new [GitHub Actions](https://github.com/features/actions) will let us auto-format pull requests and post comments with relevant linting information.
### Types of change
enhancement, code style
## Checklist
<!--- Before you submit the PR, go over this checklist and make sure you can
tick off all the boxes. [] -> [x] -->
- [x] I have submitted the spaCy Contributor Agreement.
- [x] I ran the tests, and all new and existing tests passed.
- [x] My changes don't require a change to the documentation, or if they do, I've added all required information.
2018-11-30 19:03:03 +03:00
|
|
|
# Development dependencies
|
2018-12-01 06:28:51 +03:00
|
|
|
cython>=0.25
|
2019-10-01 22:36:04 +03:00
|
|
|
pytest>=4.6.5
|
2018-07-25 00:38:44 +03:00
|
|
|
pytest-timeout>=1.3.0,<2.0.0
|
2017-05-20 14:54:31 +03:00
|
|
|
mock>=2.0.0,<3.0.0
|
💫 Tidy up and auto-format .py files (#2983)
<!--- Provide a general summary of your changes in the title. -->
## Description
- [x] Use [`black`](https://github.com/ambv/black) to auto-format all `.py` files.
- [x] Update flake8 config to exclude very large files (lemmatization tables etc.)
- [x] Update code to be compatible with flake8 rules
- [x] Fix various small bugs, inconsistencies and messy stuff in the language data
- [x] Update docs to explain new code style (`black`, `flake8`, when to use `# fmt: off` and `# fmt: on` and what `# noqa` means)
Once #2932 is merged, which auto-formats and tidies up the CLI, we'll be able to run `flake8 spacy` actually get meaningful results.
At the moment, the code style and linting isn't applied automatically, but I'm hoping that the new [GitHub Actions](https://github.com/features/actions) will let us auto-format pull requests and post comments with relevant linting information.
### Types of change
enhancement, code style
## Checklist
<!--- Before you submit the PR, go over this checklist and make sure you can
tick off all the boxes. [] -> [x] -->
- [x] I have submitted the spaCy Contributor Agreement.
- [x] I ran the tests, and all new and existing tests passed.
- [x] My changes don't require a change to the documentation, or if they do, I've added all required information.
2018-11-30 19:03:03 +03:00
|
|
|
flake8>=3.5.0,<3.6.0
|
