We have a public roadmap that lists what has been done, what we're currently doing, and what needs doing. There's also an icebox with high level ideas that need framing. You're welcome to pick anything that takes your fancy and that you deem important. Feel free to open a discussion if you want to clarify a topic and/or want to be formally assigned a task in the board.
Of course, you're welcome to propose and contribute new ideas. We encourage you to open a discussion so that we can align on the work to be done. It's generally a good idea to have a quick discussion before opening a pull request that is potentially out-of-scope.
The typical workflow for contributing to River is:
- Fork the
mainbranch from the GitHub repository. - Clone your fork locally.
- Commit changes.
- Push the changes to your fork.
- Send a pull request from your fork back to the original
mainbranch.
Start by cloning the repository:
git clone https://github.com/online-ml/riverNext, you'll need a Python environment. A nice way to manage your Python versions is to use pyenv, which can installed here. Once you have pyenv, you can install the latest Python version River supports:
pyenv install -v $(cat .python-version)You need a Rust compiler you can install it by following this link. You'll also need Poetry:
curl -sSL https://install.python-poetry.org | python3 -Now you're set to install River and activate the virtual environment:
poetry install
poetry shellFinally, install the pre-commit push hooks. This will run some code quality checks every time you push to GitHub.
pre-commit install --hook-type pre-pushYou can optionally run pre-commit at any time as so:
pre-commit run --all-filesYou're now ready to make some changes. We strongly recommend that you to check out River's source code for inspiration before getting into the thick of it. How you make the changes is up to you of course. However we can give you some pointers as to how to test your changes. Here is an example workflow that works for most cases:
- Create and open a Jupyter notebook at the root of the directory.
- Add the following in the code cell:
%load_ext autoreload
%autoreload 2- The previous code will automatically reimport River for you whenever you make changes.
- For instance, if a change is made to
linear_model.LinearRegression, then rerunning the following code doesn't require rebooting the notebook:
from river import linear_model
model = linear_model.LinearRegression()- Pick a base class from the
basemodule. - Check if any of the mixin classes from the
basemodule apply to your implementation. - Make you've implemented the required methods, with the following exceptions:
- Stateless transformers do not require a
learn_onemethod. - In case of a classifier, the
predict_oneis implemented by default, but can be overridden.
- Stateless transformers do not require a
- Add type hints to the parameters of the
__init__method. - If possible provide a default value for each parameter. If, for whatever reason, no good default exists, then implement the
_unit_test_paramsmethod. This is a private method that is meant to be used for testing. - Write a comprehensive docstring with example usage. Try to have empathy for new users when you do this.
- Check that the class you have implemented is imported in the
__init__.pyfile of the module it belongs to. - When you're done, run the
utils.check_estimatorfunction on your class and check that no exceptions are raised.
If you're adding a class or a function, then you'll need to add a docstring. We follow the Google docstring convention, so please do too.
To build the documentation, you need to install some extra dependencies:
poetry install --with docs
pip install git+https://github.com/MaxHalford/yampFrom the root of the repository, you can then run the make livedoc command to take a look at the documentation in your browser. This will run a custom script which parses all the docstrings and generate MarkDown files that MkDocs can render.
All classes and function are automatically picked up and added to the documentation. The only thing you have to do is to add an entry to the relevant file in the docs/releases directory.
poetry installUnit tests
These tests absolutely have to pass.
pytestStatic typing
These tests absolutely have to pass.
mypy riverWeb dependent tests
This involves tests that need an internet connection, such as those in the datasets module which requires downloading some files. In most cases you probably don't need to run these.
pytest -m webNotebook tests
You don't have to worry too much about these, as we only check them before each release. If you break them because you changed some code, then it's probably because the notebooks have to be modified, not the other way around.
make execute-notebooks- Checkout
main - Run
make execute-notebooksjust to be safe - Run the benchmarks
- Bump the version in
river/__version__.py - Bump the version in
pyproject.toml - Tag and date the
docs/releases/unreleased.mdfile - Commit and push
- Wait for CI to run the unit tests
- Push the tag:
RIVER_VERSION=$(python -c "import river; print(river.__version__)")
echo $RIVER_VERSIONgit tag $RIVER_VERSION
git push origin $RIVER_VERSION- Wait for CI to ship to PyPI and publish the new docs
- Create a release:
RELEASE_NOTES=$(cat <<-END
- https://riverml.xyz/${RIVER_VERSION}/releases/${RIVER_VERSION}/
- https://pypi.org/project/river/${RIVER_VERSION}/
END
)
brew update && brew install gh
gh release create $RIVER_VERSION --notes $RELEASE_NOTES- Pyodide needs to be told there is a new release. This can done by updating
packages/riverin online-ml/pyodide