ataraxis-automation

Supports tox-based development automation pipelines used by other Sun (NeuroAI) lab projects.

Detailed Description

Upon installation into a Python environment, this library exposes a command-line interface (automation-cli) used by the tox-based project development automation suite that comes with every Sun Lab project. The CLI abstracts the project's environment manipulation and facilitates mundane development tasks, such as linting, typing, and documenting the source code API.

Features

Supports Windows, Linux, and macOS.
Optimized for runtime speed by using mamba and uv for all environment management tasks.
Compliments the extensive suite of tox environments and tasks used by all Sun lab projects to streamline development.
Apache 2.0 License.

Dependencies

miniforge3. This library expects that a miniforge3 distribution is used to install and export the mamba environment manager to the host-system's PATH variable.
uv. This library uses uv as the main package management engine and expects that uv is available from the system's base Python environment.

For users, all other library dependencies are installed automatically by all supported installation methods. For developers, see the Developers section for information on installing additional development dependencies.

Installation

Source

Note, installation from source is highly discouraged for anyone who is not an active project developer.

Download this repository to the local machine using the preferred method, such as git-cloning. Use one of the stable releases that include precompiled binary and source code distribution (sdist) wheels.
If the downloaded distribution is stored as a compressed archive, unpack it using the appropriate decompression tool.
cd to the root directory of the prepared project distribution.
Run pip install . to install the project and its dependencies.

pip

Use the following command to install the library and all of its dependencies via pip: pip install ataraxis-automation

Usage

Note, the library expects the managed project to use a specific configuration and file structure. If any CLI command terminates with an error, the terminal output describes whether the error is due to an invalid project configuration or file structure.

Automation Command-Line Interface

All library functions designed to be called by end-users are exposed through the 'automation-cli' Command Line Interface (CLI). This CLI is automatically exposed by installing the library into a Python environment.

Automation-CLI

All functions supplied by the library are accessible by calling automation-cli from a Python environment where the library is installed. For example:

Use automation-cli --help to verify that the CLI is available and to see the list of supported commands.
Use automation-cli COMMAND-NAME --help to display additional information about a specific command. For example: automation-cli import-environment --help.

Tox Integration

This library is intended to be used via tox tasks (environments). To use any of the exposed CLI's commands as part of a tox environment, add it to the 'commands' section of the tox.ini:

[testenv:create]
deps =
    ataraxis-automation==8.0.0
commands =
    automation-cli create-environment --environment-name axa_dev --python-version 3.14

See the tox.ini file configuration file for the most up-to-date project development automation suite used in the Sun lab. For the most up-to-date C-extension project automation suite, see the tox.ini file of the ataraxis-time library.

Additional Command Arguments

Note, many sub-commands of the CLI have additional flags and arguments that can be used to further customize their runtime. Consult the API documentation for the list of additional runtime flags for all supported CLI commands.

Supported Checkout Tox Tasks

This library is tightly linked to the environments defined in the tox.ini file configuration file.

Warning! Commands listed in this section may and frequently are modified based on the specific needs of each Sun lab project. This section is not a replacement for studying the tox.ini file for each Sun lab project.

Most commands in this section are designed to be executed together as part of the tox CLI command. These commands are referred to as 'checkout' tasks and must run successfully for any pull request candidate before it is merged into the main branch of each Sun lab project.

Lint

Shell command: tox -e lint

Uses ruff and mypy to statically analyze and, where possible, fix code formatting, typing, and problematic use patterns. As part of its runtime, this task uses automation-cli to remove existing stub (.pyi) files from the source directories, as they sometimes interfere with type-checking.

Example tox.ini section:

[testenv:lint]
description =
    Runs static code formatting, style, and typing checkers. Follows the configuration defined in the pyproject.toml
    file.
dependency_groups = dev
basepython = py312
commands =
    automation-cli purge-stubs
    ruff format
    ruff check --fix ./src
    mypy ./src

Stubs

Shell command: tox -e stubs

Uses stubgen to generate stub (.pyi) files and distributes them via automation-cli to the appropriate levels of the project's source code hierarchy. As part of this process, automation-cli also ensures that there is a 'py.typed' marker file in the highest library directory. This is required for type-checkers like mypy to recognize the library as 'typed' and process it during type-checking tasks.

Example tox.ini section:

[testenv:stubs]
description = Generates the py.typed marker and the .pyi stub files using the project's wheel distribution.
depends = lint
dependency_groups = dev
commands =
    automation-cli process-typed-markers
    stubgen -o stubs --include-private -p ataraxis_automation -v
    automation-cli process-stubs
    ruff format
    ruff check --select I --fix ./src

Test

Shell command: tox -e pyXXX-test

This task is executed for all python versions supported by each project. For example, ataraxis-automation supports versions 3.12, 3.13, and 3.14. Therefore, it has tox -e py312-test, tox -e py313-test, and tox -e py314-test as valid 'test' tasks. These tasks build the project in an isolated environment and run the project's unit and integration tests to verify that the project works as expected for each supported python version.

Example tox.ini section:

[testenv:{py312, py313, py314}-test]
package = wheel
description =
    Runs unit and integration tests for each of the python versions listed in the task name and aggregates test coverage
    data. Uses 'loadgroup' balancing and all logical cores to optimize task runtime speed.
dependency_groups = dev
setenv = COVERAGE_FILE = reports{/}.coverage.{envname}
commands =
    pytest --import-mode=append --cov=ataraxis_automation --cov-config=pyproject.toml --cov-report=xml \
    --junitxml=reports/pytest.xml.{envname} -n logical --dist loadgroup

Coverage

Shell command: tox -e coverage

This task is used in conjunction with the 'test' task. It aggregates code coverage data for different python versions and compiles it into an HTML report accessible by opening PROJECT_ROOT/reports/coverage_html/index.html in a browser.

Example tox.ini section:

[testenv:coverage]
skip_install = true
description =
    Combines test-coverage data from multiple test runs (for different python versions) into a single html file. The
    file can be viewed by loading the 'reports/coverage_html/index.html'.
deps = ataraxis-automation==8.0.0
setenv = COVERAGE_FILE = reports/.coverage
depends = {py312, py313, py314}-test
commands =
    junitparser merge --glob reports/pytest.xml.* reports/pytest.xml
    coverage combine --keep
    coverage xml
    coverage html

Docs

Shell command: tox -e docs

Uses Sphinx to automatically parse docstrings from source code and build the API documentation for the project. This task relies on the configuration files stored inside the PROJECT_ROOT/docs/source directory to define the generated documentation format. Built documentation can be viewed by opening PROJECT_ROOT/docs/build/html/index.html in a browser.

Example tox.ini section for a pure-python project:

description =
    Builds the API documentation from source code docstrings using Sphinx. The result can be viewed by loading
    'docs/build/html/index.html'.
depends = uninstall
deps = ataraxis-automation==8.0.0
commands =
    sphinx-build -b html -d docs/build/doctrees docs/source docs/build/html -j auto -v

Note, C-extension projects use a slightly modified version of this task that uses Doxygen to parse doxygen-styled docstrings used in the C-code and breathe to convert doxygen-generated XML files for C-code into a Sphinx-compatible format. This allows C-extension projects to include both Python and C/C++ API documentation in the same .html file. To support this behavior, the tox.ini file must include an additional command: doxygen Doxyfile.

Example tox.ini section for a C-extension project:

description =
    Builds the API documentation from source code docstrings using Sphinx. The result can be viewed by loading
    'docs/build/html/index.html'.
depends = uninstall
deps = ataraxis-automation==8.0.0
commands =
    doxygen Doxyfile
    sphinx-build -b html -d docs/build/doctrees docs/source docs/build/html -j auto -v

Build

Shell command: tox -e build

This task builds a source-code distribution (sdist) and a binary distribution (wheel) for the project. These distributions can then be uploaded to GitHub or PyPI or shared with the intended audience through any other means. Pure-python projects use hatchling and build to generate one source-code and one binary distribution. C-extension projects use cibuildwheel to compile the C-code for all supported platforms and architectures, building many binary distribution files alongside source-code distribution generated via build.

Example tox.ini section for a pure-python project:

[testenv:build]
skip_install = true
description = Builds the project's source code distribution (sdist) and binary distribution (wheel).
deps = ataraxis-automation==8.0.0
allowlist_externals = docker
commands =
    python -m build . --sdist
    python -m build . --wheel

Example tox.ini section for a C-extension project:

[testenv:build]
skip-install = true
description =
    Builds the project's source code distribution (sdist) and compiles and assembles binary wheels for all
    supported platform architectures.
deps = ataraxis-automation==8.0.0
allowlist_externals = docker
commands =
    python -m build . --sdist
    cibuildwheel --output-dir dist --platform auto

Upload

Shell command: tox -e upload

Uploads the sdist and wheel files created by the 'build' task to PyPI. When this task runs for the first time, it uses automation-cli to generate a .pypirc file and store the user-provided PyPI API token in that file. This allows reusing the token for later uploads, streamlining the process. Once uploaded, the project (library) becomes a valid target for pip install LIBRARYNAME commands.

Example tox.ini section:

[testenv:upload]
skip_install = true
description = Uses twine to upload all files inside the project's 'dist' directory to PyPI.
deps = ataraxis-automation==8.0.0
allowlist_externals = distutils
commands =
    automation-cli acquire-pypi-token {posargs:}
    twine upload dist/* --skip-existing --config-file .pypirc

Supported Mamba Environment Manipulation Tox Tasks

These tasks were added to automate repetitive tasks associated with managing project mamba environments during development. They assume that there is a validly configured mamba distribution installed and accessible from the shell of the machine that calls these commands.

Install

Shell command: tox -e install

Installs the project into its development mamba environment. To allow installing prerelease packages, use tox -e install -- --prerelease.

Example tox.ini section:

[testenv:install]
skip_install = true
deps = ataraxis-automation==8.0.0
depends =
    lint
    stubs
    {py312, py313, py314}-test
    coverage
    docs
    export
description = Builds and installs the project into its development mamba environment.
commands =
    automation-cli install-project --environment-name axa_dev

Uninstall

Shell command: tox -e uninstall

Removes the project from its development mamba environment.

Example tox.ini section:

[testenv:uninstall]
skip_install = true
deps = ataraxis-automation==8.0.0
description = Uninstalls the project from its development mamba environment.
commands =
    automation-cli uninstall-project --environment-name axa_dev

Create

Shell command: tox -e create

Creates the project's development mamba environment and installs project dependencies listed in the pyproject.toml file into the environment. This task is intended to be used when setting up project development environments for new platforms and architectures. The task assumes that all dependencies are stored using the Sun Lab format: inside the general 'dependencies' section and the optional 'dev' dependency section. To allow installing prerelease packages, use tox -e create -- --prerelease.

Example tox.ini section:

[testenv:create]
skip_install = true
deps = ataraxis-automation==8.0.0
description =
    Creates the project's development mamba environment using the requested python version and installs runtime and
    development project dependencies extracted from the pyproject.toml file.
commands =
    automation-cli create-environment --environment-name axa_dev --python-version 3.14

Remove

Shell command: tox -e remove

Removes the project's development mamba environment. Primarily, this task is intended to be used to clean the local system after project development is finished. Note; to reset the environment, it is advised to use the 'provision' task instead (see below).

Example tox.ini section:

[testenv:remove]
skip_install = true
deps = ataraxis-automation==8.0.0
description = Removes the project's development mamba environment.
commands =
    automation-cli remove-environment --environment-name axa_dev

Provision

Shell command: tox -e provision

This task is a combination of the 'remove' and 'create' tasks. It is designed to reset the project's development environment by recreating it from scratch. This is used to both reset and actualize project development environments to match the latest version of the pyproject.toml file dependency specification. To allow installing prerelease packages, use tox -e provision -- --prerelease.

Example tox.ini section:

[testenv:provision]
skip_install = true
deps = ataraxis-automation==8.0.0
description = Provisions the project's development mamba environment by removing and (re)creating the environment.
commands =
    automation-cli provision-environment --environment-name axa_dev --python-version 3.14

Export

Shell command: tox -e export

Exports the project's development environment as a .yml and spec.txt file. This task is used before distributing new versions of the project to allow the target audience to generate an identical copy of the development environment using the generated .yml and spec.txt files. While 'create' and 'provision' tasks make this largely obsolete, this functionality is maintained for all Sun lab projects.

Example tox.ini section:

[testenv:export]
skip_install = true
deps = ataraxis-automation==8.0.0
description =
    Exports the project's development mamba environment to the 'envs' project directory as a .yml file and as a
    spec.txt with revision history.
commands =
    automation-cli export-environment --environment-name axa_dev

Import

Shell command: tox -e import

Imports the project's development environment from its .yml file. If the environment does not exist, this creates an identical copy of the environment stored in the .yml file. If the environment already exists, it is updated using the .yml file. The update process is configured to prune any unused packages not found inside the .yml file.

Example tox.ini section:

[testenv:import]
skip_install = true
deps = ataraxis-automation==8.0.0
description =
    Creates or updates the project's development mamba environment using the .yml file stored in the 'envs' project
    directory.
commands =
    automation-cli import-environment --environment-name axa_dev

Claude Code Skills

The Ataraxis project also exports agentic skills that enforce Sun Lab development conventions across all downstream via the main ataraxis repository. See the Claude Code Skills section of the ataraxis README for available skills and installation instructions.

API Documentation

See the API documentation for the detailed description of the methods and classes exposed by components of this library. Note, the documentation also includes a list of all command-line interface functions and their arguments.

Developers

This section provides installation, dependency, and build-system instructions for the developers that want to modify the source code of this library.

Installing the Project

Note, this installation method requires mamba version 2.3.2 or above. Currently, all Sun lab automation pipelines require that mamba is installed through the miniforge3 installer.

Download this repository to the local machine using the preferred method, such as git-cloning.
If the downloaded distribution is stored as a compressed archive, unpack it using the appropriate decompression tool.
cd to the root directory of the prepared project distribution.
Install the core Sun lab development dependencies into the base mamba environment via the mamba install tox uv tox-uv command.
Use the tox -e create command to create the project-specific development environment followed by tox -e install command to install the project into that environment as a library.

Additional Dependencies

In addition to installing the project and all user dependencies, install the following dependencies:

Python distributions, one for each version supported by the developed project. Currently, this library supports the three latest stable versions. It is recommended to use a tool like pyenv to install and manage the required versions.
Doxygen, if the project uses C-extensions. This is necessary to build the API documentation for the C-code portion of the project.

Development Automation

This project uses tox for development automation. The following tox environments are available:

Environment	Description
`lint`	Runs ruff formatting, ruff linting, and mypy type checking
`stubs`	Generates py.typed marker and .pyi stub files
`{py312,...}-test`	Runs the test suite via pytest for each supported Python
`coverage`	Aggregates test coverage into an HTML report
`docs`	Builds the API documentation via Sphinx
`build`	Builds sdist and wheel distributions
`upload`	Uploads distributions to PyPI via twine
`install`	Builds and installs the project into its mamba environment
`uninstall`	Uninstalls the project from its mamba environment
`create`	Creates the project's mamba development environment
`remove`	Removes the project's mamba development environment
`provision`	Recreates the mamba environment from scratch
`export`	Exports the mamba environment as .yml and spec.txt files
`import`	Creates or updates the mamba environment from a .yml file

Run any environment using tox -e ENVIRONMENT. For example, tox -e lint.

Note, automation pipelines for this library have been modified from the implementation used in all other projects, as they require this library to support their runtime. To avoid circular dependencies, the pipelines for this library always compile and install the library from source code before running each automation task.

Note, all pull requests for this project have to successfully complete the tox task before being merged. To expedite the task's runtime, use the tox --parallel command to run some tasks in parallel.

Automation Troubleshooting

Many packages used in tox automation pipelines (uv, mypy, ruff) and tox itself may experience runtime failures. In most cases, this is related to their caching behavior. If an unintelligible error is encountered with any of the automation components, deleting the corresponding cache directories (.tox, .ruff_cache, .mypy_cache, etc.) manually or via a CLI command typically resolves the issue.

Versioning

This project uses semantic versioning. See the tags on this repository for the available project releases.

Authors

Ivan Kondratyev (Inkaros)

License

This project is licensed under the Apache 2.0 License: see the LICENSE file for details.

Acknowledgments

All Sun lab members for providing the inspiration and comments during the development of this library.
click project for providing the low-level command-line-interface functionality for this project.
The teams behind pip, uv, conda, mamba and tox, which form the backbone of Sun lab automation pipelines.
The creators of all other dependencies and projects listed in the pyproject.toml file.

Name		Name	Last commit message	Last commit date
Latest commit History 148 Commits
.github/ISSUE_TEMPLATE		.github/ISSUE_TEMPLATE
docs		docs
envs		envs
src/ataraxis_automation		src/ataraxis_automation
tests		tests
.gitignore		.gitignore
CLAUDE.md		CLAUDE.md
LICENSE		LICENSE
README.md		README.md
pyproject.toml		pyproject.toml
tox.ini		tox.ini

Folders and files

Latest commit

History

Repository files navigation

ataraxis-automation

Detailed Description

Features

Table of Contents

Dependencies

Installation

Source

pip

Usage

Automation Command-Line Interface

Automation-CLI

Tox Integration

Additional Command Arguments

Supported Checkout Tox Tasks

Lint

Stubs

Test

Coverage

Docs

Build

Upload

Supported Mamba Environment Manipulation Tox Tasks

Install

Uninstall

Create

Remove

Provision

Export

Import

Claude Code Skills

API Documentation

Developers

Installing the Project

Additional Dependencies

Development Automation

Automation Troubleshooting

Versioning

Authors

License

Acknowledgments

About

Topics

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases 23

Packages 0

Uh oh!

Uh oh!

Contributors

Uh oh!

Languages

Packages