Detect and draw Python dependency tree

[abitrolly]

Need a way to quickly draw pip dependency tree for troubleshooting various build problems like this one.

...
 Downloading opencv_python_headless-4.5.3.56-cp37-cp37m-manylinux2014_x86_64.whl (37.1 MB)
Collecting wxpython<4.1
  Downloading wxPython-4.0.7.post2.tar.gz (68.9 MB)
...
ERROR: Command errored out with exit status 1: /home/travis/virtualenv/python3.7.1/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-ngyqp946/wxpython_7c7fa4b7ce23477a873494227362d125/setup.py'"'"'; __file__='"'"'/tmp/pip-install-ngyqp946/wxpython_7c7fa4b7ce23477a873494227362d125/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1eyqbdoh/install-record.txt --single-version-externally-managed --compile --install-headers /home/travis/virtualenv/python3.7.1/include/site/python3.7/wxpython Check the logs for full command output.
...

[abitrolly]

BackYourStack (web only for now)

Basic support for parsing requirement.txt with JavaScripr, and it doesn't go beyond the first level,

• https://backyourstack.com/
• https://github.com/backyourstack/backyourstack

Example

https://backyourstack.com/jonmatthis/dependencies

References

• https://github.com/backyourstack/backyourstack/blob/master/src/lib/dependencies/pypi.js
• Adds basic python support backyourstack/backyourstack#238
• Document the process for adding support of new filetypes and languages backyourstack/backyourstack#241

[abitrolly]

deps.cloud (server-side indexer + CLI)

• https://deps.cloud/docs/guides/cli/

Example

Installing CLI that interacts with https://api.deps.cloud

brew tap depscloud/tap
brew install depscloud-cli
# deps {"version":"0.3.5","commit":"4d94a021e15d60f20ede00df7de2fd9149159928","date":"2021-06-07T13:46:53Z"}

Querying gave no results, not errors.

deps get dependencies -l python -n https://github.com/jonmatthis/freemocap

It is not clear if https://github.com/jonmatthis/freemocap needs to be added to the server side manually. There seems to be no command to do this from CLI.

The deployment docs mention extractor, tracker and indexer , but it is again not clear what component does what, and how to run one.

Looking at the extractor source it seems that it is the right tool, but it looks like it is server side only.

References

• https://deps.cloud/docs/languages/python/
• deps doesn't report errors depscloud/depscloud#341
• Add extract manifests command depscloud/depscloud#2
• https://github.com/depscloud/depscloud/tree/main/services/extractor

[abitrolly]

pipgrip (Python CLI)

Installs all deps as wheels and analyzes them.

• https://github.com/ddelange/pipgrip

Example

export GITREPO=https://github.com/jonmatthis/freemocap
podman run --rm -it python:3 bash -c "\
    pip3 install pipgrip && \
    git clone --depth 1 $GITREPO app && \
    cd app && \
    pipgrip . -v --tree \
"

[abitrolly]

pip-tools (Python CLI)

Add comments to requirements.txt that explain where things are coming from.

• Request: Compact annotations jazzband/pip-tools#1306)

Example

... TBD

[abitrolly]

pipdeptree` (Python CLI)

Shows dependency tree for installed packages.

• https://github.com/naiquevin/pipdeptree

Example

... TBD

[abitrolly]

Also https://github.com/jaraco/jaraco.packaging#make-tree