Skip to content

Example script crashes when bfgn is installed using provided environment.yaml files #103

Description

@rachelemason

I installed bfgn following the CPU instructions in the README file, then put the contents of the termite_mound_example.py file into a Jupyter notebook in order to step through it piece by piece, making only the minimum modifications to the script necessary for it to run in the notebook. The fit_model_with_data_container step failed with the following error:

W tensorflow/core/framework/op_kernel.cc:1401] OP_REQUIRES failed at mkl_slice_op.cc:438 : Aborted: Operation received an exception:Status: 5, message: could not create a view primitive descriptor, in file tensorflow/core/kernels/mkl_slice_op.cc:435

I obtained a Jupyter notebook version of the termite example script from Megs Seeley along with a listing of the packages in the conda environment in which she successfully ran the notebook. I find that the notebook runs successfully in that environment, but fails in my environment. I suspect that the important difference between the environments is that the one I created from the environment.yaml file on github uses python=3.7 and tensorflow=1.13.1, while Megs' environment uses python=3.6 and tensorflow=1.12.0. I haven't been able to fully test that because conda runs into a mess of inconsistencies when I try to downgrade numpy and scipy.

Here are the contents of environments under which the example script does not and does run, respectively:

packages in environment at /home/remason2/.conda/envs/bfgn-cpu:

Name Version Build Channel

_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
_tflow_select 2.3.0 mkl
absl-py 0.15.0 pyhd3eb1b0_0
affine 2.3.0 pyhd3eb1b0_0
albumentations 1.0.3 pyhd8ed1ab_0 conda-forge
astor 0.8.1 py37h06a4308_0
attrs 21.4.0 pyhd3eb1b0_0
backcall 0.2.0 pypi_0 pypi
bfgn 0.1.0 dev_0
blas 1.0 mkl
brotli 1.0.9 he6710b0_2
brotlipy 0.7.0 py37h27cfd23_1003
bzip2 1.0.8 h7b6447c_0
c-ares 1.18.1 h7f8727e_0
ca-certificates 2022.4.26 h06a4308_0
cairo 1.16.0 h19f5f5c_2
certifi 2022.6.15 py37h06a4308_0
cffi 1.15.0 py37hd667e15_1
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 7.1.2 pyhd3eb1b0_0
click-plugins 1.1.1 pyhd3eb1b0_0
cligj 0.7.2 py37h06a4308_0
cloudpickle 2.1.0 pyhd8ed1ab_0 conda-forge
colorama 0.4.5 py37h06a4308_0
cryptography 37.0.1 py37h9ce1e76_0
curl 7.67.0 hbc83047_0
cycler 0.11.0 pyhd3eb1b0_0
cytoolz 0.11.2 py37h540881e_2 conda-forge
dask-core 2022.2.0 pyhd8ed1ab_0 conda-forge
dataclasses 0.8 pyh6d0b6a4_7
dbus 1.13.18 hb2f20db_0
debugpy 1.6.0 pypi_0 pypi
decorator 5.1.1 pyhd8ed1ab_0 conda-forge
entrypoints 0.4 pypi_0 pypi
expat 2.4.4 h295c915_0
ffmpeg 4.1.3 h167e202_0 conda-forge
fiona 1.8.4 py37hc38cc03_0
fontconfig 2.13.1 h6c09931_0
fonttools 4.25.0 pyhd3eb1b0_0
freetype 2.11.0 h70c0345_0
freexl 1.0.6 h27cfd23_0
fsspec 2022.5.0 pyhd8ed1ab_0 conda-forge
gast 0.5.3 pyhd3eb1b0_0
gdal 2.3.3 py37hbb2a789_0
geos 3.7.1 he6710b0_0
giflib 5.1.4 h14c3975_1
glib 2.69.1 h4ff587b_1
gmp 6.2.1 h58526e2_0 conda-forge
gnutls 3.6.13 h85f3911_1 conda-forge
graphite2 1.3.13 h58526e2_1001 conda-forge
grpcio 1.42.0 py37hce63b2e_0
gst-plugins-base 1.14.0 h8213a91_2
gstreamer 1.14.0 h28cd5cc_2
h5py 2.10.0 py37h7918eee_0
harfbuzz 2.4.0 h37c48d4_1 conda-forge
hdf4 4.2.13 h3ca952b_2
hdf5 1.10.4 hb1b8bf9_0
icu 58.2 he6710b0_3
idna 3.3 pyhd3eb1b0_0
imageio 2.13.1 pyhd8ed1ab_0 conda-forge
imgaug 0.4.0 pyhd8ed1ab_1 conda-forge
importlib-metadata 4.11.3 py37h06a4308_0
intel-openmp 2021.4.0 h06a4308_3561
ipykernel 6.15.0 pypi_0 pypi
ipython 7.34.0 pypi_0 pypi
jasper 1.900.1 h07fcdf6_1006 conda-forge
jedi 0.18.1 pypi_0 pypi
joblib 1.1.0 pyhd3eb1b0_0
jpeg 9e h7f8727e_0
json-c 0.13.1 h1bed415_0
jupyter-client 7.3.4 pypi_0 pypi
jupyter-core 4.10.0 pypi_0 pypi
kealib 1.4.7 hd0c454d_6
keras 2.2.4 0
keras-applications 1.0.8 py_1
keras-base 2.2.4 py37_0
keras-preprocessing 1.1.2 pyhd3eb1b0_0
kiwisolver 1.4.2 py37h295c915_0
krb5 1.16.4 h173b8e3_0
lame 3.100 h7f98852_1001 conda-forge
lcms2 2.12 h3be6417_0
ld_impl_linux-64 2.38 h1181459_1
libblas 3.9.0 12_linux64_mkl conda-forge
libboost 1.67.0 h46d08c1_4
libcblas 3.9.0 12_linux64_mkl conda-forge
libcurl 7.67.0 h20c2e04_0
libdap4 3.19.1 h6ec2957_0
libedit 3.1.20210910 h7f8727e_0
libffi 3.3 he6710b0_2
libgcc-ng 11.2.0 h1234567_1
libgdal 2.3.3 h2e7e64b_0
libgfortran-ng 7.5.0 hae1eefd_17 conda-forge
libgfortran4 7.5.0 ha8ba4b0_17
libgomp 11.2.0 h1234567_1
libiconv 1.16 h516909a_0 conda-forge
libkml 1.3.0 h590aaf7_4
liblapack 3.9.0 12_linux64_mkl conda-forge
liblapacke 3.9.0 12_linux64_mkl conda-forge
libnetcdf 4.6.1 h11d0813_2
libpng 1.6.37 hbc83047_0
libpq 11.5 hd9ab2ff_2 conda-forge
libprotobuf 3.20.1 h4ff587b_0
libspatialite 4.3.0a hb08deb6_19
libssh2 1.10.0 h8f2d780_0
libstdcxx-ng 11.2.0 h1234567_1
libtiff 4.1.0 h2818925_1
libuuid 1.0.3 h7f8727e_2
libwebp 1.0.2 h576950b_1 conda-forge
libxcb 1.15 h7f8727e_0
libxml2 2.9.14 h74e7548_0
locket 1.0.0 pyhd8ed1ab_0 conda-forge
lz4-c 1.9.3 h295c915_1
markdown 3.3.4 py37h06a4308_0
matplotlib 3.3.4 py37h06a4308_0
matplotlib-base 3.3.4 py37h62a2d02_0
matplotlib-inline 0.1.3 pypi_0 pypi
mkl 2021.4.0 h06a4308_640
mkl-service 2.4.0 py37h7f8727e_0
mkl_fft 1.3.1 py37hd3c417c_0
mkl_random 1.2.2 py37h51133e4_0
mock 4.0.3 pyhd3eb1b0_0
munch 2.5.0 pyhd3eb1b0_0
munkres 1.1.4 py_0
ncurses 6.3 h7f8727e_2
nest-asyncio 1.5.5 pypi_0 pypi
nettle 3.6 he412f7d_0 conda-forge
networkx 2.5 py_0 conda-forge
numpy 1.21.5 py37h6c91a56_3
numpy-base 1.21.5 py37ha15fc14_3
olefile 0.46 py37_0
opencv 4.1.0 py37h5517eff_4 conda-forge
openh264 1.8.0 hdbcaa40_1000 conda-forge
openjpeg 2.4.0 h3ad879b_0
openssl 1.1.1p h5eee18b_0
packaging 21.3 pyhd3eb1b0_0
parso 0.8.3 pypi_0 pypi
partd 1.2.0 pyhd8ed1ab_0 conda-forge
pcre 8.45 h295c915_0
pexpect 4.8.0 pypi_0 pypi
pickleshare 0.7.5 pypi_0 pypi
pillow 8.3.1 py37h2c7a002_0
pip 21.2.2 py37h06a4308_0
pixman 0.40.0 h7f8727e_1
poppler 0.65.0 h581218d_1
poppler-data 0.4.11 h06a4308_0
proj4 5.2.0 h295c915_1001
prompt-toolkit 3.0.29 pypi_0 pypi
protobuf 3.20.1 py37h295c915_0
psutil 5.8.0 py37h27cfd23_1
ptyprocess 0.7.0 pypi_0 pypi
pycparser 2.21 pyhd3eb1b0_0
pygments 2.12.0 pypi_0 pypi
pyopenssl 22.0.0 pyhd3eb1b0_0
pyparsing 3.0.4 pyhd3eb1b0_0
pyqt 5.9.2 py37h05f1152_2
pysocks 1.7.1 py37_1
python 3.7.13 h12debd9_0
python-dateutil 2.8.2 pyhd3eb1b0_0
python_abi 3.7 2_cp37m conda-forge
pywavelets 1.3.0 py37hda87dfa_1 conda-forge
pyyaml 5.4.1 py37h27cfd23_1
pyzmq 23.2.0 pypi_0 pypi
qt 5.9.7 h5867ecd_1
rasterio 1.0.21 py37hc38cc03_0
readline 8.1.2 h7f8727e_1
requests 2.27.1 pyhd3eb1b0_0
scikit-image 0.16.2 py37hb3f55d8_0 conda-forge
scikit-learn 0.24.2 py37ha9443f7_0
scipy 1.7.3 py37hc147768_0
setuptools 61.2.0 py37h06a4308_0
shapely 1.6.4 py37h86c5351_0
sip 4.19.8 py37hf484d3e_0
six 1.16.0 pyhd3eb1b0_1
snuggs 1.4.7 pyhd3eb1b0_0
sqlite 3.38.3 hc218d9a_0
tensorboard 1.13.1 py37hf484d3e_0
tensorflow 1.13.1 mkl_py37h54b294f_0
tensorflow-base 1.13.1 mkl_py37h7ce6ba3_0
tensorflow-estimator 1.13.0 py_0
termcolor 1.1.0 py37h06a4308_1
threadpoolctl 2.2.0 pyh0d69192_0
tk 8.6.12 h1ccaba5_0
toolz 0.11.2 pyhd8ed1ab_0 conda-forge
tornado 6.1 py37h27cfd23_0
tqdm 4.63.0 pyhd3eb1b0_0
traitlets 5.3.0 pypi_0 pypi
typing_extensions 4.1.1 pyh06a4308_0
urllib3 1.26.9 py37h06a4308_0
wcwidth 0.2.5 pypi_0 pypi
werkzeug 2.0.3 pyhd3eb1b0_0
wheel 0.37.1 pyhd3eb1b0_0
x264 1!152.20180806 h14c3975_0 conda-forge
xerces-c 3.2.3 h780794e_0
xz 5.2.5 h7f8727e_1
yaml 0.2.5 h7b6447c_0
zipp 3.8.0 py37h06a4308_0
zlib 1.2.12 h7f8727e_2
zstd 1.5.2 ha4553b6_0

packages in environment at /home/remason2/.conda/envs/bfgn-again:

Name Version Build Channel

_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
_tflow_select 2.3.0 mkl
absl-py 0.15.0 pyhd3eb1b0_0
affine 2.3.0 pyhd3eb1b0_0
albumentations 1.1.0 pypi_0 pypi
astor 0.8.1 py36h06a4308_0
attrs 21.4.0 pyhd3eb1b0_0
backcall 0.2.0 pypi_0 pypi
bfgn 0.1.0 dev_0
blas 1.0 mkl
brotlipy 0.7.0 py36h27cfd23_1003
bzip2 1.0.8 h7b6447c_0
c-ares 1.18.1 h7f8727e_0
ca-certificates 2022.4.26 h06a4308_0
cairo 1.16.0 h19f5f5c_2
certifi 2021.5.30 py36h06a4308_0
cffi 1.14.6 py36h400218f_0
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 7.1.2 pyhd3eb1b0_0
click-plugins 1.1.1 pyhd3eb1b0_0
cligj 0.7.2 py36h06a4308_0
colorama 0.4.4 pyhd3eb1b0_0
coverage 5.5 py36h27cfd23_2
cryptography 35.0.0 py36hd23ed53_0
curl 7.67.0 hbc83047_0
cycler 0.11.0 pyhd3eb1b0_0
cython 0.29.24 py36h295c915_0
dataclasses 0.8 pyh4f3eec9_6
dbus 1.13.18 hb2f20db_0
decorator 5.1.1 pypi_0 pypi
entrypoints 0.4 pypi_0 pypi
expat 2.4.4 h295c915_0
fiona 1.8.4 py36hc38cc03_0
fontconfig 2.13.1 h6c09931_0
freetype 2.11.0 h70c0345_0
freexl 1.0.6 h27cfd23_0
gast 0.5.3 pyhd3eb1b0_0
gdal 2.3.3 py36hbb2a789_0
geos 3.7.1 he6710b0_0
giflib 5.1.4 h14c3975_1
glib 2.69.1 h4ff587b_1
grpcio 1.36.1 py36h2157cd5_1
gst-plugins-base 1.14.0 h8213a91_2
gstreamer 1.14.0 h28cd5cc_2
h5py 2.10.0 py36h7918eee_0
hdf4 4.2.13 h3ca952b_2
hdf5 1.10.4 hb1b8bf9_0
icu 58.2 he6710b0_3
idna 3.3 pyhd3eb1b0_0
imageio 2.15.0 pypi_0 pypi
importlib-metadata 4.8.1 py36h06a4308_0
intel-openmp 2022.0.1 h06a4308_3633
ipykernel 5.5.6 pypi_0 pypi
ipython 7.16.3 pypi_0 pypi
ipython-genutils 0.2.0 pypi_0 pypi
jedi 0.17.2 pypi_0 pypi
joblib 1.1.0 pypi_0 pypi
jpeg 9e h7f8727e_0
json-c 0.13.1 h1bed415_0
jupyter-client 7.1.2 pypi_0 pypi
jupyter-core 4.9.2 pypi_0 pypi
kealib 1.4.7 hd0c454d_6
keras 2.2.4 0
keras-applications 1.0.8 py_1
keras-base 2.2.4 py36_0
keras-preprocessing 1.1.2 pyhd3eb1b0_0
kiwisolver 1.3.1 py36h2531618_0
krb5 1.16.4 h173b8e3_0
lcms2 2.12 h3be6417_0
ld_impl_linux-64 2.38 h1181459_1
libboost 1.73.0 h28710b8_12
libcurl 7.67.0 h20c2e04_0
libdap4 3.19.1 h6ec2957_0
libedit 3.1.20210910 h7f8727e_0
libffi 3.3 he6710b0_2
libgcc-ng 11.2.0 h1234567_1
libgdal 2.3.3 h2e7e64b_0
libgfortran-ng 7.3.0 hdf63c60_0
libgomp 11.2.0 h1234567_1
libkml 1.3.0 h7ecb851_5
libnetcdf 4.6.1 h11d0813_2
libpng 1.6.37 hbc83047_0
libpq 11.5 hd9ab2ff_2 conda-forge
libprotobuf 3.17.2 h4ff587b_1
libspatialite 4.3.0a hb08deb6_19
libssh2 1.10.0 h8f2d780_0
libstdcxx-ng 11.2.0 h1234567_1
libtiff 4.2.0 h2818925_1
libuuid 1.0.3 h7f8727e_2
libwebp-base 1.2.2 h7f8727e_0
libxcb 1.15 h7f8727e_0
libxml2 2.9.14 h74e7548_0
lz4-c 1.9.3 h295c915_1
markdown 3.3.4 py36h06a4308_0
matplotlib 3.3.4 py36h06a4308_0
matplotlib-base 3.3.4 py36h62a2d02_0
mkl 2020.2 256
mkl-service 2.3.0 py36he8ac12f_0
mkl_fft 1.3.0 py36h54f3939_0
mkl_random 1.1.1 py36h0573a6f_0
munch 2.5.0 pyhd3eb1b0_0
ncurses 6.3 h7f8727e_2
nest-asyncio 1.5.5 pypi_0 pypi
networkx 2.5.1 pypi_0 pypi
numpy 1.19.5 pypi_0 pypi
numpy-base 1.19.2 py36hfa32c7d_0
olefile 0.46 py36_0
opencv-python-headless 4.6.0.66 pypi_0 pypi
openjpeg 2.4.0 h3ad879b_0
openssl 1.1.1p h5eee18b_0
parso 0.7.1 pypi_0 pypi
pcre 8.45 h295c915_0
pexpect 4.8.0 pypi_0 pypi
pickleshare 0.7.5 pypi_0 pypi
pillow 8.4.0 pypi_0 pypi
pip 21.2.2 py36h06a4308_0
pixman 0.40.0 h7f8727e_1
poppler 0.65.0 h581218d_1
poppler-data 0.4.11 h06a4308_0
proj4 5.2.0 h295c915_1001
prompt-toolkit 3.0.30 pypi_0 pypi
protobuf 3.17.2 py36h295c915_0
psutil 5.8.0 py36h27cfd23_1
ptyprocess 0.7.0 pypi_0 pypi
pycparser 2.21 pyhd3eb1b0_0
pygments 2.12.0 pypi_0 pypi
pyopenssl 22.0.0 pyhd3eb1b0_0
pyparsing 3.0.9 pypi_0 pypi
pyqt 5.9.2 py36h05f1152_2
pysocks 1.7.1 py36h06a4308_0
python 3.6.13 h12debd9_1
python-dateutil 2.8.2 pyhd3eb1b0_0
pywavelets 1.1.1 pypi_0 pypi
pyyaml 6.0 pypi_0 pypi
pyzmq 23.2.0 pypi_0 pypi
qt 5.9.7 h5867ecd_1
qudida 0.0.4 pypi_0 pypi
rasterio 1.0.21 py36hc38cc03_0
readline 8.1.2 h7f8727e_1
requests 2.27.1 pyhd3eb1b0_0
scikit-image 0.17.2 pypi_0 pypi
scikit-learn 0.24.2 py36ha9443f7_0
scipy 1.5.4 pypi_0 pypi
setuptools 58.0.4 py36h06a4308_0
shapely 1.6.4 py36h86c5351_0
sip 4.19.8 py36hf484d3e_0
six 1.16.0 pyhd3eb1b0_1
snuggs 1.4.7 pyhd3eb1b0_0
sqlite 3.38.5 hc218d9a_0
tensorboard 1.12.2 py36he6710b0_0
tensorflow 1.12.0 mkl_py36h69b6ba0_0
tensorflow-base 1.12.0 mkl_py36h3c3e929_0
termcolor 1.1.0 py36h06a4308_1
threadpoolctl 3.1.0 pypi_0 pypi
tifffile 2020.9.3 pypi_0 pypi
tk 8.6.12 h1ccaba5_0
tornado 6.1 py36h27cfd23_0
tqdm 4.63.1 pyhd8ed1ab_0 conda-forge
traitlets 4.3.3 pypi_0 pypi
typing_extensions 4.1.1 pyh06a4308_0
urllib3 1.26.8 pyhd3eb1b0_0
wcwidth 0.2.5 pypi_0 pypi
werkzeug 2.0.3 pyhd3eb1b0_0
wheel 0.37.1 pyhd3eb1b0_0
xerces-c 3.2.3 h780794e_0
xz 5.2.5 h7f8727e_1
yaml 0.2.5 h7b6447c_0
zipp 3.6.0 pyhd3eb1b0_0
zlib 1.2.12 h7f8727e_2
zstd 1.5.2 ha4553b6_0

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions