API: Building the dependency graph
API: Dependency graph is built (7 artefacts; 7 methods)
API: Running computations
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_1.csv...
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py...
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_2.csv...
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/code/modelA.py...
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_3.csv...
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/code/tfDataProcessing.py...
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/code/tfQuadraticWeightedKappa.py...
DependencyGraph: Calculating hash of /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv...
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_1.csv - acquiring data hash...
HashHash: Artefact /home/dmitry/repos/PANDA-Challenge/code/tfDataProcessing.py - acquiring data hash...
: Artefact /home/dmitry/repos/PANDA-Challenge/code/modelA.py - acquiring data hash...
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/tfQuadraticWeightedKappa.py - acquiring data hash...
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_3.csv - acquiring data hash...
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py - acquiring data hash...
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_2.csv - acquiring data hash...
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_1.csv - acquiring files modification timeHash
: Artefact /home/dmitry/repos/PANDA-Challenge/code/modelA.py - acquiring files modification time
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_3.csv - acquiring files modification time
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/tfDataProcessing.py - acquiring files modification time
HashHash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_2.csv - acquiring files modification time
: Artefact /home/dmitry/repos/PANDA-Challenge/code/tfQuadraticWeightedKappa.py - acquiring files modification timeHash: Artefact /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py - acquiring files modification time
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv - acquiring data hash...
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv - acquiring files modification time
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_1.csv - modification time extracted
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_3.csv - modification time extracted
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/tfQuadraticWeightedKappa.py - modification time extracted
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/modelA.py - modification time extracted
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv - modification time extracted
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_2.csv - modification time extracted
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/tfDataProcessing.py - modification time extracted
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py - modification time extracted
HashHash: Artefact /home/dmitry/repos/PANDA-Challenge/code/modelA.py hash is extracted from up-to-date .hash file
: Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/tfQuadraticWeightedKappa.py hash is extracted from up-to-date .hash file
Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_3.csv hash is extracted from up-to-date .hash file
Hash: Hash: Artefact /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv hash is extracted from up-to-date .hash file
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_2.csv hash is extracted from up-to-date .hash file
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_1.csv hash is extracted from up-to-date .hash file
Hash: Artefact /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py hash is extracted from up-to-date .hash file
Artefact /home/dmitry/repos/PANDA-Challenge/code/tfDataProcessing.py hash is extracted from up-to-date .hash file
DependencyGraph: Written alph file for source artefact (LinkToArtefact Artefact(experiments/dgrechka/13c/pretrain/../val_folds/*.csv|["fold_1"]:Some "BBB439", ["fold_2"]:Some "3C2173", ["fold_3"]:Some "F85E3D") [expected version Map (map
[("fold_1",
Value
(Some
"BBB439747E2E597FAF19C6475C77C3CDBEA381B1175EDFAFA4EC15A61202BA4FD357E7A81F1FD0E57D3A1E0DE63CA1B477F89AD5AA6D44328E0F3EB997C11DA8"));
("fold_2",
Value
(Some
"3C2173C4499F5C10671E410D397E97059D88F19284FDE4FF77A59C31096A1FDFB4EA711AF86030CDD1ADB05E316F42A3A20855C3EB2A849225363DAB94BED2AF"));
("fold_3",
Value
(Some
"F85E3DE8E5C97B3BB9C284025021572470AD4420C85778151732F633C337A452B1684B8BA560C4C4A412CF80C01579E9F997F7D4CA29F47818FFC4D6BA02C487"))])]), as there is some data for the artefact on disk
DependencyGraph: Saving alph file for artefact Path "experiments/dgrechka/13c/pretrain/../val_folds/*.csv"
DependencyGraph: Saved alph file for artefact Path "experiments/dgrechka/13c/pretrain/../val_folds/*.csv"
Execution: experiments/dgrechka/13c/pretrain/fold_1/["fold_1"]: Started
ExecutionExecution: experiments/dgrechka/13c/pretrain/fold_3/["fold_3"]: Started
: experiments/dgrechka/13c/pretrain/fold_2/["fold_2"]: Started
Execution: experiments/dgrechka/13c/pretrain/fold_1/: Needs recomputation as disk version of the input does not match expected version
Execution: experiments/dgrechka/13c/pretrain/fold_3/: Needs recomputation as disk version of the input does not match expected versionExecution: experiments/dgrechka/13c/pretrain/fold_2/: Needs recomputation as disk version of the input does not match expected version
Execution: experiments/dgrechka/13c/pretrain/fold_3/["fold_3"]: Waiting for system resources quota to become availableExecution: experiments/dgrechka/13c/pretrain/fold_2/["fold_2"]: Waiting for system resources quota to become available
Execution: experiments/dgrechka/13c/pretrain/fold_1/["fold_1"]: Waiting for system resources quota to become available
Execution: experiments/dgrechka/13c/pretrain/fold_3/["fold_3"]: Got resource: gpu
Execution: experiments/dgrechka/13c/pretrain/fold_3/["fold_3"]: Obtained needed system resources quota
Execution: [experiments/dgrechka/13c/pretrain/fold_3/]: Running "python /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_3.csv /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/pretrain/fold_3/ 64" in "/home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/pretrain/..\..\..\../"
Execution: experiments/dgrechka/13c/pretrain/fold_2/["fold_2"]: Got resource: gpu
Execution: experiments/dgrechka/13c/pretrain/fold_2/["fold_2"]: Obtained needed system resources quota
Execution: [experiments/dgrechka/13c/pretrain/fold_2/]: Running "python /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_2.csv /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/pretrain/fold_2/ 64" in "/home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/pretrain/..\..\..\../"
Execution: experiments/dgrechka/13c/pretrain/fold_1/["fold_1"]: Got resource: gpu
Execution: experiments/dgrechka/13c/pretrain/fold_1/["fold_1"]: Obtained needed system resources quota
Execution: [experiments/dgrechka/13c/pretrain/fold_1/]: Running "python /home/dmitry/repos/PANDA-Challenge/code/pretrainA_tfrecords.py /home/dmitry/repos/PANDA-Challenge/data/kaggleOfficial/train.csv /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/val_folds/fold_1.csv /home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/pretrain/fold_1/ 64" in "/home/dmitry/repos/PANDA-Challenge/experiments/dgrechka/13c/pretrain/..\..\..\../"
Error occurred: No such file or directory
On ubuntu
executing
(venv) dmitry@compute:~/repos/PANDA-Challenge/experiments/dgrechka$ alpheus -v verbose compute 13c/pretrain/vector.alphresults in