Fixed bug in examples that failed integration tests

[ntgbaoo]

Summary / Description

Fixed bug in examples.

Related Issues: #411

Type of Change

• Bug fix
• New feature
• Breaking Change
• Refactoring
• Documentation update

Test Evidence

Describe how this PR has been tested.

• Unit tests
• Integration tests
• Performance tests

Questions / Discussion Points

List any areas where you’d like reviewer input or have open questions.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

[github-actions]

Job: test_ctan_linkprop_pred_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.013
train latency	8.949
train peak_gpu_mb	543.521
train alloc_gpu_mb	531.590
eval latency	15.217
eval peak_gpu_mb	697.279
eval alloc_gpu_mb	464.958
Loss epoch 1	330.389
Validation mrr epoch 1	0.227
Test mrr epoch 1	0.217

Download raw logs

[github-actions]

Job: test_dygformer_nodeprop_pred_tgbn-trade

Metric	Value
discretize latency	0.004
materialize latency	0.002
execute_active_hooks latency	0.003
train latency	19.098
train peak_gpu_mb	524.244
train alloc_gpu_mb	519.409
eval latency	2.888
eval peak_gpu_mb	189.959
eval alloc_gpu_mb	167.619
Loss epoch 1	251.346
Validation ndcg epoch 1	0.278
Test ndcg epoch 1	0.228

Job: test_dygformer_linkprop_pred_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.013
train latency	18.932
train peak_gpu_mb	1209.590
train alloc_gpu_mb	1200.937
eval latency	479.103
eval peak_gpu_mb	1277.894
eval alloc_gpu_mb	1048.962
Loss epoch 1	275.940
Validation mrr epoch 1	0.732
Test mrr epoch 1	0.708

Download raw logs

[github-actions]

Job: test_gclstm_nodeprop_pred_tgbn-trade

Metric	Value
materialize latency	0.003
train latency	0.339
train peak_gpu_mb	23.279
train alloc_gpu_mb	7.217
eval latency	0.074
eval peak_gpu_mb	22.988
eval alloc_gpu_mb	3.224
Loss epoch 1	111.865
Validation ndcg epoch 1	0.349
Test ndcg epoch 5	0.421
Loss epoch 2	89.703
Validation ndcg epoch 2	0.409
Loss epoch 3	88.076
Validation ndcg epoch 3	0.450
Loss epoch 4	85.389
Validation ndcg epoch 4	0.497
Loss epoch 5	81.936
Validation ndcg epoch 5	0.558

Job: test_gclstm_linkprop_pred_tgbl-wiki

Metric	Value
discretize latency	0.016
materialize latency	0.001
execute_active_hooks latency	0.010
train latency	3.855
train peak_gpu_mb	188.440
train alloc_gpu_mb	113.095
eval latency	12.173
eval peak_gpu_mb	167.551
eval alloc_gpu_mb	83.072
Loss epoch 1	3.563
Validation mrr epoch 1	0.064
Test mrr epoch 5	0.111
Loss epoch 2	2.824
Validation mrr epoch 2	0.108
Loss epoch 3	2.172
Validation mrr epoch 3	0.172
Loss epoch 4	1.766
Validation mrr epoch 4	0.206
Loss epoch 5	1.514
Validation mrr epoch 5	0.227

Download raw logs

[github-actions]

Job: test_tgcn_graphprop_pred_tgb_D-tgbl-wiki

Metric	Value
discretize latency	0.029
materialize latency	0.001
train latency	0.307
train peak_gpu_mb	116.461
train alloc_gpu_mb	87.842
eval latency	0.019
eval peak_gpu_mb	74.255
eval alloc_gpu_mb	40.955
Loss epoch 1	17.585
TrainBinaryAveragePrecision epoch 1	0.631
TrainBinaryAUROC epoch 1	0.418
ValidationBinaryAveragePrecision epoch 1	0.628
ValidationBinaryAUROC epoch 1	0.408
TestBinaryAveragePrecision epoch 5	0.593
TestBinaryAUROC epoch 5	0.486
Loss epoch 2	13.278
TrainBinaryAveragePrecision epoch 2	0.603
TrainBinaryAUROC epoch 2	0.463
ValidationBinaryAveragePrecision epoch 2	0.603
ValidationBinaryAUROC epoch 2	0.458
Loss epoch 3	13.804
TrainBinaryAveragePrecision epoch 3	0.565
TrainBinaryAUROC epoch 3	0.399
ValidationBinaryAveragePrecision epoch 3	0.569
ValidationBinaryAUROC epoch 3	0.404
Loss epoch 4	13.605
TrainBinaryAveragePrecision epoch 4	0.570
TrainBinaryAUROC epoch 4	0.393
ValidationBinaryAveragePrecision epoch 4	0.577
ValidationBinaryAUROC epoch 4	0.402
Loss epoch 5	13.245
TrainBinaryAveragePrecision epoch 5	0.584
TrainBinaryAUROC epoch 5	0.403
ValidationBinaryAveragePrecision epoch 5	0.587
ValidationBinaryAUROC epoch 5	0.408

Job: test_tgcn_graphprop_pred_mint_test-token.csv

Metric	Value
discretize latency	0.004
materialize latency	0.001
train latency	0.375
train peak_gpu_mb	144.860
train alloc_gpu_mb	111.657
eval latency	0.040
eval peak_gpu_mb	87.127
eval alloc_gpu_mb	48.994
Loss epoch 1	40.747
TrainBinaryAveragePrecision epoch 1	0.293
TrainBinaryAUROC epoch 1	0.313
ValidationBinaryAveragePrecision epoch 1	0.296
ValidationBinaryAUROC epoch 1	0.306
TestBinaryAveragePrecision epoch 5	0.478
TestBinaryAUROC epoch 5	0.533
Loss epoch 2	39.007
TrainBinaryAveragePrecision epoch 2	0.338
TrainBinaryAUROC epoch 2	0.414
ValidationBinaryAveragePrecision epoch 2	0.343
ValidationBinaryAUROC epoch 2	0.422
Loss epoch 3	29.273
TrainBinaryAveragePrecision epoch 3	0.430
TrainBinaryAUROC epoch 3	0.550
ValidationBinaryAveragePrecision epoch 3	0.446
ValidationBinaryAUROC epoch 3	0.554
Loss epoch 4	19.466
TrainBinaryAveragePrecision epoch 4	0.596
TrainBinaryAUROC epoch 4	0.678
ValidationBinaryAveragePrecision epoch 4	0.595
ValidationBinaryAUROC epoch 4	0.678
Loss epoch 5	12.649
TrainBinaryAveragePrecision epoch 5	0.670
TrainBinaryAUROC epoch 5	0.734
ValidationBinaryAveragePrecision epoch 5	0.670
ValidationBinaryAUROC epoch 5	0.733

Job: test_gcn_graphprop_pred_mint_test-token.csv

Metric	Value
discretize latency	0.029
materialize latency	0.001
eval latency	0.031
ValidationBinaryAveragePrecision	0.527
ValidationBinaryAUROC	0.657
TestBinaryAveragePrecision	0.605
TestBinaryAUROC	0.638

Job: test_tgcn_linkproppred_tgbl-wiki

Metric	Value
discretize latency	0.013
materialize latency	0.001
execute_active_hooks latency	0.010
train latency	3.238
train peak_gpu_mb	130.518
train alloc_gpu_mb	72.812
eval latency	12.279
eval peak_gpu_mb	100.948
eval alloc_gpu_mb	38.152
Loss epoch 1	1.123
Validation mrr epoch 1	0.089
Test mrr epoch 5	0.160
Loss epoch 2	0.834
Validation mrr epoch 2	0.167
Loss epoch 3	0.740
Validation mrr epoch 3	0.213
Loss epoch 4	0.691
Validation mrr epoch 4	0.229
Loss epoch 5	0.657
Validation mrr epoch 5	0.247

Job: test_gcn_linkprop_pred_tgbl-wiki

Metric	Value
discretize latency	0.011
materialize latency	0.001
execute_active_hooks latency	0.010
train latency	1.741
train peak_gpu_mb	99.441
train alloc_gpu_mb	45.784
eval latency	11.699
eval peak_gpu_mb	89.816
eval alloc_gpu_mb	32.102
Loss epoch 1	1.604
Validation mrr epoch 1	0.206
Test mrr epoch 5	0.419
Loss epoch 2	0.694
Validation mrr epoch 2	0.382
Loss epoch 3	0.601
Validation mrr epoch 3	0.495
Loss epoch 4	0.523
Validation mrr epoch 4	0.518
Loss epoch 5	0.490
Validation mrr epoch 5	0.537

Job: test_gcn_graphprop_pred_tgb_D-tgbl-wiki

Metric	Value
discretize latency	0.018
materialize latency	0.001
train latency	0.174
train peak_gpu_mb	67.640
train alloc_gpu_mb	44.446
eval latency	0.011
eval peak_gpu_mb	58.267
eval alloc_gpu_mb	31.592
Loss epoch 1	19.895
TrainBinaryAveragePrecision epoch 1	0.693
TrainBinaryAUROC epoch 1	0.571
ValidationBinaryAveragePrecision epoch 1	0.687
ValidationBinaryAUROC epoch 1	0.542
TestBinaryAveragePrecision epoch 5	0.671
TestBinaryAUROC epoch 5	0.625
Loss epoch 2	14.104
TrainBinaryAveragePrecision epoch 2	0.623
TrainBinaryAUROC epoch 2	0.454
ValidationBinaryAveragePrecision epoch 2	0.624
ValidationBinaryAUROC epoch 2	0.453
Loss epoch 3	14.328
TrainBinaryAveragePrecision epoch 3	0.595
TrainBinaryAUROC epoch 3	0.379
ValidationBinaryAveragePrecision epoch 3	0.596
ValidationBinaryAUROC epoch 3	0.383
Loss epoch 4	13.076
TrainBinaryAveragePrecision epoch 4	0.595
TrainBinaryAUROC epoch 4	0.377
ValidationBinaryAveragePrecision epoch 4	0.596
ValidationBinaryAUROC epoch 4	0.380
Loss epoch 5	13.199
TrainBinaryAveragePrecision epoch 5	0.594
TrainBinaryAUROC epoch 5	0.373
ValidationBinaryAveragePrecision epoch 5	0.595
ValidationBinaryAUROC epoch 5	0.376

Job: test_tgcn_nodeprop_pred_tgbn-trade

Metric	Value
materialize latency	0.003
train latency	0.236
train peak_gpu_mb	40.831
train alloc_gpu_mb	24.871
eval latency	0.070
eval peak_gpu_mb	41.211
eval alloc_gpu_mb	21.574
Loss epoch 1	115.459
Validation ndcg epoch 1	0.363
Test ndcg epoch 5	0.353
Loss epoch 2	92.759
Validation ndcg epoch 2	0.369
Loss epoch 3	91.286
Validation ndcg epoch 3	0.361
Loss epoch 4	90.766
Validation ndcg epoch 4	0.394
Loss epoch 5	90.648
Validation ndcg epoch 5	0.374

Job: test_gcn_nodeprop_pred_tgbn-trade

Metric	Value
materialize latency	0.003
train latency	0.300
train peak_gpu_mb	29.133
train alloc_gpu_mb	14.607
eval latency	0.065
eval peak_gpu_mb	29.108
eval alloc_gpu_mb	11.107
Loss epoch 1	112.194
Validation ndcg epoch 1	0.412
Test ndcg epoch 5	0.420
Loss epoch 2	92.109
Validation ndcg epoch 2	0.438
Loss epoch 3	89.943
Validation ndcg epoch 3	0.460
Loss epoch 4	88.273
Validation ndcg epoch 4	0.463
Loss epoch 5	87.408
Validation ndcg epoch 5	0.479

Download raw logs

[github-actions]

Job: test_graphmixer_linkprop_pred_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.014
train latency	21.355
train peak_gpu_mb	469.510
train alloc_gpu_mb	463.724
eval latency	531.582
eval peak_gpu_mb	407.247
eval alloc_gpu_mb	254.266
Loss epoch 1	487.886
Validation mrr epoch 1	0.094
Test mrr epoch 1	0.096

Download raw logs

[github-actions]

Job: test_persistant_forecast_graphprop_pred_mint_test-token.csv

Metric	Value
discretize latency	0.037
materialize latency	0.001
eval latency	0.033
ValidationBinaryAveragePrecision	0.527
ValidationBinaryAUROC	0.657
TestBinaryAveragePrecision	0.605
TestBinaryAUROC	0.638

Job: test_persistant_forecast_nodeprop_pred_tgbn-trade

Metric	Value
materialize latency	0.005
eval latency	0.279
Validation ndcg	0.860
Test ndcg	0.855

Job: test_persistant_forecast_graphprop_pred_tgb_D-tgbl-wiki

Metric	Value
discretize latency	0.031
materialize latency	0.001
eval latency	0.025
ValidationBinaryAveragePrecision	0.583
ValidationBinaryAUROC	0.250
TestBinaryAveragePrecision	0.333
TestBinaryAUROC	0.367

Download raw logs

[github-actions]

Job: test_poptrack_linkprop_pred_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.057
eval latency	9.900
Validation mrr	0.104
Test mrr	0.097

Download raw logs

[github-actions]

Job: test_roland_linkprop_pred_tgbl-wiki

Metric	Value
discretize latency	0.020
materialize latency	0.001
execute_active_hooks latency	0.010
train latency	3.676
train peak_gpu_mb	181.303
train alloc_gpu_mb	126.189
eval latency	12.048
eval peak_gpu_mb	165.280
eval alloc_gpu_mb	74.505
Loss epoch 1	0.883
Validation mrr epoch 1	0.464
Test mrr epoch 1	0.386

Download raw logs

[github-actions]

Job: test_tgat_nodeprop_pred_recency_sampler_tgbn-trade

Metric	Value
materialize latency	0.002
execute_active_hooks latency	0.000
train latency	5.911
train peak_gpu_mb	289.341
train alloc_gpu_mb	287.282
eval latency	0.624
eval peak_gpu_mb	155.127
eval alloc_gpu_mb	132.489
Loss epoch 1	242.634
Validation ndcg epoch 1	0.353
Test ndcg epoch 1	0.294

Job: test_tgat_linkprop_pred_recency_sampler_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.014
train latency	12.623
train peak_gpu_mb	1272.301
train alloc_gpu_mb	1269.774
eval latency	540.430
eval peak_gpu_mb	1818.752
eval alloc_gpu_mb	1668.352
Loss epoch 1	605.188
Validation mrr epoch 1	0.058
Test mrr epoch 1	0.045

Job: test_tgat_linkprop_pred_uniform_sampler_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.342
train latency	150.457
train peak_gpu_mb	116.299
train alloc_gpu_mb	113.772
eval latency	527.846
eval peak_gpu_mb	145.970
eval alloc_gpu_mb	119.654
Loss epoch 1	669.032
Validation mrr epoch 1	0.060
Test mrr epoch 1	0.051

Download raw logs

[github-actions]

Job: test_tgcn_graphprop_pred_mint_test-token.csv

Metric	Value
discretize latency	0.004
materialize latency	0.001
train latency	0.386
train peak_gpu_mb	144.860
train alloc_gpu_mb	111.657
eval latency	0.041
eval peak_gpu_mb	87.127
eval alloc_gpu_mb	48.994
Loss epoch 1	40.747
TrainBinaryAveragePrecision epoch 1	0.293
TrainBinaryAUROC epoch 1	0.313
ValidationBinaryAveragePrecision epoch 1	0.296
ValidationBinaryAUROC epoch 1	0.306
TestBinaryAveragePrecision epoch 5	0.478
TestBinaryAUROC epoch 5	0.533
Loss epoch 2	39.007
TrainBinaryAveragePrecision epoch 2	0.338
TrainBinaryAUROC epoch 2	0.414
ValidationBinaryAveragePrecision epoch 2	0.343
ValidationBinaryAUROC epoch 2	0.422
Loss epoch 3	29.273
TrainBinaryAveragePrecision epoch 3	0.430
TrainBinaryAUROC epoch 3	0.550
ValidationBinaryAveragePrecision epoch 3	0.446
ValidationBinaryAUROC epoch 3	0.554
Loss epoch 4	19.359
TrainBinaryAveragePrecision epoch 4	0.596
TrainBinaryAUROC epoch 4	0.678
ValidationBinaryAveragePrecision epoch 4	0.595
ValidationBinaryAUROC epoch 4	0.678
Loss epoch 5	13.036
TrainBinaryAveragePrecision epoch 5	0.669
TrainBinaryAUROC epoch 5	0.734
ValidationBinaryAveragePrecision epoch 5	0.667
ValidationBinaryAUROC epoch 5	0.733

Job: test_tgcn_linkproppred_tgbl-wiki

Metric	Value
discretize latency	0.012
materialize latency	0.001
execute_active_hooks latency	0.010
train latency	3.152
train peak_gpu_mb	130.518
train alloc_gpu_mb	72.812
eval latency	11.877
eval peak_gpu_mb	100.948
eval alloc_gpu_mb	38.152
Loss epoch 1	1.123
Validation mrr epoch 1	0.089
Test mrr epoch 5	0.161
Loss epoch 2	0.834
Validation mrr epoch 2	0.167
Loss epoch 3	0.739
Validation mrr epoch 3	0.212
Loss epoch 4	0.691
Validation mrr epoch 4	0.228
Loss epoch 5	0.658
Validation mrr epoch 5	0.248

Job: test_tgcn_nodeprop_pred_tgbn-trade

Metric	Value
materialize latency	0.003
train latency	0.333
train peak_gpu_mb	40.831
train alloc_gpu_mb	24.871
eval latency	0.075
eval peak_gpu_mb	41.211
eval alloc_gpu_mb	21.574
Loss epoch 1	115.459
Validation ndcg epoch 1	0.363
Test ndcg epoch 5	0.353
Loss epoch 2	92.759
Validation ndcg epoch 2	0.369
Loss epoch 3	91.286
Validation ndcg epoch 3	0.361
Loss epoch 4	90.766
Validation ndcg epoch 4	0.394
Loss epoch 5	90.648
Validation ndcg epoch 5	0.374

Job: test_tgcn_graphprop_pred_tgb_D-tgbl-wiki

Metric	Value
discretize latency	0.025
materialize latency	0.001
train latency	0.281
train peak_gpu_mb	116.461
train alloc_gpu_mb	87.842
eval latency	0.016
eval peak_gpu_mb	74.255
eval alloc_gpu_mb	40.955
Loss epoch 1	17.585
TrainBinaryAveragePrecision epoch 1	0.631
TrainBinaryAUROC epoch 1	0.418
ValidationBinaryAveragePrecision epoch 1	0.628
ValidationBinaryAUROC epoch 1	0.408
TestBinaryAveragePrecision epoch 5	0.593
TestBinaryAUROC epoch 5	0.486
Loss epoch 2	13.278
TrainBinaryAveragePrecision epoch 2	0.603
TrainBinaryAUROC epoch 2	0.463
ValidationBinaryAveragePrecision epoch 2	0.603
ValidationBinaryAUROC epoch 2	0.458
Loss epoch 3	13.804
TrainBinaryAveragePrecision epoch 3	0.565
TrainBinaryAUROC epoch 3	0.399
ValidationBinaryAveragePrecision epoch 3	0.569
ValidationBinaryAUROC epoch 3	0.404
Loss epoch 4	13.605
TrainBinaryAveragePrecision epoch 4	0.570
TrainBinaryAUROC epoch 4	0.393
ValidationBinaryAveragePrecision epoch 4	0.577
ValidationBinaryAUROC epoch 4	0.402
Loss epoch 5	13.245
TrainBinaryAveragePrecision epoch 5	0.584
TrainBinaryAUROC epoch 5	0.403
ValidationBinaryAveragePrecision epoch 5	0.587
ValidationBinaryAUROC epoch 5	0.408

Download raw logs

[github-actions]

Job: test_tgn_linkprop_pred_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.013
train latency	15.034
train peak_gpu_mb	150.956
train alloc_gpu_mb	146.296
eval latency	14.147
eval peak_gpu_mb	406.417
eval alloc_gpu_mb	304.835
Loss epoch 1	433.936
Validation mrr epoch 1	0.074
Test mrr epoch 1	0.070

Download raw logs

[github-actions]

Job: test_tncn_linkprop_pred_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.013
train latency	17.798
train peak_gpu_mb	150.999
train alloc_gpu_mb	146.338
eval latency	68.024
eval peak_gpu_mb	411.084
eval alloc_gpu_mb	305.562
Loss epoch 1	524.713
Validation mrr epoch 1	0.360
Test mrr epoch 1	0.354

Download raw logs

[github-actions]

Job: test_tpnet_nodeprop_pred_tgbn-trade

Metric	Value
discretize latency	0.003
materialize latency	0.002
execute_active_hooks latency	0.003
train latency	16.947
train peak_gpu_mb	383.943
train alloc_gpu_mb	379.752
eval latency	2.611
eval peak_gpu_mb	364.863
eval alloc_gpu_mb	342.988
Loss epoch 1	252.953
Validation ndcg epoch 1	0.221
Test ndcg epoch 1	0.188

Job: test_tpnet_linkprop_pred_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.003
train latency	46.507
train peak_gpu_mb	12406.914
train alloc_gpu_mb	11425.137
eval latency	192.393
eval peak_gpu_mb	55579.155
eval alloc_gpu_mb	54373.750
Loss epoch 1	222.520
Validation mrr epoch 1	0.780
Test mrr epoch 1	0.627

Download raw logs

[github-actions]

Job: test_base3_linkprop_inf_EB_memory_tgbl-wiki

Metric	Value
materialize latency	0.001
execute_active_hooks latency	0.054
eval latency	210.189
Validation mrr	0.600
Test mrr	0.571

Download raw logs