Leaderboards for Dynamic Link Property Prediction

Check leaderboards for

- tgbl-wiki-v2

- tgbl-review-v2

- tgbl-coin-v2

- tgbl-comment

- tgbl-flight-v2

The bold method name indicates that the implementation is official (by the author of the original paper).
Package denotes the required package version for each dataset to be eligible for the leaderboard.

Leaderboard for tgbl-wiki-v2

Please update your package >= 0.7.5. In version 2 of tgbl-wiki, we have included all possible negative destinations for each positive edge thus increasing the task difficulty. For submissions, please submit to this version. Previous version of the dataset leaderboard is tgbl-wiki-v1. The MRR score on the test and validation sets. The higher, the better.

Package: >=0.7.5

Rank Method Test MRR Validation MRR Contact References Date
1 DyGFormer 0.798 ± 0.004 0.816 ± 0.005 Le Yu (Beihang University) Paper, Code August 22nd, 2023
2 NAT 0.749 ± 0.010 0.773 ± 0.011 TGB team Paper, Code August 22nd, 2023
3 CAWN 0.711 ± 0.006 0.743 ± 0.004 TGB team Paper, Code July 27th, 2023
4 EdgeBank(tw) 0.571 0.600 TGB team Paper, Code July 27th, 2023
5 EdgeBank(unlimited) 0.495 0.527 TGB team Paper, Code July 27th, 2023
6 TGN 0.396 ± 0.060 0.435 ± 0.069 TGB team Paper, Code August 7th, 2023
7 TCL 0.207 ± 0.025 0.198 ± 0.016 TGB team Paper, Code July 27th, 2023
8 TGAT 0.141 ± 0.007 0.131 ± 0.008 TGB team Paper, Code August 22th, 2023
9 GraphMixer 0.118 ± 0.002 0.113 ± 0.003 TGB team Paper, Code August 7th, 2023
10 DyRep 0.050 ± 0.017 0.072 ± 0.009 TGB team Paper, Code July 27th, 2023

Leaderboard for tgbl-review-v2

Please update your package >= 0.7.5. In version 2 of tgbl-review, we have included 100 negative destinations for each positive edge thus increasing the task difficulty. For submissions, please submit to this version. Previous version of the dataset leaderboard is tgbl-review-v1. The MRR score on the test and validation sets. The higher, the better.

Package: >=0.7.5

Rank Method Test MRR Validation MRR Contact References Date
1 GraphMixer 0.521 ± 0.015 0.428 ± 0.019 TGB team Paper, Code July 27th, 2023
2 TGAT 0.355 ± 0.012 0.324 ± 0.006 TGB team Paper, Code August 22th, 2023
3 TGN 0.349 ± 0.020 0.313 ± 0.012 TGB team Paper, Code July 27th, 2023
4 NAT 0.341 ± 0.020 0.302 ± 0.011 TGB team Paper, Code August 22nd, 2023
5 DyGFormer 0.224 ± 0.015 0.219 ± 0.017 Le Yu (Beihang University) Paper, Code September 21st, 2023
6 DyRep 0.220 ± 0.030 0.216 ± 0.031 TGB team Paper, Code July 27th, 2023
7 CAWN 0.193 ± 0.001 0.200 ± 0.001 TGB team Paper, Code July 27th, 2023
8 TCL 0.193 ± 0.009 0.199 ± 0.007 TGB team Paper, Code July 27th, 2023
9 EdgeBank(tw) 0.025 0.024 TGB team Paper, Code July 27th, 2023
10 EdgeBank(unlimited) 0.023 0.023 TGB team Paper, Code July 27th, 2023

Leaderboard for tgbl-coin-v2

Please update your package >= 0.9.0. In version 2 of tgbl-coin, we fixed an error where a small portion of edges are not sorted chronologically. For submissions, please submit to this version. Previous version of the dataset leaderboard is tgbl-coin-v1. The MRR score on the test and validation sets. The higher, the better.

Package: >=0.9.0

Rank Method Test MRR Validation MRR Contact References Date
1 TGN 0.586 ± 0.037 0.607 ± 0.014 TGB team Paper, Code September 27th, 2023
2 EdgeBank(tw) 0.580 0.492 TGB team Paper, Code September 27th, 2023
3 DyRep 0.452 ± 0.046 0.512 ± 0.014 TGB team Paper, Code September 27th, 2023
4 EdgeBank(unlimited) 0.359 0.315 TGB team Paper, Code September 27th, 2023

Leaderboard for tgbl-comment

The MRR score on the test and validation sets. The higher, the better.

Package: >=0.7.5

Rank Method Test MRR Validation MRR Contact References Date
1 DyGFormer 0.670 ± 0.001 0.613 ± 0.003 Le Yu (Beihang University) Paper, Code September 21st, 2023
1 TGN 0.379 ± 0.021 0.356 ± 0.019 TGB team Paper, Code June 7th, 2023
2 DyRep 0.289 ± 0.033 0.291 ± 0.028 TGB team Paper, Code June 7th, 2023
3 EdgeBank(tw) 0.149 0.124 TGB team Paper, Code June 7th, 2023
4 EdgeBank(unlimited) 0.129 0.109 TGB team Paper, Code June 7th, 2023

Leaderboard for tgbl-flight-v2

Please update your package >= 0.9.0. In version 2 of tgbl-flight, we fixed an error where a small portion of edges are not sorted chronologically. For submissions, please submit to this version. Previous version of the dataset leaderboard is tgbl-flight-v1. The MRR score on the test and validation sets. The higher, the better.

Package: >=0.9.0

Rank Method Test MRR Validation MRR Contact References Date
1 TGN 0.705 ± 0.020 0.731 ± 0.010 TGB team Paper, Code September 27th, 2023
2 DyRep 0.556 ± 0.014 0.573 ± 0.013 TGB team Paper, Code September 27th, 2023
3 EdgeBank(tw) 0.387 0.363 TGB team Paper, Code September 27th, 2023
4 EdgeBank(unlimited) 0.167 0.166 TGB team Paper, Code September 27th, 2023