International Planning Competition 2018
Classical Track Scores

Optimal Track

Coverage Agricola Caldera Data Network Nurikabe Organic Synthesis Petri Net Alignment Settlers Snake Spider Termes SUM
Delfi1 12 13 13 12 13 20 9 11 11 12 126
Complementary2 6 12 12 12 13 18 9 14 12 16 124
Complementary1 10 11 14 13 13 17 8 11 11 16 124
Planning-PDBs 6 12 14 11 13 18 8 13 11 16 122
Baseline: symbolic-bidirectional 15 10 13 11 13 19 8 4 7 18 118
Scorpion 2 12 14 13 13 0 10 14 17 14 109
Delfi2 11 11 13 11 13 9 8 7 7 15 105
FDMS2 14 12 9 12 13 2 8 11 11 12 104
FDMS1 9 12 10 12 13 2 9 11 11 12 101
DecStar 0 8 14 11 14 8 8 11 13 12 99
Metis1 0 13 12 12 14 9 9 7 11 6 93
MSP 7 8 13 8 12 10 0 11 6 16 91
Metis2 0 15 12 12 14 9 0 7 12 6 87
Baseline: blind 0 8 7 11 10 7 8 12 11 10 84
Symple-2 1 8 9 7 13 2 0 0 5 13 58
Symple-1 0 8 9 8 13 2 0 0 4 13 57
maplan-2 2 2 9 0 6 0 0 14 1 12 46
maplan-1 0 2 12 0 6 0 0 7 10 6 43

Satisficing Track

Score Agricola Caldera Data Network flashfill Nurikabe Organic Synthesis Settlers Snake Spider Termes SUM
Fast Downward Stone Soup 2018 13.49 13.97 10.73 13.74 18.43 9.75 16.6 7.20 10.67 8.68 123.27
Fast Downward Remix 13.56 14.92 10.58 12.85 18.61 9.00 16.21 7.24 10.78 6.95 120.69
LAPKT-DUAL-BFWS 12.71 17.94 11.79 16.66 14.79 11.75 6.73 9.34 12.12 5.80 119.62
Saarplan 14.48 11.76 12.47 13.56 16.64 11.00 9.90 8.36 10.93 7.77 116.87
DecStar 12.42 13.64 9.99 13.74 12.42 9.75 15.68 4.03 12.79 6.75 111.21
Cerberus 10.62 10.92 11.71 9.74 15.50 12.0 9.87 5.72 13.94 7.94 107.95
Baseline: LAMA 2011 9.53 13.90 7.48 13.74 10.59 12.0 15.76 3.55 13.42 7.58 107.56
LAPKT-BFWS-Preference 10.99 15.94 8.18 11.74 12.63 7.00 8.43 15.78 10.29 5.46 106.44
Cerberus-gl 10.62 10.92 11.71 9.74 15.50 12.0 9.11 5.72 14.16 6.64 106.13
OLCFF 13.74 11.76 12.19 0.82 17.92 9.00 0 7.62 11.24 7.79 92.09
LAPKT-POLYNOMIAL-BFWS 13.30 17.84 11.92 8.82 10.65 5.00 9.62 2.33 8.63 2.10 90.20
IBaCoP-2018 10.83 5.83 14.66 0 6.40 8.75 0 7.95 8.80 10.33 73.56
IBaCoP2-2018 11.82 5.95 11.53 0 7.18 8.00 0 7.91 7.20 7.23 66.84
MERWIN 10.83 0 10.10 0 5.82 12.0 0 4.94 11.54 7.71 62.93
mercury2014 12.71 0 8.67 0 5.82 11.00 0 3.52 12.23 7.69 61.65
LAPKT-DFS+ 10.55 12.80 6.72 1.00 5.00 5.00 7.81 4.21 7.79 0 60.89
fs-sim 11.47 5.95 5.16 0 10.47 4.00 0 7.94 4.70 3.90 53.60
fs-blind 3.00 6.00 5.47 0 12.14 4.00 0 7.06 5.32 7.33 50.32
freelunch-doubly-relaxed 7.99 1.57 0.19 0 0 6.00 0 5.57 0.72 0 22.04
freelunch-madagascar 0 2.32 1.96 0 3.00 8.00 0 1.00 0 0 16.27
Symple-2 1.00 2.00 0 0 2.00 5.00 0 0 0 1.00 11.00
Symple-1 1.00 2.00 0 0 2.00 5.00 0 0 0 1.00 11.00
alien 4.24 0 1.12 0 0 4.00 0 0 0 0 9.36

Agile Track

Score Agricola Caldera Data Network flashfill Nurikabe Organic Synthesis Settlers Snake Spider Termes SUM
LAPKT-BFWS-Preference 2.25 6.86 6.12 8.81 7.54 3.87 2.37 8.87 5.57 3.81 56.08
Baseline: LAMA 2011 0.78 6.62 7.55 7.38 6.26 2.91 7.06 1.96 4.57 7.57 52.67
Saarplan 1.43 6.57 9.54 3.41 7.52 1.89 3.78 3.81 2.02 6.33 46.30
LAPKT-DUAL-BFWS 1.62 7.65 4.38 7.98 7.09 4.76 1.68 3.75 4.17 3.10 46.19
Fast Downward Remix 1.16 6.11 6.62 6.04 7.09 3.29 5.58 1.58 1.45 5.36 44.27
LAPKT-POLYNOMIAL-BFWS 2.23 7.55 5.44 6.66 7.40 2.81 1.77 2.51 4.78 1.86 43.01
DecStar 1.41 5.85 5.29 3.90 6.39 2.28 5.62 1.79 2.56 6.27 41.35
OLCFF 1.26 6.60 9.14 0.44 7.44 1.75 0 3.78 1.71 6.03 38.15
Cerberus 0.48 5.89 4.83 2.35 7.42 1.54 1.72 2.65 0.68 6.80 34.38
Cerberus-gl 0.42 5.78 4.83 2.35 7.46 1.56 1.72 2.57 0.69 3.58 30.96
LAPKT-DFS+ 2.45 6.55 1.90 0.28 4.13 2.05 2.65 0.66 3.47 0 24.15
mercury2014 1.13 0 7.06 0 1.09 2.47 0 1.92 3.41 6.43 23.50
fs-blind 0.48 3.37 2.36 0 7.38 0.23 0 4.73 1.49 3.43 23.48
fs-sim 2.53 3.32 3.16 0 6.50 0.44 0 2.67 1.14 2.99 22.75
MERWIN 0.89 0 6.97 0 1.07 2.52 0 1.77 2.78 5.73 21.74
freelunch-doubly-relaxed 1.06 0.90 3.36 0 0 1.25 0 10.84 1.76 0 19.16
IBaCoP-2018 0.27 0.44 1.52 0 0.09 0.97 0 0.43 0 0.78 4.52
freelunch-madagascar 0 1.44 0.81 0 0.57 1.04 0 0 0 0 3.86
alien 0.56 0 1.10 0 0 1.84 0 0 0 0 3.49
IBaCoP2-2018 0.26 0.15 1.10 0 0.00 0.49 0 0.41 0 0.59 2.99
Symple-2 0 0.06 0 0 0.39 1.65 0 0 0 0 2.10
Symple-1 0 0.14 0 0 0.50 1.45 0 0 0 0 2.08

Cost-Bounded Track

Coverage Agricola Caldera Data Network Nurikabe Settlers Snake Spider Termes SUM
Fast Downward Stone Soup 2018 8 16 8 15 14 9 9 8 87
Fast Downward Remix 8 13 10 14 14 10 10 7 86
Saarplan 9 12 7 11 10 9 7 8 73
LAPKT-DUAL-BFWS 6 17 9 6 7 10 6 3 64
Baseline: LAMA 2011 8 9 9 7 10 5 6 8 62
Complementary2 8 10 3 10 5 10 9 6 61
Cerberus-gl 3 8 7 11 9 8 7 5 58
Cerberus 2 8 7 11 9 8 7 5 57
Planning-PDBs 5 7 3 9 5 7 10 6 52
DecStar 5 8 2 10 8 5 8 5 51
Complementary1 6 8 2 12 4 5 8 6 51
OLCFF 5 12 4 12 0 10 5 1 49
MERWIN 8 0 9 4 0 6 4 3 34
Symple-2 0 2 0 2 0 0 2 4 10
Symple-1 0 2 0 2 0 0 2 4 10