| Solver | |||||||||
| SAT/ | Mini- Sat++ |
pico- aigersat | MiniCirc | CMUSAT-AIG | kw_aiger | NFLSAT | |||
| Instance | UNSAT | (32bit) | (32bit) | (64bit) | (64bit) | (32bit) | (64bit) | ||
| Anbulagan Benchmark Suite (3 SAT / 7 UNSAT) | |||||||||
| dated-10-11-u | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| dated-10-15-u | UNSAT | 16.7 | 183.12 | 38.33 | 285.76 | 49.66 | 101.6 | ||
| dated-5-19-u | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| partial-10-11-u | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| partial-10-13-u | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| partial-5-11-s | SAT | 401.31 | 155.32 | 46.8 | 665.93 | ----- | 541.99 | ||
| partial-5-13-s | SAT | 56.24 | 500.16 | 123.03 | 202.11 | 216.41 | ----- | ||
| partial-5-15-u | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| partial-5-17-s | SAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| total-5-11-u | UNSAT | 15.15 | 114.03 | 28.14 | 164.38 | 47.48 | 68.88 | ||
| Babic Benchmark Suite (2 SAT / 8 UNSAT) | |||||||||
| dspam_dump_vc1093 | UNSAT | 4.33 | 4.64 | 5.41 | 4.7 | 23.15 | 6.58 | ||
| dspam_dump_vc1104 | UNSAT | 15.23 | 11.4 | 15.32 | 83.43 | 29.05 | 41.27 | ||
| dspam_dump_vc950 | UNSAT | 4.51 | 5.11 | 5.7 | 4.98 | 10.95 | 127.71 | ||
| dspam_dump_vc962 | UNSAT | 4.34 | 4.99 | 5.15 | 4.73 | 10.41 | 113.64 | ||
| dspam_dump_vc972 | UNSAT | 14.66 | 11.71 | 14.93 | 13.46 | 28.32 | 27.68 | ||
| hsat_vc11773 | UNSAT | 5.76 | 5.42 | 9.36 | 5.04 | 11.04 | 7.91 | ||
| hsat_vc11813 | UNSAT | 8.94 | 7.06 | 12.3 | 6.3 | 13.68 | 10.8 | ||
| itox_vc1033 | SAT | 5.16 | 4.15 | 6.27 | 5.84 | 18.99 | 5.22 | ||
| itox_vc1044 | SAT | 5.52 | 4.4 | 7.8 | 6.1 | 20 | 7.02 | ||
| itox_vc965 | UNSAT | 2.93 | 0.95 | 4.5 | 1.76 | 3.96 | 4.96 | ||
| C32SAT Benchmark Suite (10 UNSAT) | |||||||||
| ssort11 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| ssort13 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| ssort16 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| ssort17 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| ssort18 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| ssort19 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| ssort20 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| ssort5 | UNSAT | 5.42 | 376.39 | 4.97 | 5.73 | 19.69 | 115.38 | ||
| ssort6 | UNSAT | 22.83 | ----- | 21.91 | 38.64 | 59.03 | ----- | ||
| ssort7 | UNSAT | 131.33 | ----- | 115.54 | 90.06 | 167.76 | ----- | ||
| Mironov-Zhang Benchmark Suite (10 SAT) | |||||||||
| mizh-md5-47-3 | SAT | 179.45 | 244.63 | ----- | 319.66 | ----- | 456.65 | ||
| mizh-md5-47-4 | SAT | 167.64 | 231.56 | 76.77 | 301.71 | 178.49 | 99 | ||
| mizh-md5-47-5 | SAT | 48.97 | 272.07 | 135.65 | 208.4 | 443.07 | 751.99 | ||
| mizh-md5-48-2 | SAT | 419.67 | 559.57 | ----- | 229.48 | ----- | 538.66 | ||
| mizh-md5-48-5 | SAT | 338.67 | ----- | ----- | 95.15 | 761.45 | 515.02 | ||
| mizh-sha0-35-2 | SAT | 16.65 | 168.26 | 258.11 | 196.62 | 56.46 | 148.73 | ||
| mizh-sha0-35-3 | SAT | 241.92 | 430.49 | 31.46 | 22.57 | 389.54 | 34.55 | ||
| mizh-sha0-35-4 | SAT | 71.95 | ----- | 416.24 | 63.41 | 137.23 | 43.24 | ||
| mizh-sha0-35-5 | SAT | 21.47 | 254.31 | 164.52 | 117.33 | 209.27 | 36.03 | ||
| mizh-sha0-36-2 | SAT | 523.6 | ----- | ----- | 280.91 | ----- | ----- | ||
| IBM Benchmark Suite (5 SAT / 5 UNSAT) | |||||||||
| ibm18_len28_unsat | UNSAT | 6.8 | 12.79 | 6.71 | 21.26 | 32.71 | 18.95 | ||
| ibm18_len29_sat | SAT | 4.67 | 17.28 | 7.25 | 5.79 | 34.81 | 19.94 | ||
| ibm20_len43_unsat | UNSAT | 54.49 | 71.69 | 36.11 | 106.57 | 142.47 | 85.44 | ||
| ibm20_len44_sat | SAT | 43.53 | 35.01 | 40.41 | 57.88 | 105.01 | 32.78 | ||
| ibm22_len51_unsat | UNSAT | 18.53 | 31.72 | 16.42 | 57.79 | 83.29 | 47.94 | ||
| ibm22_len52_sat | SAT | 20.84 | 43.66 | 20.87 | 60.06 | 78.02 | 62.36 | ||
| ibm23_len35_unsat | UNSAT | 31.27 | 73.94 | 42.26 | 109.22 | 102.13 | 78.76 | ||
| ibm23_len36_sat | SAT | 17.9 | 91.16 | 43.44 | 176.02 | 82.89 | 65.29 | ||
| ibm29_len25_unsat | UNSAT | 5.61 | 46.88 | 6.22 | 34.08 | 20.15 | 18.28 | ||
| ibm29_len26_sat | SAT | 2.82 | 18.02 | 2.66 | 17.36 | 11.66 | 2.82 | ||
| Intel Benchmark Suite (10 SAT) | |||||||||
| intel_003_k-ind_30 | SAT | 7.77 | 1.4 | 6.3 | 8.73 | 16.13 | 15.68 | ||
| intel_009_k-ind_20 | SAT | ----- | 75.68 | ----- | ----- | ----- | ----- | ||
| intel_014_k-ind_20 | SAT | ----- | 22.62 | ----- | ----- | ----- | ----- | ||
| intel_019_k-ind_10 | SAT | 3.82 | 1.59 | 4.88 | 3.6 | 18.3 | 3.37 | ||
| intel_025_k-ind_20 | SAT | 21.52 | 6.24 | 32.33 | 59.45 | ----- | 144.35 | ||
| intel_027_k-ind_20 | SAT | ----- | 78.92 | ----- | 253.19 | ----- | ----- | ||
| intel_028_k-ind_20 | SAT | ----- | 118.69 | ----- | ----- | ----- | ----- | ||
| intel_032_k-ind_10 | SAT | 15.57 | 2.25 | 13.55 | 7.85 | 63.92 | 7.43 | ||
| intel_037_k-ind_30 | SAT | ----- | 190.64 | ----- | ----- | ----- | ----- | ||
| intel_041_k-ind_10 | SAT | ----- | 59.76 | ----- | 40.66 | ----- | 54.45 | ||
| Manolios Benchmark Suite (10 UNSAT) | |||||||||
| manol-pipe-c10nidw_s | UNSAT | 20.12 | 10.49 | 14.67 | 16.53 | 493.6 | 305.69 | ||
| manol-pipe-c6nidw_i | UNSAT | 31.18 | 293.91 | 34.3 | 53.08 | 208.67 | ----- | ||
| manol-pipe-c7bidw_i | UNSAT | 65.42 | ----- | 57.7 | 110.58 | 647.43 | ----- | ||
| manol-pipe-c7nidw | UNSAT | 99.55 | 737.63 | 64.64 | 167.59 | 883.92 | ----- | ||
| manol-pipe-f10ni | UNSAT | 798.14 | ----- | 646.99 | ----- | ----- | ----- | ||
| manol-pipe-f7idw | UNSAT | 203.2 | 133.07 | 808.55 | ----- | ----- | ----- | ||
| manol-pipe-f9b | UNSAT | 262.25 | ----- | 360.52 | 587.12 | ----- | ----- | ||
| manol-pipe-f9n | UNSAT | 221.11 | ----- | 364.63 | 635.46 | ----- | ----- | ||
| manol-pipe-g10bidw | UNSAT | 188.08 | 366.71 | 126.66 | ----- | ----- | ----- | ||
| manol-pipe-g10nid | UNSAT | 118.94 | 349.1 | 44.28 | ----- | 597.09 | ----- | ||
| Palacios Benchmark Suite (2 SAT / 9 UNSAT) | |||||||||
| blocks-4-ipc5-h21-unknown | UNSAT | 15.07 | 95.72 | 20.81 | 31.79 | 138.88 | 64.2 | ||
| blocks-4-ipc5-h22-unknown | UNSAT | 28.76 | 198.11 | 19.12 | 65.96 | 329.8 | 71.03 | ||
| cube-9-h10-unsat | UNSAT | 11.53 | 513.89 | 49.88 | 224.11 | 39.18 | 43.31 | ||
| emptyroom-4-h21-unsat | UNSAT | 189.03 | 689.54 | 266.86 | ----- | ----- | 765.39 | ||
| safe-50-h49-unsat | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| sortnet-7-ipc5-h16-sat | SAT | 40.64 | 225.35 | 153.55 | 196.43 | ----- | 272.31 | ||
| uts-l05-ipc5-h26-unsat | UNSAT | 7.61 | 27.81 | 5.52 | 26.68 | 70.35 | 34.02 | ||
| uts-l06-ipc5-h30-unknown | UNSAT | 24 | 150.46 | 13.98 | 97.89 | 662.82 | 77.99 | ||
| uts-l06-ipc5-h31-unknown | UNSAT | 33.21 | 165.72 | 18.36 | 125.8 | 462.21 | 166.37 | ||
| uts-l06-ipc5-h33-unknown | UNSAT | 47.82 | 402.74 | 76.93 | 827.83 | 715.58 | ----- | ||
| uts-l06-ipc5-h35-unknown | SAT | 18.27 | 107.33 | 8.54 | 28.79 | 125.71 | 27.79 | ||
| Mixed Benchmark Suite (8 SAT / 9 UNSAT / 2 unknown) | |||||||||
| AProVE07-08 | UNSAT | 801.4 | ----- | ----- | ----- | ----- | ----- | ||
| AProVE07-15 | UNSAT | 13.86 | 90.14 | 23.79 | 39.35 | 58.79 | 43.61 | ||
| AProVE07-20 | UNSAT | 248.38 | 175.83 | 185.28 | 114.15 | 266.02 | 233.34 | ||
| AProVE07-26 | unknown | ----- | ----- | ----- | ----- | ----- | ----- | ||
| AProVE07-27 | unknown | ----- | ----- | ----- | ----- | ----- | ----- | ||
| clauses-2 | SAT | 1.77 | 2.32 | 2 | 3.8 | 3.48 | 1.8 | ||
| clauses-4 | SAT | 13.79 | 36.17 | 12.22 | 41.98 | 33.6 | 21.29 | ||
| clauses-6 | SAT | 107.23 | 390.37 | 49.59 | 226.7 | 237.94 | 185.35 | ||
| clauses-8 | SAT | ----- | ----- | 227.19 | ----- | 891.06 | ----- | ||
| eq.atree.braun.11.unsat | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| eq.atree.braun.12.unsat | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ||
| eq.atree.braun.7.unsat | UNSAT | 3.71 | 2.56 | 3.17 | 2.88 | 3.88 | 2.2 | ||
| eq.atree.braun.8.unsat | UNSAT | 43.29 | 13.13 | 30.09 | 21.97 | 27.94 | 14.03 | ||
| fvp-unsat.2.0.5pipe_1_ooo.1 | UNSAT | 22.39 | 90.14 | 94.81 | 18.32 | 19.32 | 18.87 | ||
| vis.prodcell-24-E-50 | UNSAT | 11.03 | 24.58 | 13.93 | 24.99 | 42.29 | 15.48 | ||
| vmpc_24 | SAT | 6.63 | 308.51 | 21.92 | 5.9 | 3.71 | 15.18 | ||
| vmpc_25 | SAT | 31.31 | 730.81 | 44.77 | 62.54 | 41.52 | 10.43 | ||
| vmpc_28 | SAT | 216.43 | ----- | 47.78 | 48.31 | ----- | 289.11 | ||
| vmpc_31 | SAT | ----- | ----- | ----- | ----- | 483.29 | ----- | ||
| #solved: | 74 | 69 | 70 | 70 | 62 | 60 | |||
| #solved SAT/UNSAT: | 31/43 | 33/36 | 28/42 | 33/37 | 26/36 | 30/30 | |||
| rank by solved: | 1 | 4 | 2 | 2 | 5 | 6 | |||
| speed points: | 12.98 | 13.80 | 12.29 | 11.85 | 9.18 | 9.34 | |||
| rank by speed: | 2 | 1 | 3 | 4 | 6 | 5 | |||
| total score: | 86.98 | 82.80 | 82.29 | 81.85 | 71.18 | 69.34 | |||
| rank: | 1 | 2 | 3 | 4 | 5 | 6 | |||