| Solver | |||||||||||||||||||||||||||||||
| SAT/ | MiniSat | pMiniSat | Barce- logic |
Rsat | MXC | preSAT | CMUSAT | kw | picosat | Eureka | ManySat | Local- Minisat |
MiraXT | SATzilla | eSAT | Spear | Tinisat | clasp | SAT4J | ||||||||||||
| Instance | UNSAT | (32bit) | (64bit) | (64bit) | (32bit) | (32bit) | (32bit) | (64bit) | (32bit) | (32bit) | (64bit) | (32bit) | (32bit) | (32bit) | (32bit) | (32bit) | (32bit) | (32bit) | (32bit) | (64bit) | |||||||||||
| IBM Benchmark Suite (15 SAT / 5 UNSAT) | |||||||||||||||||||||||||||||||
| ibm-2002-04r-k80 | SAT | 17.2 | 16.4 | 67.8 | 49.8 | 58.8 | 94.1 | 48.4 | 107.5 | 26.7 | 77.5 | 95.8 | 38.0 | 27.6 | 107.6 | 87.7 | 65.9 | 59.1 | 485.7 | 83.9 | |||||||||||
| ibm-2002-11r1-k45 | SAT | 15.2 | 20.1 | 31.7 | 51.2 | 35.5 | 110.4 | 30.8 | 72.8 | 20.3 | 97.4 | 57.3 | 43.0 | 10.7 | 118.2 | 82.0 | 62.5 | 96.2 | 342.0 | 153.6 | |||||||||||
| ibm-2002-18r-k90 | SAT | 81.7 | 61.5 | 278.6 | 471.3 | 201.0 | 213.0 | 243.8 | ----- | 168.4 | 684.4 | 306.1 | 475.8 | 859.1 | ----- | 437.1 | ----- | ----- | ----- | ----- | |||||||||||
| ibm-2002-20r-k75 | SAT | 50.3 | 101.8 | 90.8 | 98.9 | 124.5 | 306.2 | 131.6 | 670.0 | 84.1 | 682.6 | 476.7 | 337.7 | 449.8 | 443.6 | 218.0 | ----- | 409.1 | ----- | ----- | |||||||||||
| ibm-2002-22r-k60 | UNSAT | 202.1 | 342.4 | 409.9 | 391.4 | 441.1 | 537.1 | 822.7 | 736.3 | 168.2 | ----- | 507.8 | ----- | ----- | ----- | 562.3 | ----- | ----- | ----- | ----- | |||||||||||
| ibm-2002-22r-k75 | SAT | 45.5 | 83.4 | 183.1 | 378.7 | 62.8 | 158.1 | 198.9 | 631.0 | 77.7 | 598.0 | 245.8 | 522.5 | 231.1 | 648.0 | 431.2 | 430.0 | 606.5 | ----- | 648.5 | |||||||||||
| ibm-2002-22r-k80 | SAT | 94.8 | 148.9 | 254.7 | 614.1 | 154.8 | 263.1 | 90.8 | 742.1 | 75.3 | ----- | 479.8 | 418.7 | 251.0 | 637.2 | 697.1 | 502.6 | 603.3 | ----- | 729.6 | |||||||||||
| ibm-2002-23r-k90 | SAT | 141.6 | 142.2 | 437.0 | 726.3 | 314.1 | ----- | 421.4 | ----- | 431.9 | ----- | ----- | ----- | 581.0 | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| ibm-2002-24r3-k100 | UNSAT | 125.6 | 228.5 | 148.8 | 255.3 | 154.7 | 233.6 | 256.3 | 157.5 | 163.3 | 204.9 | 203.3 | 155.2 | ----- | 283.6 | 212.4 | 215.5 | 254.1 | ----- | 226.1 | |||||||||||
| ibm-2002-25r-k10 | UNSAT | 668.4 | 399.0 | ----- | ----- | ----- | ----- | ----- | 535.8 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| ibm-2002-29r-k75 | SAT | 35.7 | 154.8 | 78.2 | 293.7 | 79.6 | 362.8 | 131.1 | 102.6 | 117.3 | ----- | 625.3 | 66.4 | 52.9 | 825.0 | 168.8 | 87.4 | 156.0 | ----- | 67.2 | |||||||||||
| ibm-2002-30r-k85 | SAT | ----- | 899.3 | ----- | ----- | ----- | ----- | 766.8 | ----- | ----- | ----- | ----- | ----- | ----- | 640.6 | ----- | ----- | ----- | ----- | ----- | |||||||||||
| ibm-2002-31_1r3-k30 | UNSAT | 143.1 | 402.5 | 154.2 | 226.1 | 374.4 | 857.8 | 811.1 | 326.9 | 673.2 | 307.5 | 466.2 | 822.5 | ----- | ----- | ----- | 548.4 | ----- | ----- | ----- | |||||||||||
| ibm-2004-01-k90 | SAT | 17.3 | 12.7 | 49.5 | 91.5 | 12.4 | 52.8 | 48.1 | 30.9 | 47.0 | 273.0 | 70.0 | 164.4 | 117.3 | 91.0 | 143.3 | 86.0 | 199.8 | ----- | 313.9 | |||||||||||
| ibm-2004-1_11-k80 | SAT | 52.8 | 38.6 | 286.7 | 422.7 | 60.2 | 131.5 | 258.0 | 311.0 | 178.6 | 177.1 | 564.7 | 230.7 | 77.7 | ----- | 403.5 | 330.1 | ----- | ----- | ----- | |||||||||||
| ibm-2004-23-k100 | SAT | 107.0 | 214.2 | 485.8 | ----- | 371.6 | ----- | 264.9 | ----- | 892.9 | ----- | ----- | ----- | 357.8 | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| ibm-2004-23-k80 | SAT | 259.7 | 143.2 | 193.7 | 461.2 | 91.2 | 221.2 | 453.5 | ----- | 160.5 | ----- | ----- | 397.1 | 86.1 | 718.6 | ----- | ----- | 681.9 | ----- | ----- | |||||||||||
| ibm-2004-29-k25 | UNSAT | 41.6 | 68.7 | 84.3 | 109.5 | 61.0 | 345.8 | 115.4 | 165.4 | 64.0 | 91.7 | 189.4 | 390.7 | 674.1 | 115.9 | 95.5 | 401.5 | ----- | 632.3 | ----- | |||||||||||
| ibm-2004-29-k55 | SAT | 26.4 | 10.5 | 21.9 | 86.7 | 83.2 | 109.5 | 30.9 | 81.9 | 94.3 | 242.0 | 77.8 | 116.9 | 13.6 | ----- | 240.6 | 83.2 | ----- | ----- | 64.7 | |||||||||||
| ibm-2004-3_02_3-k95 | SAT | 1.4 | 1.6 | 1.4 | 2.9 | 1.5 | 39.3 | 1.5 | 3.4 | 1.4 | 2.0 | 5.6 | 1.9 | 1.7 | 5.9 | 5.9 | 1.1 | 2.5 | 1.2 | 4.4 | |||||||||||
| Manolios Benchmark Suite (10 UNSAT) | |||||||||||||||||||||||||||||||
| manol-pipe-c10nid_i | UNSAT | 384.0 | 416.9 | 527.2 | 265.2 | 784.7 | 430.3 | ----- | 890.1 | ----- | ----- | 825.3 | 865.0 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| manol-pipe-c10nidw | UNSAT | 535.5 | ----- | 756.4 | 428.4 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| manol-pipe-c6bidw_i | UNSAT | 34.4 | 44.2 | 40.9 | 26.6 | 62.0 | 44.9 | 52.2 | 85.1 | 59.5 | 87.0 | 73.6 | 55.2 | 125.4 | 151.4 | 298.7 | 68.0 | 129.4 | 332.7 | 74.5 | |||||||||||
| manol-pipe-c8nidw | UNSAT | 204.0 | 207.5 | 265.6 | 167.7 | 306.5 | 273.5 | 431.1 | 724.8 | ----- | 347.8 | 521.8 | 435.9 | 807.3 | ----- | ----- | 889.8 | ----- | ----- | 476.4 | |||||||||||
| manol-pipe-c9n_i | UNSAT | 13.2 | 17.0 | 17.5 | 17.9 | 20.4 | 24.8 | 20.3 | 30.3 | 24.3 | 11.8 | 34.5 | 41.7 | 131.4 | 55.0 | 34.6 | 35.1 | 36.0 | 33.0 | 71.5 | |||||||||||
| manol-pipe-f7nidw | UNSAT | 493.5 | ----- | 70.7 | 59.2 | ----- | ----- | ----- | ----- | 255.0 | 45.1 | 149.0 | ----- | 203.6 | 156.9 | 227.9 | 358.4 | 116.9 | 421.0 | 419.2 | |||||||||||
| manol-pipe-f9b | UNSAT | 354.6 | 574.9 | 232.2 | 512.3 | 405.6 | 812.4 | 570.6 | ----- | ----- | 46.7 | 311.7 | ----- | ----- | 657.5 | 406.9 | ----- | 638.6 | 882.9 | ----- | |||||||||||
| manol-pipe-g10bid_i | UNSAT | 393.0 | 552.0 | 497.3 | 263.6 | 890.2 | 516.0 | ----- | ----- | ----- | ----- | 833.0 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| manol-pipe-g10nid | UNSAT | 150.8 | 145.8 | 69.2 | 132.4 | 102.7 | 178.9 | 161.5 | 214.0 | 87.6 | 78.5 | 151.2 | 173.9 | 456.4 | 258.1 | 404.9 | 486.8 | 236.2 | ----- | 296.6 | |||||||||||
| manol-pipe-g8nidw | UNSAT | 205.5 | 369.8 | 15.1 | 12.7 | 350.1 | 110.2 | 146.6 | 65.6 | 10.3 | 11.4 | 24.5 | 43.5 | 28.9 | 39.9 | 52.0 | 98.5 | 21.7 | 99.5 | 43.7 | |||||||||||
| Mironov-Zhang Benchmark Suite (10 SAT) | |||||||||||||||||||||||||||||||
| mizh-md5-47-3 | SAT | 19.9 | 238.7 | ----- | ----- | 91.9 | 58.8 | 403.2 | 48.2 | 116.9 | 806.5 | ----- | 190.9 | 124.0 | ----- | ----- | 124.2 | 878.5 | 106.8 | ----- | |||||||||||
| mizh-md5-47-4 | SAT | 39.9 | 357.9 | ----- | 266.6 | 55.3 | 359.5 | 85.3 | 87.9 | 92.6 | ----- | ----- | ----- | 292.0 | 353.4 | 589.7 | 96.6 | ----- | 507.0 | 713.1 | |||||||||||
| mizh-md5-47-5 | SAT | 475.0 | 100.1 | 716.9 | 669.8 | 290.5 | 356.2 | 96.9 | 203.6 | 153.0 | 565.3 | 619.4 | 105.1 | 27.3 | 345.3 | 492.4 | 214.4 | 93.9 | 35.8 | 222.5 | |||||||||||
| mizh-md5-48-2 | SAT | 124.1 | 268.6 | 224.8 | ----- | 129.5 | 56.8 | 259.1 | 115.9 | 103.3 | ----- | ----- | 643.7 | 432.9 | 461.9 | ----- | 604.4 | ----- | 202.1 | ----- | |||||||||||
| mizh-md5-48-5 | SAT | 93.3 | 700.1 | ----- | ----- | 71.8 | 81.0 | 213.8 | 272.9 | 118.5 | 805.7 | ----- | 549.9 | 387.9 | ----- | ----- | 143.9 | 224.0 | 866.6 | ----- | |||||||||||
| mizh-sha0-35-3 | SAT | 7.4 | 36.1 | 45.2 | 291.8 | 18.7 | 66.3 | 18.9 | 169.5 | 14.6 | 513.0 | ----- | 458.8 | 20.1 | 156.1 | 78.6 | 18.8 | 403.0 | 129.4 | 233.4 | |||||||||||
| mizh-sha0-35-4 | SAT | 9.4 | 208.1 | 60.4 | 342.4 | 355.5 | 28.8 | 100.7 | 114.1 | 119.5 | 596.6 | 103.8 | 36.7 | 98.4 | 94.8 | ----- | 72.6 | 307.6 | 278.8 | 292.4 | |||||||||||
| mizh-sha0-36-1 | SAT | 190.2 | ----- | 259.5 | 332.4 | 85.8 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 311.2 | 553.4 | 332.4 | ----- | ----- | |||||||||||
| mizh-sha0-36-3 | SAT | 68.8 | 336.9 | ----- | ----- | ----- | 195.7 | 153.0 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| mizh-sha0-36-4 | SAT | 367.6 | ----- | ----- | 164.5 | 768.3 | 13.9 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 742.0 | |||||||||||
| Post Benchmark Suite (2 SAT / 8 UNSAT) | |||||||||||||||||||||||||||||||
| post-c32s-col400-16 | UNSAT | 46.9 | 35.2 | 353.3 | 208.1 | 45.7 | 191.6 | 116.6 | 154.6 | 142.1 | 565.5 | 268.8 | 46.5 | 239.1 | 89.2 | 464.8 | 140.2 | 66.7 | 48.5 | 417.9 | |||||||||||
| post-c32s-gcdm16-22 | SAT | 102.9 | 147.8 | 120.9 | 33.9 | ----- | 126.6 | 302.3 | 254.1 | 120.1 | 193.8 | 361.7 | 197.5 | ----- | 761.5 | ----- | ----- | 762.1 | 361.9 | 506.5 | |||||||||||
| post-c32s-gcdm16-23 | UNSAT | 125.7 | 163.4 | 150.6 | 39.6 | ----- | 157.5 | 326.5 | 627.6 | 130.2 | 233.3 | 284.1 | 425.1 | ----- | ----- | ----- | ----- | ----- | 156.5 | ----- | |||||||||||
| post-c32s-ss-8 | UNSAT | ----- | 340.0 | ----- | ----- | ----- | ----- | 344.2 | 524.2 | ----- | ----- | ----- | 378.8 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| post-cbmc-aes-d-r1 | UNSAT | 2.8 | 5.0 | 4.0 | 3.6 | 2.6 | 8.4 | 2.5 | 3.5 | 3.0 | 4.8 | 4.6 | 3.0 | 4.2 | 6.0 | 3.7 | 1.9 | 3.8 | 5.3 | 5.1 | |||||||||||
| post-cbmc-aes-d-r2 | UNSAT | ----- | 680.9 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 281.2 | 811.6 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| post-cbmc-aes-ee-r2 | UNSAT | ----- | 799.7 | 772.2 | ----- | ----- | ----- | ----- | ----- | ----- | 284.8 | 731.9 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| post-cbmc-aes-ee-r3 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| post-cbmc-aes-ele | UNSAT | 19.7 | 44.2 | 45.3 | 35.9 | 24.3 | 95.6 | 34.0 | ----- | 64.5 | 38.2 | 47.7 | 289.8 | 84.8 | 79.4 | 22.9 | 537.3 | 54.2 | 168.0 | ----- | |||||||||||
| post-cbmc-zfcp-2.8-u2 | SAT | 85.4 | ----- | ----- | ----- | 66.2 | 15.4 | 109.9 | ----- | 64.6 | ----- | ----- | 54.7 | 37.6 | ----- | 85.6 | ----- | ----- | 33.9 | ----- | |||||||||||
| Velev Benchmark Suite (4 SAT / 6 UNSAT) | |||||||||||||||||||||||||||||||
| velev-engi-uns-1.0-4nd | UNSAT | 8.9 | 10.7 | 27.5 | 16.1 | 14.3 | 75.3 | 16.3 | 41.2 | 42.9 | 67.1 | 41.2 | 29.7 | 29.8 | 56.5 | 16.8 | 21.0 | 21.7 | 15.2 | 75.0 | |||||||||||
| velev-fvp-sat-3.0-b18 | SAT | 18.6 | 193.2 | 5.2 | 64.6 | 9.5 | 500.0 | 11.7 | ----- | 12.0 | 18.4 | 7.2 | ----- | 30.0 | 408.7 | 2.4 | ----- | 35.9 | 41.8 | 64.2 | |||||||||||
| velev-npe-1.0-9dlx-b71 | SAT | 106.3 | 169.5 | 763.4 | 767.0 | 208.5 | 5.8 | 578.9 | 872.4 | 98.4 | ----- | ----- | 44.2 | 655.8 | ----- | ----- | ----- | 449.6 | 17.1 | ----- | |||||||||||
| velev-vliw-sat-4.0-b4 | SAT | 45.9 | 21.2 | 182.5 | 340.1 | 72.5 | 4.1 | 69.8 | 156.9 | 91.3 | ----- | 96.7 | 29.2 | 24.0 | ----- | 414.9 | 47.4 | 46.2 | 10.6 | 199.9 | |||||||||||
| velev-vliw-sat-4.0-b8 | SAT | 68.6 | 33.3 | 93.5 | 273.3 | 40.6 | 4.1 | 91.3 | 151.9 | 100.6 | 698.7 | 84.0 | 42.7 | 34.5 | ----- | 143.6 | 55.5 | 84.5 | 10.5 | 257.3 | |||||||||||
| velev-vliw-uns-2.0-iq1 | UNSAT | ----- | ----- | 19.4 | 255.8 | ----- | ----- | ----- | 133.1 | ----- | 15.1 | 681.0 | ----- | ----- | ----- | 139.5 | ----- | 211.7 | 133.3 | ----- | |||||||||||
| velev-vliw-uns-2.0-iq2 | UNSAT | ----- | ----- | 66.1 | 368.0 | ----- | ----- | ----- | 652.2 | ----- | 64.4 | ----- | ----- | ----- | 159.3 | 319.1 | ----- | 778.5 | 416.7 | ----- | |||||||||||
| velev-vliw-uns-2.0-uq5 | UNSAT | ----- | ----- | 639.2 | ----- | ----- | ----- | ----- | ----- | ----- | 484.7 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| velev-vliw-uns-4.0-9-i1 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| velev-vliw-uns-4.0-9 | UNSAT | ----- | ----- | 561.0 | 359.6 | ----- | ----- | ----- | 489.1 | ----- | 161.4 | ----- | 608.7 | ----- | 474.9 | ----- | ----- | 303.3 | 283.9 | 578.2 | |||||||||||
| Mixed Benchmark Suite (17 SAT / 23 UNSAT) | |||||||||||||||||||||||||||||||
| aloul-chnl11-13 | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 132.0 | ----- | ----- | ----- | 814.3 | ----- | |||||||||||
| anbul-dated-5-15-u | UNSAT | 377.7 | 142.2 | 361.2 | 486.5 | 684.7 | 299.7 | ----- | 479.1 | ----- | ----- | 819.0 | ----- | ----- | ----- | 524.5 | 555.6 | ----- | ----- | ----- | |||||||||||
| anbul-part-10-13-s | SAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| anbul-part-10-15-s | SAT | 157.7 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| babic-dspam-vc1080 | UNSAT | 1.1 | 1.4 | 1.8 | 1.7 | 0.6 | 1.4 | 1.0 | 36.0 | 1.3 | 1.8 | 1.7 | 0.9 | 1.5 | 0.8 | 0.5 | 4.6 | 1.9 | 0.8 | 1.7 | |||||||||||
| babic-dspam-vc949 | UNSAT | 1.1 | 1.2 | 1.6 | 1.5 | 0.6 | 1.6 | 1.0 | 35.6 | 1.1 | 1.6 | 1.5 | 0.8 | 1.1 | 0.7 | 0.4 | 1.6 | 1.7 | 0.7 | 1.6 | |||||||||||
| babic-dspam-vc973 | UNSAT | 2.4 | 2.5 | 3.4 | 3.5 | 1.4 | 1.8 | 2.4 | 25.3 | 2.8 | 3.5 | 3.4 | 1.8 | 2.7 | 1.5 | 12.2 | 5.8 | 3.7 | 1.7 | 3.5 | |||||||||||
| cmu-bmc-barrel6 | UNSAT | 1.7 | 1.9 | 1.2 | 1.5 | 2.8 | 1.4 | 2.3 | 1.4 | 1.6 | 1.3 | 3.0 | 2.6 | 5.0 | 3.8 | 2.1 | 1.3 | 2.4 | 1.9 | 6.4 | |||||||||||
| cmu-bmc-longmult13 | UNSAT | 27.7 | 12.5 | 13.4 | 15.0 | 17.2 | 21.7 | 24.1 | 27.4 | 11.2 | 231.6 | 35.0 | 33.5 | 23.2 | 63.3 | 49.3 | 22.0 | 81.2 | 21.2 | 43.7 | |||||||||||
| cmu-bmc-longmult15 | UNSAT | 16.3 | 11.9 | 12.5 | 10.6 | 18.7 | 32.1 | 17.8 | 22.6 | 10.1 | 15.0 | 47.4 | 30.9 | 14.6 | 48.6 | 30.3 | 15.3 | 56.2 | 21.3 | 36.6 | |||||||||||
| een-pico-prop00-75 | UNSAT | 2.0 | 2.1 | 2.2 | 3.7 | 1.6 | 0.2 | 1.9 | 8.6 | 1.9 | 2.5 | 2.7 | 1.9 | 1.5 | 5.4 | 0.5 | 4.4 | 2.7 | 1.5 | 8.6 | |||||||||||
| een-pico-prop05-75 | UNSAT | 14.9 | 18.2 | 28.1 | 17.7 | 141.6 | 52.9 | 35.1 | 57.7 | 17.7 | 22.6 | 38.4 | 36.1 | 50.7 | 182.4 | 73.0 | 98.9 | 140.2 | 848.9 | 165.3 | |||||||||||
| een-tip-sat-nusmv-t5.B | SAT | 0.9 | 1.0 | 1.4 | 2.2 | 1.0 | 50.9 | 1.1 | 3.2 | 1.3 | 1.7 | 2.5 | 1.1 | 1.2 | 1.0 | 6.7 | 2.2 | 1.6 | 1.1 | 3.8 | |||||||||||
| een-tip-sat-texas-tp-5e | SAT | 0.1 | 0.2 | 0.2 | 0.3 | 0.1 | 0.5 | 0.2 | 0.6 | 0.1 | 0.3 | 0.3 | 0.1 | 0.1 | 0.1 | 0.2 | 0.3 | 0.3 | 0.1 | 0.5 | |||||||||||
| een-tip-sat-vis-eisen | SAT | 0.3 | 0.3 | 0.4 | 0.5 | 0.4 | 3.6 | 0.4 | 1.1 | 0.3 | 0.4 | 0.6 | 0.4 | 0.4 | 0.4 | 1.0 | 0.6 | 0.5 | 0.4 | 1.5 | |||||||||||
| fuhs-aprove-15 | UNSAT | 15.2 | 27.5 | 47.9 | 15.7 | 29.1 | 20.2 | 27.2 | 56.6 | 19.0 | 59.6 | 37.6 | 125.1 | 75.1 | 135.3 | 46.2 | 62.8 | 123.2 | 59.1 | 327.6 | |||||||||||
| fuhs-aprove-16 | UNSAT | 161.7 | 191.6 | 205.1 | 315.9 | 472.4 | 422.3 | 323.7 | ----- | 682.0 | 203.5 | 722.8 | 545.6 | ----- | ----- | 272.2 | 733.5 | 395.0 | 256.9 | ----- | |||||||||||
| goldb-heqc-alu4mul | UNSAT | 192.7 | 165.1 | 535.2 | 179.7 | 248.5 | 269.0 | 248.3 | 91.9 | 208.9 | 649.0 | 637.8 | 350.5 | 330.2 | 250.1 | 323.4 | 142.0 | ----- | 332.7 | ----- | |||||||||||
| goldb-heqc-dalumul | UNSAT | ----- | 814.8 | ----- | 848.9 | ----- | ----- | ----- | 73.4 | ----- | 175.6 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| goldb-heqc-frg1mul | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 10.1 | ----- | 133.5 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| goldb-heqc-x1mul | UNSAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 119.0 | ----- | 392.2 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| grieu-vmpc-27 | SAT | 129.7 | 19.8 | 545.3 | 55.4 | 860.6 | 79.8 | 75.0 | 397.3 | 8.1 | 525.6 | 250.2 | ----- | 55.5 | 60.9 | 508.1 | 741.9 | 41.8 | 9.2 | 441.1 | |||||||||||
| grieu-vmpc-31 | SAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 38.4 | ----- | ----- | 35.6 | 59.3 | ----- | ----- | ----- | ----- | |||||||||||
| hoons-vbmc-lucky7 | UNSAT | 1.0 | 1.4 | 1.4 | 1.0 | 1.4 | 3.5 | 2.9 | 22.1 | 0.7 | 2.2 | 3.5 | 3.0 | 22.5 | 6.2 | 3.9 | 6.1 | 3.7 | 35.6 | ----- | |||||||||||
| jarvi-eq-atree-9 | UNSAT | 149.3 | 60.3 | 61.9 | 84.2 | 66.6 | 134.1 | 87.0 | 238.0 | 33.7 | 578.9 | 240.2 | 574.9 | 65.1 | 160.6 | 163.8 | 85.5 | 756.1 | 51.5 | 537.0 | |||||||||||
| marijn-philips | UNSAT | ----- | ----- | 454.4 | ----- | 541.3 | ----- | ----- | ----- | 263.4 | ----- | ----- | ----- | 748.9 | 609.9 | ----- | ----- | ----- | 428.5 | ----- | |||||||||||
| maris-s03-gripper11 | SAT | ----- | 66.3 | ----- | 37.5 | 18.9 | ----- | ----- | ----- | 29.1 | 184.9 | 23.8 | ----- | ----- | 37.3 | ----- | ----- | ----- | ----- | ----- | |||||||||||
| narain-vpn-clauses-10 | SAT | 73.2 | ----- | 90.6 | 187.3 | 68.7 | 173.3 | 87.5 | 277.7 | 96.1 | 432.3 | 365.8 | 134.0 | 173.6 | 150.4 | 128.2 | 128.7 | 247.3 | ----- | 507.0 | |||||||||||
| narain-vpn-clauses-8 | SAT | 828.0 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| palac-sn7-ipc5-h16 | SAT | 284.9 | 331.4 | 120.5 | 43.7 | 123.7 | 74.0 | 549.4 | 549.5 | 472.5 | 295.4 | 155.7 | 51.5 | 318.5 | 401.0 | ----- | 307.9 | ----- | ----- | 614.2 | |||||||||||
| palac-uts-l06-ipc5-h34 | SAT | 18.1 | 34.8 | 20.2 | 18.3 | 22.5 | 77.8 | 49.3 | 123.1 | 11.5 | 16.9 | 31.5 | 45.3 | 41.3 | 104.3 | 42.8 | 24.8 | 29.6 | 237.7 | 152.3 | |||||||||||
| schup-l2s-abp4-1-k31 | UNSAT | 8.2 | 12.9 | 15.9 | 13.9 | 11.3 | 57.5 | 20.2 | 27.1 | 19.4 | 23.9 | 35.9 | 36.3 | 45.7 | 81.7 | 33.3 | 36.0 | 227.3 | 98.5 | 317.8 | |||||||||||
| schup-l2s-bc56s-1-k391 | UNSAT | 514.9 | 720.0 | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| schup-l2s-motst-2-k315 | SAT | 23.6 | 26.6 | 49.9 | 65.6 | 99.1 | 123.7 | 32.5 | 254.8 | 29.9 | 56.7 | 110.2 | 24.7 | 45.5 | 514.8 | 459.3 | 282.4 | ----- | 449.0 | 197.7 | |||||||||||
| simon-s02-f2clk-50 | UNSAT | 172.2 | 220.8 | 706.3 | 130.7 | 206.0 | 290.8 | 360.6 | 398.8 | ----- | 404.8 | 410.2 | 381.9 | ----- | ----- | ----- | 483.5 | ----- | ----- | ----- | |||||||||||
| simon-s02b-r4b1k1.1 | SAT | 145.6 | 230.2 | 112.8 | 177.3 | 464.0 | 265.4 | 10.5 | 690.5 | 156.0 | 522.9 | 261.8 | 669.3 | 273.5 | 141.2 | ----- | 71.8 | 106.0 | ----- | ----- | |||||||||||
| simon-s02b-r4b1k1.2 | SAT | 106.4 | 259.9 | 147.4 | 467.9 | 108.5 | 527.5 | 79.5 | 562.7 | 152.7 | 850.5 | 815.7 | ----- | ----- | 155.6 | 122.1 | 205.1 | ----- | 784.3 | ----- | |||||||||||
| simon-s03-fifo8-400 | UNSAT | 35.0 | 30.1 | 44.4 | 55.9 | 101.5 | 98.3 | 52.8 | 78.0 | 30.7 | 92.8 | 58.2 | 81.1 | 90.0 | 142.9 | 287.3 | 114.3 | 114.9 | 234.1 | 133.8 | |||||||||||
| simon-s03-w08-15 | SAT | 74.0 | 83.1 | 41.9 | 106.6 | 114.9 | 213.3 | 50.8 | 194.9 | 51.7 | 80.6 | 186.5 | 119.8 | 51.1 | 679.1 | 316.0 | 94.2 | 624.0 | ----- | 631.2 | |||||||||||
| vange-col-abb313GPIA-9-c | SAT | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | 104.9 | ----- | ----- | ----- | 31.2 | ----- | ----- | ----- | ----- | ----- | ----- | |||||||||||
| #solved: | 81 | 79 | 77 | 76 | 74 | 72 | 72 | 70 | 70 | 69 | 68 | 64 | 63 | 60 | 60 | 60 | 56 | 54 | 49 | ||||||||||||
| #solved SAT/UNSAT: | 43/38 | 39/40 | 35/42 | 36/40 | 40/34 | 38/34 | 40/32 | 32/38 | 40/30 | 29/40 | 30/38 | 32/32 | 37/26 | 30/30 | 29/31 | 30/30 | 28/28 | 23/31 | 26/23 | ||||||||||||
| rank by solved: | 1 | 2 | 3 | 4 | 5 | 6 | 6 | 8 | 8 | 10 | 11 | 12 | 13 | 14 | 14 | 14 | 17 | 18 | 19 | ||||||||||||
| speed points: | 7.26 | 5.61 | 5.10 | 5.04 | 4.79 | 4.73 | 4.72 | 5.19 | 5.16 | 5.44 | 3.99 | 3.68 | 4.26 | 4.18 | 3.81 | 3.32 | 3.08 | 3.19 | 2.43 | ||||||||||||
| rank by speed: | 1 | 2 | 6 | 7 | 8 | 9 | 10 | 4 | 5 | 3 | 13 | 15 | 11 | 12 | 14 | 16 | 18 | 17 | 19 | ||||||||||||
| total score: | 88.26 | 84.61 | 82.10 | 81.04 | 78.79 | 76.73 | 76.72 | 75.19 | 75.16 | 74.44 | 71.99 | 67.68 | 67.26 | 64.18 | 63.81 | 63.32 | 59.08 | 57.19 | 51.43 | ||||||||||||
| rank: | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | ||||||||||||