SAT-Race 2015
Results
Sat Conference presentation slides.
Incremental Track
Detailed results and logs for the incremental track: incr.zip.
Winners:
- 1st Prize - CryptoMinisat
- 1st Prize - COMiniSatPS
- 3rd Prize - Glucose
| Essentials | HWMC | Portfolio | PMaxSat | |||||
|---|---|---|---|---|---|---|---|---|
| Rank | Solver | #s | Solver | #s | Solver | #s | Solver | #s |
| 1 | glucose | 48 | CryptoMiniSat | 1454 | COMiniSatPS-earth | 12 | CryptoMiniSat-auto | 271 |
| 2 | CryptoMiniSat | 48 | CryptoMiniSat-auto | 1452 | satuzk | 5 | CryptoMiniSat | 266 |
| 3 | CryptoMiniSat-auto | 47 | COMiniSatPS-sun | 1434 | picosat961 | 5 | glucose | 259 |
| 4 | COMiniSatPS-sun | 45 | glucose | 1407 | COMiniSatPS-sun | 5 | COMiniSatPS-sun | 250 |
| 5 | COMiniSatPS-earth | 45 | COMiniSatPS-earth | 1406 | riss 505 | 4 | riss 504 | 244 |
| 6 | riss 505 | 44 | riss 505 | 1372 | riss 504 | 2 | COMiniSatPS-earth | 244 |
| 7 | riss 504 | 44 | riss 504 | 1370 | glucose | 1 | riss 505 | 234 |
| 8 | picosat961 | 44 | picosat961 | 1285 | CryptoMiniSat-auto | 0 | satuzk | 204 |
| 9 | satuzk | 43 | satuzk | 842 | CryptoMiniSat | 0 | picosat961 | 165 |
Parallel Track
Detailed results and logs for the parallel track: para.zip
| glucose-update | 78 |
| treengeling | 73 |
| plingeling | 73 |
| cbpenelope | 66 |
| glucose-default | 62 |
| satuzk | 38 |
| pcasso-bb | 37 |
| pcasso | 37 |
| CryptoMiniSat-autotune | 32 |
| paraglueminisat | 29 |
| CryptoMiniSat | 29 |
Main Track
Detailed runtimes for solvers and benchmarks: main.zip, separeted by SAT and UNSAT instances: res-sat-unsat.zip.
| Solver | R1 | R2 | R3 | R4 | R5 | Avg. |
| abcdSAT,default | 261 | 261 | 261 | 261 | 261 | 261 |
| minisat_BCD,default | 256 | 256 | 256 | 257 | 257 | 256.4 |
| riss_505,blackbox | 248 | 248 | 249 | 252 | 250 | 249.4 |
| COMiniSatPS_Subdwarf,Subdwarf | 247 | 247 | 246 | 247 | 247 | 246.8 |
| COMiniSatPS_Main_Sequence,MainSequence | 246 | 247 | 246 | 247 | 246 | 246.4 |
| Lingeling_sr15baq,lingeling-sr15baq | 244 | 245 | 245 | 244 | 245 | 244.6 |
| GlueMiniSat_2.2.10,default | 244 | 244 | 243 | 244 | 244 | 243.8 |
| CryptoMiniSat-autotune,default | 242 | 243 | 242 | 242 | 241 | 242 |
| Lingeling_sr15bal,lingeling-sr15bal | 242 | 242 | 241 | 241 | 241 | 241.4 |
| BreakIDGlucose2,default | 241 | 241 | 240 | 241 | 241 | 240.8 |
| GlueMiniSat_2.2.10-5,default | 239 | 241 | 240 | 240 | 243 | 240.6 |
| ADS-glucose-adapt,default | 239 | 240 | 241 | 241 | 241 | 240.4 |
| riss_505,default | 237 | 238 | 237 | 239 | 239 | 238 |
| CryptoMiniSat,default | 237 | 238 | 238 | 237 | 237 | 237.4 |
| Glucose_nbSatRsltn,default | 235 | 236 | 236 | 235 | 236 | 235.6 |
| glucose-community-switching,default | 235 | 234 | 235 | 235 | 236 | 235 |
| glueminisat-Actmini,default | 234 | 235 | 235 | 235 | 236 | 235 |
| or-tools,script.sh | 234 | 234 | 234 | 234 | 234 | 234 |
| CCAglucose2015,default.sh | 232 | 232 | 232 | 232 | 232 | 232 |
| multi-sat-g2_0,default | 232 | 232 | 232 | 232 | 232 | 232 |
| glucose-default,default | 231 | 232 | 231 | 233 | 232 | 231.8 |
| Glucose_nbSat,default | 231 | 232 | 232 | 232 | 232 | 231.8 |
| multi-sat-g2_2,default | 229 | 230 | 229 | 230 | 231 | 229.8 |
| Nigma-1.2.86,default | 229 | 229 | 228 | 227 | 227 | 228 |
| Nigma-1.2.87,default | 226 | 227 | 227 | 226 | 227 | 226.6 |
| dccaSatToRiss,default | 215 | 214 | 214 | 215 | 215 | 214.6 |
| satUZK-seq,default | 165 | 166 | 166 | 166 | 166 | 165.8 |
| ratselfax_cnf_215_final,ratselfax_cnf_final | 83 | 85 | 84 | 82 | 82 | 83.2 |