SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT03/handmade/bevan/cnf/ marg3x3add8.shuffled-as.sat03-1449.cnf	UNSAT	0.000999	0.0058731	3499568
SAT02/handmade/chu-min-li/urquhart/ urquhart3_25bis.shuffled.cnf	UNSAT	0.000999	0.0057231	3499688
SAT02/handmade/zhang-lintao/ xor-chain/x1_40.shuffled.cnf	UNSAT	0.000999	0.00578794	3499686
SAT03/handmade/bevan/cnf/ marg3x3add8ch.shuffled-as.sat03-1448.cnf	UNSAT	0.001998	0.005596	3499570
SAT02/handmade/zhang-lintao/ xor-chain/x1_80.shuffled.cnf	UNSAT	0.001998	0.00577906	3499684
crafted/skvortsov/battleship/ battleship-5-8-unsat.cnf	UNSAT	0.069988	0.0706709	3499406
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3500_3500_30f1.shuffled.cnf	UNSAT	0.070989	0.071662	3499668
crafted/skvortsov/battleship/ battleship-6-9-unsat.cnf	UNSAT	0.133978	0.133854	3499422
SAT05/crafted/sabharwal05/counting/php/unsat/ easier/php-010-008.shuffled-as.sat05-1171.cnf	UNSAT	0.446932	0.447747	3499622
SAT02/handmade/simon/ satex-challenges/c6288.shuffled.cnf	UNSAT	0.774881	0.775375	3499680
SAT05/crafted/sorge05/QG8/ gensys-ukn007.shuffled-as.sat05-3586.cnf	UNSAT	0.873866	0.873656	3499660
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3900_3900_060.shuffled.cnf	UNSAT	4.33234	4.33372	3499670
SAT05/crafted/sabharwal05/pebbling/grid-pebbling/unsat/ grid-pbl-0250.shuffled-as.sat05-1349.shuffled-as.sat05-1349.cnf	UNSAT	5.40418	5.40611	3499632
SAT05/crafted/sabharwal05/planning/logistics/unsat/ logistics-rotate-07t5.shuffled-as.sat05-1137.cnf	UNSAT	5.57015	5.57104	3499618
crafted/skvortsov/battleship/ battleship-10-10-unsat.cnf	UNSAT	8.01978	8.02065	3499398
SAT05/crafted/sabharwal05/ordering/gt-ordering/ sat/gt-030.shuffled-as.sat05-1295.cnf	UNSAT	18.6152	18.6168	3499634
SAT05/crafted/sorge05/QG6/ dead-dnd002.shuffled-as.sat05-2713.cnf	UNSAT	59.5809	59.5864	3499664
crafted/skvortsov/ automata-synchronization/crn_11_99_u.cnf	UNSAT	65.577	65.5813	3499376
crafted/skvortsov/battleship/ battleship-12-12-unsat.cnf	UNSAT	147.684	147.678	3499414
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-12_135.cnf	UNSAT	158.685	158.685	3499506
crafted/skvortsov/battleship/ battleship-11-11-unsat.cnf	UNSAT	162.785	162.786	3499392
SAT03/handmade/markstrom/UNSATISFIABLE/ mm-2x2-6-6-s.1.shuffled-as.sat03-1499.cnf	UNSAT	198.166	198.165	3499566
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-5_528.cnf	UNSAT	228.981	228.975	3499456
SAT05/crafted/sorge05/QG7/ dead-dnd003.shuffled-as.sat05-3109.cnf	UNSAT	249.627	249.625	3499658
crafted/skvortsov/battleship/ battleship-7-12-unsat.cnf	UNSAT	588.774	588.749	3499410
SAT05/crafted/sorge05/QG7/ gensys-icl007.shuffled-as.sat05-3133.cnf	UNSAT	644.457	644.438	3499656
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-19_348.cnf	UNSAT	682.322	682.304	3499468
crafted/spence/sgen/ sgen3-n120-s55656844-unsat.cnf	UNSAT	716.736	716.713	3499284
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-20_381.cnf	UNSAT	935.814	935.791	3499476
SAT05/crafted/sabharwal05/counting/fphp/unsat/ harder/fphp-020-019.shuffled-as.sat05-1232.cnf	UNSAT	1019.69	1019.66	3499630
crafted/spence/ hard/s113-100.cnf	UNSAT	1113.71	1113.7	3499146
SAT05/crafted/sorge05/QG7a/ gensys-icl005.shuffled-as.sat05-3826.cnf	UNSAT	1304.78	1304.75	3499646
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-13_160.cnf	UNSAT	1375.09	1375.06	3499494
SAT04/handmade/marijn/equilarge-l/ equilarge_l4.used-as.sat04-896.cnf	UNSAT	1402.88	1402.84	3499600
SAT05/crafted/sabharwal05/counting/php/unsat/ harder/php-020-019.shuffled-as.sat05-1190.cnf	UNSAT	1476.57	1476.54	3499626
SAT04/handmade/marijn/equilarge-l/ equilarge_l2.used-as.sat04-894.cnf	UNSAT	1603.22	1603.17	3499598
SAT03/handmade/stanion/hwb/ hwb-n28-01-S136611085.shuffled-as.sat03-1627.cnf	UNSAT	1898.7	1898.63	3499564
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-20_390.cnf	UNSAT	1928.18	1928.13	3499478
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_401.cnf	UNSAT	2309.13	2309.08	3499474
SAT05/crafted/sorge05/QG7a/ gensys-ukn006.shuffled-as.sat05-3846.cnf	UNSAT	3674.43	3674.34	3499648
SAT05/crafted/sorge05/QG7a/ gensys-ukn003.shuffled-as.sat05-3843.cnf	UNSAT	3817.16	3817.03	3499652
SAT05/crafted/sorge05/QG7a/ gensys-ukn009.shuffled-as.sat05-3849.cnf	UNSAT	4213.87	4213.77	3499644
SAT03/handmade/stanion/hwb/ hwb-n28-02-S818962541.shuffled-as.sat03-1628.cnf	UNSAT	4299.27	4299.14	3499558

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/crafted/jarvisalo05/mod2-rand3bip-sat/ mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf	SAT	0.006998	0.00797002	3499602
crafted/skvortsov/battleship/ battleship-8-15-sat.cnf	SAT	0.007997	0.00811897	3499394
crafted/mosoi/289/ 289-sat-4x8.cnf	SAT	0.009997	0.010048	3499312
crafted/mosoi/ 289/289-sat-11x4.cnf	SAT	0.016997	0.01764	3499352
crafted/mosoi/289/ 289-sat-5x8.cnf	SAT	0.016997	0.0177261	3499342
crafted/mosoi/289/ 289-sat-7x6.cnf	SAT	0.020996	0.020951	3499340
crafted/mosoi/289/ 289-sat-6x8.cnf	SAT	0.025995	0.026452	3499356
crafted/skvortsov/battleship/ battleship-7-13-sat.cnf	SAT	0.030994	0.030859	3499428
crafted/mosoi/289/ 289-sat-6x9.cnf	SAT	0.034994	0.0350781	3499362
crafted/skvortsov/battleship/ battleship-10-19-sat.cnf	SAT	0.038993	0.038724	3499426
crafted/mosoi/ 289/289-sat-6x19.cnf	SAT	0.166974	0.167974	3499306
crafted/mosoi/ 289/289-sat-4x35.cnf	SAT	0.172973	0.172994	3499314
crafted/mosoi/ 289/289-sat-11x9.cnf	SAT	0.180971	0.181818	3499360
SAT05/crafted/sorge05/QG7/ iso-ukn004.shuffled-as.sat05-3385.cnf	SAT	0.181971	0.181992	3499654
crafted/mosoi/ 289/289-sat-6x20.cnf	SAT	0.193969	0.194985	3499328
crafted/mosoi/ 289/289-sat-14x8.cnf	SAT	0.203968	0.204949	3499326
crafted/mosoi/ 289/289-sat-11x10.cnf	SAT	0.215966	0.216093	3499338
crafted/mosoi/ 289/289-sat-9x13.cnf	SAT	0.237962	0.238319	3499332
crafted/spence/sgen/ sgen3-n120-s12930489-sat.cnf	SAT	0.247961	0.248764	3499294
SAT04/handmade/anton/l5k3/ lksat-n900-m3357-k3-l5-s950595579.used-as.sat04-938.cnf	SAT	0.295955	0.29767	3499584
SAT05/crafted/sorge05/QG8/ iso-ukn009.shuffled-as.sat05-3632.cnf	SAT	0.301953	0.302729	3499662
SAT04/handmade/anton/l5k3/ lksat-n1100-m4103-k3-l5-s558351420.used-as.sat04-934.cnf	SAT	0.473927	0.473461	3499582
crafted/mosoi/ 289/289-sat-12x14.cnf	SAT	0.637902	0.637543	3499348
SAT02/handmade/simon/satex-challenges/ par32-3.shuffled.cnf	SAT	0.638902	0.639671	3499682
crafted/mosoi/ 289/289-sat-12x15.cnf	SAT	0.787879	0.788237	3499318
SAT04/handmade/anton/l4k4/ lksat-n900-m6174-k4-l4-s819398222.used-as.sat04-929.cnf	SAT	1.18182	1.18121	3499586
crafted/spence/sgen/ sgen3-n140-s18527668-sat.cnf	SAT	4.80127	5.74038	3499300
SAT02/handmade/pehoushek/twentyvars/ 7cnf20_90000_90000_7.shuffled.cnf	SAT	4.90225	4.90218	3499666
crafted/skvortsov/battleship/ battleship-12-23-sat.cnf	SAT	5.01224	5.0121	3499416
crafted/skvortsov/battleship/ battleship-10-18-sat.cnf	SAT	5.05723	5.42464	3499402
CRAFTED/sgi/ satsgi-n26himBHm28-p0-q293.cnf	SAT	5.08323	5.08431	3499166
crafted/skvortsov/battleship/ battleship-9-17-sat.cnf	SAT	5.32919	5.33028	3499434
crafted/skvortsov/battleship/ battleship-10-17-sat.cnf	SAT	5.37518	5.37535	3499388
SAT05/crafted/sorge05/QG7a/ gensys-brn002.shuffled-as.sat05-3935.cnf	SAT	5.78012	5.78207	3499642
crafted/skvortsov/battleship/ battleship-24-57-sat.cnf	SAT	7.54585	7.54656	3499396
CRAFTED/ramseycube/ Q3inK10.cnf	SAT	17.7253	17.7248	3499158
crafted/skvortsov/battleship/ battleship-17-33-sat.cnf	SAT	24.0673	24.0702	3499424
crafted/skvortsov/battleship/ battleship-11-21-sat.cnf	SAT	35.3206	35.3209	3499432
SAT04/handmade/andrew/composite/ Composite-024BitPrimes-1.used-as.sat04-861.cnf	SAT	45.6091	45.6148	3499596
CRAFTED/ edgematching/all/em_8_4_5_all.cnf	SAT	47.0988	47.0998	3499154
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-5_527.cnf	SAT	48.7746	48.7857	3499450
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q369.75-n30-p15-s59317012.cnf	SAT	65.55	65.5544	3499716
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g7.cnf	SAT	119.794	119.794	3499186
crafted/skvortsov/ automata-synchronization/rnd_100_27_s.cnf	SAT	237.956	238.043	3499380
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-220-3.shuffled-as.sat05-2490.cnf	SAT	316.197	316.192	3499610
crafted/skvortsov/ automata-synchronization/rnd_100_28_s.cnf	SAT	339.847	339.89	3499364
crafted/skvortsov/ automata-synchronization/crn_11_100_s.cnf	SAT	408.404	408.397	3499370
crafted/skvortsov/ automata-synchronization/rnd_100_32_s.cnf	SAT	816.441	816.429	3499384
CRAFTED/rbsat/random/unforced/ rbsat-v760c43649g5.cnf	SAT	1013.53	1013.51	3499178
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_505.cnf	SAT	1168.4	1168.37	3499486
CRAFTED/parity-games/ instance_n9_i9_pp.cnf	SAT	1349.58	1349.53	3499262
CRAFTED/edgematching/ compact/em_7_3_6_cmp.cnf	SAT	1450.3	1450.28	3499148
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-2.shuffled-as.sat05-2534.cnf	SAT	1452.1	1452.06	3499606
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q225-n25-p15-s58217873.cnf	SAT	1487.87	1487.87	3499712
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g1.cnf	SAT	1493.47	1493.49	3499174
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-1.shuffled-as.sat05-2533.cnf	SAT	1545.61	1545.56	3499616
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-240-2.shuffled-as.sat05-2519.cnf	SAT	1760.55	1760.52	3499612
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_399.cnf	SAT	1767.43	1767.39	3499458
crafted/skvortsov/ automata-synchronization/rnd_150_42_s.cnf	SAT	1845.37	1845.33	3499366
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_4300_4300_110.shuffled.cnf	SAT	1971.74	1971.67	3499676
SAT03/handmade/anton/SAT/ SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf	SAT	2169.2	2169.12	3499556
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q225-n25-p30-s70617701.cnf	SAT	2184.3	2184.23	3499698
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes6.cnf	SAT	2409.78	2409.73	3499248
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes5.cnf	SAT	2449.67	2449.61	3499236
CRAFTED/edgematching/ fbcolors/em_8_4_5_fbc.cnf	SAT	2554.86	2554.79	3499156
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535.cnf	SAT	2567.93	2562.98	3499608
CRAFTED/rbsat/crafted/forced/ rbsat-v760c43649gyes8.cnf	SAT	2870.92	2870.86	3499246
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g4.cnf	SAT	3669.15	3669.05	3499172
SAT04/handmade/kexu/frb-0.6/ frb75-13-2.used-as.sat04-878.cnf	SAT	3835.62	3835.53	3499572
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_404.cnf	SAT	4448.42	4448.31	3499466
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g9.cnf	SAT	4670.06	4669.84	3499224
SAT02/handmade/simon/ satex-challenges/f600.shuffled.cnf	SAT	4750.96	4750.8	3499678
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520.cnf	SAT	4935.21	4935.12	3499604

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes7.cnf	? (TO)	5000.09	4995.12	3499204
crafted/skvortsov/battleship/ battleship-16-16-unsat.cnf	? (TO)	5000.09	4995.12	3499412
crafted/mosoi/289/ 289-unsat-21x14.cnf	? (TO)	5000.1	4995.41	3499324
SAT03/handmade/stanion/hwb/ hwb-n32-02-S1478512323.shuffled-as.sat03-1638.cnf	? (TO)	5000.1	4995.12	3499560
crafted/spence/sgen/ sgen3-n140-s20078956-unsat.cnf	? (TO)	5000.11	4998.11	3499290

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
crafted/mosoi/289/ 289-unsat-5x41.cnf	? (exit code)	4998.27	4998.25	3499316
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q255-n25-p15-s2076598.cnf	? (exit code)	4998.28	4998.15	3499726
SAT05/crafted/lynce05/social-golfer-problem/ sgp_5-6-8.shuffled-as.sat05-2669.cnf	? (exit code)	4998.3	4998.19	3499636
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes7.cnf	? (exit code)	4998.3	4998.13	3499198
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-17_279.cnf	? (exit code)	4998.32	4998.18	3499490
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q663-n40-p15-s72490337.cnf	? (exit code)	4998.33	4998.23	3499732
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_506.cnf	? (exit code)	4998.33	4998.1	3499472
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_508.cnf	? (exit code)	4998.33	4998.17	3499470
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf	? (exit code)	4998.34	4998.19	3499690
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-23_507.cnf	? (exit code)	4998.34	4998.18	3499464
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes10.cnf	? (exit code)	4998.35	4998.17	3499256
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-5_4231.cnf	? (exit code)	4998.35	4998.29	3499442
crafted/mosoi/289/ 289-unsat-6x40.cnf	? (exit code)	4998.36	4998.24	3499346
CRAFTED/rbsat/crafted/ forced/rbsat-v2640c305320gyes3.cnf	? (exit code)	4998.37	4998.19	3499254
CRAFTED/rbsat/random/unforced/ rbsat-v1375c111739g4.cnf	? (exit code)	4998.37	4998.25	3499192
crafted/mosoi/289/ 289-unsat-6x34.cnf	? (exit code)	4998.38	4998.31	3499304
crafted/spence/sgen/ sgen3-n180-s34713902-sat.cnf	? (exit code)	4998.38	4998.23	3499272
crafted/anton/SRHD-SGI/ srhd-sgi-m27-q255-n25-p30-s39712998.cnf	? (exit code)	4998.39	4998.22	3499706
SAT04/handmade/kexu/frb-0.8/ frb59-26-1.used-as.sat04-891.cnf	? (exit code)	4998.4	4998.27	3499580
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_3900_3900_220.shuffled.cnf	? (exit code)	4998.41	4998.27	3499674
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf	? (exit code)	4998.41	4998.28	3499722
SAT03/handmade/anton/UNSAT/ SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf	? (exit code)	4998.41	4998.33	3499526
crafted/spence/sgen/ sgen3-n170-s56409011-unsat.cnf	? (exit code)	4998.43	4998.28	3499280
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q841.5-n45-p15-s16393788.cnf	? (exit code)	4998.44	4998.27	3499728
CRAFTED/rbsat/random/unforced/ rbsat-v2400c266431g10.cnf	? (exit code)	4998.44	4998.31	3499170
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g9.cnf	? (exit code)	4998.45	4998.34	3499232
SAT03/handmade/stanion/hwb/ hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf	? (exit code)	4998.45	4998.3	3499562
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q1041.25-n50-p15-s99099953.cnf	? (exit code)	4998.46	4998.38	3499738
crafted/skvortsov/battleship/ battleship-14-14-unsat.cnf	? (exit code)	4998.46	4998.32	3499400
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-5_4232.cnf	? (exit code)	4998.46	4998.34	3499454
SAT03/handmade/anton/UNSAT/ SGI_30_70_20_60_10-dir.shuffled-as.sat03-144.cnf	? (exit code)	4998.47	4998.34	3499536
SAT05/crafted/sorge05/QG7a/ gensys-ukn004.shuffled-as.sat05-3844.cnf	? (exit code)	4998.47	4998.24	3499650
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-21_406.cnf	? (exit code)	4998.47	4998.35	3499482
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1504.5-n60-p15-s80450670.cnf	? (exit code)	4998.48	4998.34	3499702
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-4_512.cnf	? (exit code)	4998.49	4998.3	3499440
CRAFTED/rbsat/crafted/unforced/ rbsat-v2400c266431g6.cnf	? (exit code)	4998.5	4998.27	3499226
SAT05/crafted/sabharwal05/counting/php/unsat/ harder/php-040-039.shuffled-as.sat05-1194.cnf	? (exit code)	4998.5	4998.37	3499624
CRAFTED/rbsat/crafted/ forced/rbsat-v2400c266431gyes2.cnf	? (exit code)	4998.52	4998.32	3499258
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf	? (exit code)	4998.52	4998.46	3499508
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g7.cnf	? (exit code)	4998.54	4998.47	3499176
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf	? (exit code)	4998.54	4998.4	3499710
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes1.cnf	? (exit code)	4998.54	4998.33	3499206
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf	? (exit code)	4998.55	4998.44	3499720
crafted/skvortsov/ automata-synchronization/rnd_150_29_u.cnf	? (exit code)	4998.56	4998.42	3499382
crafted/spence/sgen/ sgen3-n180-s33098896-unsat.cnf	? (exit code)	4998.56	4998.48	3499270
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-5-5_34309.cnf	? (exit code)	4998.56	4998.44	3499448
crafted/mosoi/289/ 289-unsat-6x30.cnf	? (exit code)	4998.57	4998.4	3499310
CRAFTED/rbsat/random/forced/ rbsat-v945c61409gyes5.cnf	? (exit code)	4998.58	4998.47	3499200
SAT03/handmade/anton/UNSAT/ SGI_30_60_24_40_2-log.shuffled-as.sat03-119.cnf	? (exit code)	4998.59	4998.66	3499514
CRAFTED/rbsat/crafted/ forced/rbsat-v1560c133795gyes1.cnf	? (exit code)	4998.59	4998.47	3499252
SAT02/handmade/pehoushek/plainoldcnf/ 5cnf_4300_4300_170.shuffled.cnf	? (exit code)	4998.6	4998.48	3499672
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q585-n40-p15-s54275047.cnf	? (exit code)	4998.61	4998.44	3499736
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g6.cnf	? (exit code)	4998.61	4998.46	3499182
crafted/spence/sgen/ sgen3-n240-s78945233-sat.cnf	? (exit code)	4998.62	4998.51	3499298
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes1.cnf	? (exit code)	4998.62	4998.51	3499250
SAT04/handmade/kexu/frb-0.8/ frb59-26-2.used-as.sat04-892.cnf	? (exit code)	4998.62	4998.78	3499578
crafted/mosoi/289/ 289-unsat-21x33.cnf	? (exit code)	4998.62	4998.51	3499320
SAT03/handmade/anton/UNSAT/ SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf	? (exit code)	4998.63	4998.54	3499528
SAT03/handmade/anton/UNSAT/ SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf	? (exit code)	4998.63	4998.52	3499516
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-18_312.cnf	? (exit code)	4998.64	4998.53	3499496
CRAFTED/edgematching/ compact/em_11_3_4_cmp.cnf	? (exit code)	4998.64	4998.48	3499152
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes7.cnf	? (exit code)	4998.65	4998.51	3499238
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q742.5-n45-p30-s17570390.cnf	? (exit code)	4998.65	4998.42	3499708
crafted/spence/sgen/ sgen3-n260-s62321009-sat.cnf	? (exit code)	4998.66	4998.55	3499296
SAT05/crafted/sabharwal05/counting/fphp/unsat/ harder/fphp-030-029.shuffled-as.sat05-1234.cnf	? (exit code)	4998.66	4998.47	3499628
SAT04/handmade/kexu/frb-0.8/ frb45-21-1.used-as.sat04-883.cnf	? (exit code)	4998.66	4998.58	3499576
crafted/skvortsov/battleship/ battleship-15-29-sat.cnf	? (exit code)	4998.66	4998.43	3499430
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-14_186.cnf	? (exit code)	4998.67	4998.53	3499502
CRAFTED/rbsat/crafted/unforced/ rbsat-v945c61409g3.cnf	? (exit code)	4998.67	4998.55	3499228
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_445.cnf	? (exit code)	4998.67	4998.53	3499484
SAT04/handmade/connamacher/connm-d0.02/ connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf	? (exit code)	4998.68	4998.52	3499588
CRAFTED/rbsat/crafted/forced/ rbsat-v945c61409gyes10.cnf	? (exit code)	4998.68	4998.58	3499242
CRAFTED/modcircuits/ mod4block_3vars_7gates.cnf	? (exit code)	4998.69	4998.54	3499160
SAT03/handmade/anton/UNSAT/ SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf	? (exit code)	4998.69	4998.65	3499520
crafted/anton/SRHD-SGI/ srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf	? (exit code)	4998.7	4998.56	3499696
crafted/mosoi/289/ 289-unsat-21x40.cnf	? (exit code)	4998.7	4998.57	3499322
SAT05/crafted/roussel05/visbmc-PHNF/ phnf-size10-exclusive-philo.used-as.sat04-988.shuffled-as.sat05-4195.cnf	? (exit code)	4998.7	4998.63	3499638
crafted/mosoi/289/ 289-unsat-7x39.cnf	? (exit code)	4998.71	4998.59	3499330
SAT05/crafted/sabharwal05/counting/php/unsat/ easier/php-045-035.shuffled-as.sat05-1181.cnf	? (exit code)	4998.72	4998.56	3499620
crafted/spence/sgen/ sgen3-n190-s29985700-unsat.cnf	? (exit code)	4998.73	4998.61	3499302
crafted/spence/sgen/ sgen3-n200-s39840374-sat.cnf	? (exit code)	4998.73	4998.59	3499274
CRAFTED/parity-games/ instance_n8_i8_pp_ci_ce.cnf	? (exit code)	4998.74	4998.55	3499260
CRAFTED/rbsat/crafted/unforced/ rbsat-v1820c171155g5.cnf	? (exit code)	4998.74	4998.6	3499222
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_443.cnf	? (exit code)	4998.76	4998.62	3499480
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q585-n40-p30-s19690873.cnf	? (exit code)	4998.76	4998.63	3499744
crafted/manthey/sudoku-single-hard/ sudoku_81x81_unknown.cnf	? (exit code)	4998.77	4998.66	3499436
CRAFTED/rbsat/random/unforced/ rbsat-v945c61409g3.cnf	? (exit code)	4998.77	4998.65	3499184
SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/ mod2c-rand3bip-sat-230-3.shuffled-as.sat05-2505.cnf	? (exit code)	4998.78	4998.66	3499614
SAT03/handmade/gomes/bqwh/ bqwh.50.825.shuffled-as.sat03-1648.cnf	? (exit code)	4998.78	4998.68	3499510
crafted/mosoi/289/ 289-unsat-13x32.cnf	? (exit code)	4998.79	4998.72	3499308
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf	? (exit code)	4998.81	4998.69	3499740
SAT04/handmade/connamacher/connm-d0.04/ connm-ue-csp-sat-n800-d0.04-s1788334438.used-as.sat04-976.cnf	? (exit code)	4998.81	4998.62	3499590
SAT03/handmade/anton/UNSAT/ SGI_30_70_18_80_10-dir.shuffled-as.sat03-140.cnf	? (exit code)	4998.82	4998.77	3499534
CRAFTED/rbsat/crafted/ forced/rbsat-v2400c266431gyes3.cnf	? (exit code)	4998.82	4998.84	3499240
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-15_218.cnf	? (exit code)	4998.82	4998.78	3499500
crafted/mosoi/289/ 289-unsat-9x32.cnf	? (exit code)	4998.82	4998.64	3499344
crafted/spence/sgen/ sgen3-n130-s30940966-unsat.cnf	? (exit code)	4998.83	4998.76	3499286
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-20_389.cnf	? (exit code)	4998.85	4998.73	3499492
crafted/spence/sgen/ sgen3-n200-s00813792-unsat.cnf	? (exit code)	4998.86	4998.72	3499292
SAT03/handmade/anton/UNSAT/ SGI_30_80_28_70_8-dir.shuffled-as.sat03-215.cnf	? (exit code)	4998.86	4998.74	3499522
CRAFTED/modcircuits/ mod3block_2vars_11gates_u2_autoenc.cnf	? (exit code)	4998.87	4998.72	3499164
crafted/skvortsov/ automata-synchronization/crn_20_361_s.cnf	? (exit code)	4998.87	4998.76	3499378
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-20_388.cnf	? (exit code)	4998.87	4998.72	3499504
crafted/skvortsov/battleship/ battleship-14-27-sat.cnf	? (exit code)	4998.87	4998.64	3499418
crafted/skvortsov/automata-synchronization/ crn_40_1521_s.cnf	? (exit code)	4998.89	4998.75	3499372
crafted/skvortsov/ automata-synchronization/crn_20_360_u.cnf	? (exit code)	4998.89	4998.76	3499368
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf	? (exit code)	4998.9	4998.73	3499724
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_462.cnf	? (exit code)	4998.9	4998.76	3499488
SAT03/handmade/anton/UNSAT/ SGI_30_60_29_30_6-dir.shuffled-as.sat03-130.cnf	? (exit code)	4998.9	4998.87	3499550
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-4-4_511.cnf	? (exit code)	4998.9	4998.82	3499446
SAT04/handmade/hirsch03/ hgen8-n320-01-S1432474240.shuffled-as.sat03-890.used-as.sat04-841.cnf	? (exit code)	4998.91	4998.76	3499594
crafted/skvortsov/automata-synchronization/ crn_40_1520_u.cnf	? (exit code)	4998.91	4998.79	3499386
crafted/spence/sgen/ sgen3-n160-s40283905-sat.cnf	? (exit code)	4998.93	4998.78	3499266
crafted/skvortsov/battleship/ battleship-15-15-unsat.cnf	? (exit code)	4998.93	4998.78	3499420
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q841.5-n45-p30-s84954709.cnf	? (exit code)	4998.94	4998.81	3499718
crafted/skvortsov/battleship/ battleship-16-31-sat.cnf	? (exit code)	4998.95	4998.83	3499390
SAT03/handmade/anton/UNSAT/ SGI_30_70_19_80_8-log.shuffled-as.sat03-143.cnf	? (exit code)	4998.96	4998.85	3499518
SAT03/handmade/anton/UNSAT/ SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf	? (exit code)	4998.96	4998.82	3499544
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q326.25-n30-p30-s48700942.cnf	? (exit code)	4998.97	4998.74	3499714
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q918.75-n50-p30-s52376212.cnf	? (exit code)	4998.97	4998.84	3499694
crafted/anton/SRHD-SGI/ srhd-sgi-m32-q326.25-n30-p15-s44266159.cnf	? (exit code)	4998.98	4998.87	3499734
CRAFTED/rbsat/random/ forced/rbsat-v1150c84314gyes1.cnf	? (exit code)	4998.98	4998.84	3499220
CRAFTED/modcircuits/ mod4block_2vars_8gates_u2.cnf	? (exit code)	4998.98	4998.91	3499162
SAT04/handmade/connamacher/connm-d-0.02/ connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf	? (exit code)	4999	4998.85	3499592
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-24_567.cnf	? (exit code)	4999.01	4998.87	3499460
crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/ VanDerWaerden_pd_2-3-22_464.cnf	? (exit code)	4999.01	4998.84	3499462
crafted/spence/sgen/ sgen3-n150-s89334302-unsat.cnf	? (exit code)	4999.01	4998.85	3499276
crafted/anton/SRHD-SGI/ srhd-sgi-m47-q742.5-n45-p15-s28972035.cnf	? (exit code)	4999.02	4998.86	3499704
SAT03/handmade/anton/UNSAT/ SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf	? (exit code)	4999.02	4998.9	3499548
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q918.75-n50-p15-s98191766.cnf	? (exit code)	4999.02	4998.84	3499742
SAT05/crafted/markstrom05/eulcbip/ eulcbip-7-UNSAT.shuffled-as.sat05-3936.cnf	? (exit code)	4999.03	4998.89	3499640
crafted/spence/sgen/ sgen3-n300-s12830984-sat.cnf	? (exit code)	4999.05	4998.98	3499268
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_5-log.shuffled-as.sat03-111.cnf	? (exit code)	4999.05	4998.92	3499530
crafted/anton/SRHD-SGI/ srhd-sgi-m62-q1327.5-n60-p30-s52708253.cnf	? (exit code)	4999.06	4998.91	3499692
crafted/mosoi/289/ 289-unsat-14x34.cnf	? (exit code)	4999.06	4998.9	3499354
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g2.cnf	? (exit code)	4999.07	4998.96	3499234
CRAFTED/rbsat/crafted/unforced/ rbsat-v760c43649g7.cnf	? (exit code)	4999.07	4999.17	3499230
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-5-5_34308.cnf	? (exit code)	4999.08	4998.97	3499444
CRAFTED/rbsat/random/unforced/ rbsat-v1150c84314g7.cnf	? (exit code)	4999.08	4998.96	3499194
SAT03/handmade/anton/UNSAT/ SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf	? (exit code)	4999.08	4998.93	3499552
CRAFTED/rbsat/random/ forced/rbsat-v2100c215164gyes2.cnf	? (exit code)	4999.09	4998.98	3499218
SAT04/handmade/kexu/frb-0.6/ frb80-14-2.used-as.sat04-880.cnf	? (exit code)	4999.11	4999	3499574
crafted/anton/SRHD-SGI/ srhd-sgi-m52-q1041.25-n50-p30-s30907550.cnf	? (exit code)	4999.11	4998.97	3499700
crafted/mosoi/289/ 289-unsat-21x39.cnf	? (exit code)	4999.12	4998.95	3499358
CRAFTED/rbsat/random/unforced/ rbsat-v1375c111739g6.cnf	? (exit code)	4999.12	4998.99	3499190
SAT03/handmade/anton/UNSAT/ SGI_30_70_26_60_1-dir.shuffled-as.sat03-167.cnf	? (exit code)	4999.12	4998.95	3499532
crafted/spence/sgen/ sgen3-n280-s93756482-sat.cnf	? (exit code)	4999.13	4999.05	3499288
SAT03/handmade/anton/UNSAT/ SGI_30_70_21_60_7-log.shuffled-as.sat03-151.cnf	? (exit code)	4999.13	4999.06	3499542
CRAFTED/rbsat/random/unforced/ rbsat-v2100c215164g4.cnf	? (exit code)	4999.13	4999.01	3499188
CRAFTED/rbsat/random/ forced/rbsat-v1820c171155gyes3.cnf	? (exit code)	4999.14	4998.98	3499212
CRAFTED/edgematching/ compact/em_12_2_4_cmp.cnf	? (exit code)	4999.14	4998.99	3499150
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_1-log.shuffled-as.sat03-107.cnf	? (exit code)	4999.14	4998.95	3499524
crafted/mosoi/289/ 289-unsat-17x27.cnf	? (exit code)	4999.15	4999.03	3499336
crafted/spence/sgen/ sgen3-n220-s24359701-sat.cnf	? (exit code)	4999.16	4999.02	3499282
CRAFTED/rbsat/random/forced/ rbsat-v1375c111739gyes10.cnf	? (exit code)	4999.16	4998.93	3499208
CRAFTED/sgi/ new-difficult-23-189-21-75.cnf	? (exit code)	4999.16	4999.08	3499264
SAT03/handmade/anton/UNSAT/ SGI_30_60_28_40_7-log.shuffled-as.sat03-127.cnf	? (exit code)	4999.16	4999.05	3499540
CRAFTED/rbsat/random/unforced/ rbsat-v2100c215164g9.cnf	? (exit code)	4999.16	4999.01	3499180
crafted/skvortsov/ automata-synchronization/rnd_100_28_u.cnf	? (exit code)	4999.16	4999.13	3499374
SAT03/handmade/gomes/bqwh/ bqwh.60.1152.shuffled-as.sat03-1650.cnf	? (exit code)	4999.16	4999.32	3499512
crafted/spence/sgen/ sgen3-n160-s73223945-unsat.cnf	? (exit code)	4999.17	4999.01	3499278
crafted/mosoi/289/ 289-unsat-17x30.cnf	? (exit code)	4999.18	4999	3499334
crafted/kullmann/VanDerWaerden/ VanderWaerden3k/VanDerWaerden_2-3-19_349.cnf	? (exit code)	4999.18	4999.06	3499498
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes2.cnf	? (exit code)	4999.19	4999.06	3499196
CRAFTED/rbsat/random/forced/ rbsat-v2640c305320gyes10.cnf	? (exit code)	4999.19	4999.12	3499216
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-6_2071.cnf	? (exit code)	4999.2	4999.05	3499452
SAT03/handmade/anton/UNSAT/ SGI_30_50_30_20_3-log.shuffled-as.sat03-109.cnf	? (exit code)	4999.2	4999.19	3499554
CRAFTED/rbsat/crafted/ forced/rbsat-v2100c215164gyes4.cnf	? (exit code)	4999.21	4999.07	3499244
crafted/skvortsov/battleship/ battleship-13-13-unsat.cnf	? (exit code)	4999.21	4999.07	3499404
SAT03/handmade/anton/UNSAT/ SGI_30_70_20_70_1-dir.shuffled-as.sat03-146.cnf	? (exit code)	4999.22	4999.1	3499538
crafted/mosoi/289/ 289-unsat-14x38.cnf	? (exit code)	4999.22	4999.06	3499350
crafted/anton/SRHD-SGI/ srhd-sgi-m42-q663-n40-p30-s67876261.cnf	? (exit code)	4999.23	4999.13	3499730
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes5.cnf	? (exit code)	4999.23	4999.06	3499210
CRAFTED/rbsat/random/ forced/rbsat-v2640c305320gyes3.cnf	? (exit code)	4999.24	4999.16	3499214
SAT03/handmade/anton/UNSAT/ SGI_30_70_29_50_3-dir.shuffled-as.sat03-179.cnf	? (exit code)	4999.26	4999.13	3499546
crafted/kullmann/GreenTao/ GreenTaok1k2/GreenTao_2-3-6_2072.cnf	? (exit code)	4999.26	4999.2	3499438
crafted/skvortsov/battleship/ battleship-14-26-sat.cnf	? (exit code)	4999.26	4999.08	3499408
CRAFTED/rbsat/random/unforced/ rbsat-v2400c266431g3.cnf	? (exit code)	4999.26	4999.14	3499168
CRAFTED/rbsat/random/ forced/rbsat-v2400c266431gyes6.cnf	? (exit code)	4999.27	4999.14	3499202

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete)

Category "crafted instances" (CRAFTED)

Solver proved unsatisfiability (UNSATISFIABLE) (43 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (73 runs) [Show/Hide]

Solver timed out (no solution given) (5 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (179 runs) [Show/Hide]