SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.006998	0.0190659	3387614
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.011997	0.019666	3387516
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.011997	0.019902	3387518
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.140977	0.142666	3387598
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.219966	0.236863	3387120
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	0.528919	0.534082	3387068
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	0.604907	0.616697	3387070
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	0.613905	0.613609	3387374
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	0.644901	0.644921	3387376
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	0.769882	0.769708	3387390
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	0.835872	0.8373	3387368
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	1.16782	1.16808	3387510
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	1.84572	1.84734	3387494
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	2.70259	2.70383	3387364
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	2.86556	2.86689	3387380
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	3.02654	3.02766	3387602
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	3.05853	3.05867	3387636
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	3.9334	3.9331	3387312
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	3.9564	3.95803	3387330
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	4.39833	4.39882	3387634
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	4.6263	4.62664	3387388
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	5.37318	5.38443	3387372
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	6.37203	6.37294	3387176
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	6.65399	6.65496	3387354
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	6.80496	6.80521	3387352
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	6.86996	6.87102	3387508
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	7.72783	7.72932	3387366
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	10.2514	10.2524	3387550
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	11.2303	11.2309	3387340
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	14.3508	14.3499	3387328
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	17.4613	17.4612	3387238
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	17.5773	17.5766	3387316
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	19.42	19.4214	3387066
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	19.477	19.4758	3387632
velev-pipe-o-uns-1.1-6.cnf	UNSAT	19.855	19.859	3387216
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	20.6579	20.6588	3387334
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	21.2008	21.2032	3387522
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	26.049	26.0494	3387292
manol-pipe-c6bidw_i.cnf	UNSAT	27.7698	27.7695	3387108
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	38.2642	38.2654	3387552
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	38.5631	38.5693	3387488
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	40.0429	40.0449	3387392
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	47.0678	47.0675	3387172
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	48.0167	48.0206	3387178
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	50.1784	50.182	3387620
manol-pipe-f7nidw.cnf	UNSAT	66.8338	66.8331	3387112
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	69.5734	69.5734	3387492
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	77.1803	77.1802	3387038
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	83.3543	83.3529	3387168
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	83.4003	83.3999	3387078
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	85.797	85.7943	3387608
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	98.1371	98.1356	3387378
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	104.717	104.716	3387600
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	124.433	124.441	3387164
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	127.239	127.236	3387162
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	158.985	158.98	3387320
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	179.484	179.485	3387370
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	182.635	182.631	3387244
velev-pipe-o-uns-1.0-7.cnf	UNSAT	196.683	196.679	3387218
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	259.741	259.735	3387294
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	293.959	293.955	3387436
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	306.315	306.311	3387054
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	336.31	336.3	3387144
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	343.827	343.822	3387434
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	349.02	349.009	3387596
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	420.069	420.061	3387410
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	429.23	429.215	3387402
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	439.287	439.276	3387186
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	444.25	444.242	3387400
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	460.357	460.342	3387304
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	465.092	465.082	3387408
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	470.868	470.876	3387396
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	472.227	472.219	3387286
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	474.861	474.849	3387604
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	584.362	584.347	3387412
manol-pipe-c10nidw.cnf	UNSAT	592.917	592.915	3387104
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	593.117	593.1	3387624
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	718.86	718.844	3387622
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	UNSAT	769.674	769.695	3387630
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	854.727	854.737	3387506
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	888.118	888.093	3387588
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	1076.37	1076.34	3387326
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	1340.14	1340.08	3387308
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	1459.1	1459.04	3387058
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	1484.19	1484.26	3387540
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	1750.95	1750.9	3387148
velev-vliw-uns-4.0-9-i1.cnf	UNSAT	2037.75	2037.67	3387102
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	2113.68	2113.6	3387538
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	2165.61	2165.56	3387284
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	UNSAT	2348.3	2348.23	3387092
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	2723.85	2723.87	3387234
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	3050.01	3049.9	3387362
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT	3062.96	3062.9	3387556
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	3087.69	3087.59	3387590
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	3300.58	3300.47	3387184
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT	3387.73	3387.63	3387084
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT	3715.06	3714.97	3387086
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	3716.31	3716.23	3387256
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT	3732.83	3732.72	3387082
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT	4124.27	4124.16	3387528
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	4536.21	4536.19	3387386
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	UNSAT	4653.3	4653.99	3387524
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	4971.39	4971.24	3387080

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.002998	0.0162701	3387578
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.002998	0.0162681	3387576
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.003999	0.0162531	3387586
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.007997	0.016233	3387580
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.009997	0.019316	3387610
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.015997	0.0193239	3387480
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.017996	0.0211069	3387582
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.071989	0.073474	3387612
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.396939	0.397718	3387594
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	0.475927	0.479728	3387222
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	0.52092	0.522145	3387318
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	0.58591	0.585505	3387230
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	0.952854	0.953099	3387226
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	0.97885	0.980843	3387206
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	0.987849	0.989391	3387338
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.3258	1.32617	3387202
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	1.38879	1.39989	3387332
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	1.39679	1.40248	3387336
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	1.59376	1.63735	3387348
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	1.65475	1.65535	3387180
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	1.70874	1.75082	3387346
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	1.80272	1.80351	3387544
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	2.20366	2.21342	3387342
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	2.71059	2.71052	3387240
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	3.10853	3.10855	3387198
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	4.00839	4.01006	3387156
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	4.11437	4.11487	3387228
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	4.95325	4.95415	3387250
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	6.65999	6.66027	3387478
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	7.2029	7.213	3387236
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	7.83881	7.83994	3387498
application/manthey/ traffic/traffic_r_sat.cnf	SAT	10.5474	10.547	3387406
ibm-2002-21r-k95.cnf	SAT	11.1863	11.1859	3387220
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	12.2171	12.2242	3387224
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	12.884	12.8849	3387150
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	14.7818	14.7871	3387232
ibm-2004-01-k90.cnf	SAT	15.1787	15.1792	3387116
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	17.5243	17.5248	3387100
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	20.1619	20.1625	3387616
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	27.1169	27.1392	3387290
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	30.6473	30.6528	3387260
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	30.7313	30.7437	3387310
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	38.0462	38.0454	3387158
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	40.2889	40.2904	3387306
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	43.2694	43.2736	3387170
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	43.3834	43.3853	3387560
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	45.0092	45.0293	3387302
mizh-sha0-36-4.cnf	SAT	45.3051	45.3173	3387106
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	47.2008	47.2001	3387568
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	47.4448	47.4441	3387300
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	49.6624	49.661	3387562
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	SAT	58.5071	58.5072	3387166
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	62.3985	63.0286	3387520
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	65.762	65.8119	3387398
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	70.4073	70.4068	3387088
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	70.4363	70.4387	3387094
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	71.9361	71.9352	3387504
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	85.273	85.2803	3387194
ibm-2004-23-k100.cnf	SAT	85.296	85.3183	3387110
velev-npe-1.0-9dlx-b71.cnf	SAT	88.0286	88.0436	3387212
velev-pipe-sat-1.0-b9.cnf	SAT	88.6785	88.6796	3387214
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	96.4963	96.4944	3387096
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	97.7821	97.7803	3387496
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	116.061	116.063	3387196
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	138.53	138.526	3387404
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	149.098	149.096	3387296
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	182.236	182.235	3387208
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	203.375	203.408	3387254
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	213.684	213.681	3387490
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	241.198	241.19	3387314
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	278.095	278.087	3387584
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	356.796	356.789	3387618
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	507.593	507.582	3387502
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	532.858	532.847	3387188
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	545.694	545.697	3387160
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	595.046	595.026	3387566
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	615.526	615.515	3387440
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	650.512	650.51	3387044
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	682.661	682.673	3387190
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	714.409	714.387	3387174
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	778.47	778.444	3387090
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	823.729	823.765	3387042
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	1309.16	1309.17	3387486
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	1335.29	1335.27	3387098
ibm-2002-30r-k85.cnf	SAT	1368.35	1368.32	3387114
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	1455.08	1455.05	3387474
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	1595.55	1595.51	3387064
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	1790.46	1790.44	3387324
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	SAT	2045.85	2046.47	3387262
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	2101.76	2101.73	3387448
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT	2366.22	2366.14	3387248
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	2447.8	2447.91	3387270
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	2535.88	2535.8	3387570
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	2549.89	2549.9	3387192
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	2588.3	2588.26	3387414
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	3360.77	3360.78	3387444
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	SAT	3648.76	3648.94	3387574
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	4023.5	4023.4	3387076
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	SAT	4668.07	4667.95	3387442

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	? (TO)	5000.04	4999.93	3387052
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	5000.04	4999.92	3387072
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	? (TO)	5000.04	4999.92	3387074
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	5000.04	4999.93	3387424
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	5000.04	4999.92	3387056
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	? (TO)	5000.04	4999.94	3387048
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	5000.04	4999.93	3387466
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	5000.04	4999.93	3387428
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	5000.04	5029.92	3387470
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	5000.05	5000.03	3387530
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	5000.05	4999.93	3387438
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	5000.05	4999.94	3387360
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	5000.05	4999.94	3387468
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	5000.05	4999.93	3387464
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	5000.05	4999.93	3387606
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	5000.05	4999.93	3387130
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	5000.05	4999.94	3387358
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	5000.05	4999.93	3387138
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	5000.05	4999.92	3387500
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	5000.05	4999.93	3387382
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	5000.05	5000.03	3387532
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	5000.06	4999.93	3387572
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	5000.06	4999.94	3387140
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	5000.06	4999.92	3387482
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	5000.06	5000.05	3387546
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	5000.07	5000.13	3387526
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	5000.07	5000.03	3387060
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (TO)	5000.07	4999.93	3387046
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	5000.07	4999.91	3387124
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	5000.07	4999.92	3387146
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	5000.07	4999.93	3387210
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	5000.07	4999.93	3387450
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	5000.07	4999.92	3387462
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	5000.07	4999.92	3387458
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	5000.07	5040.54	3387350
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	5000.08	5000.05	3387132
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	5000.08	4999.93	3387432
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	5000.08	4999.92	3387460
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	5000.08	4999.93	3387126
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (TO)	5000.08	4999.94	3387062
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	5000.09	4999.92	3387592
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	5000.09	5000.03	3387430
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	? (TO)	5000.09	4999.93	3387384
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	5000.09	5000.17	3387542
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	? (TO)	5000.09	5000.13	3387564
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	5000.09	5000.15	3387136
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	5000.09	5000.03	3387152
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	5000.09	4999.93	3387452
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	5000.09	4999.93	3387416
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	5000.09	5000.13	3387456
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	5000.09	4999.94	3387454
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	5000.1	4999.92	3387472
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	? (TO)	5000.1	4999.94	3387118
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	5000.1	4999.92	3387128
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	5000.1	4999.93	3387142
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	5000.1	5000.02	3387154
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	5000.1	4999.94	3387418
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	5000.1	5000.03	3387446
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	5000.1	4999.92	3387476
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	5000.1	4999.92	3387484
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	5000.1	4999.99	3387514
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	5000.1	5000.03	3387536
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	5000.11	4999.95	3387534
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	5000.11	4999.94	3387134
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	5000.11	4999.93	3387426
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	5000.11	5000.03	3387204
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	5000.11	5000.08	3387122
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	5000.12	4999.93	3387356
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	5000.12	4999.93	3387420
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	5000.12	5000.02	3387548
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	5000.12	5000.13	3387200
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	5000.13	5000.17	3387394
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	5000.13	5000.01	3387050
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	5000.13	5000.34	3387422
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	5000.14	5000.04	3387344
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	5000.15	5000	3387182
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	? (TO)	5000.16	5000.09	3387322
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	5000.17	4999.99	3387268
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	5000.18	5000.1	3387512
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	5000.18	5073.19	3387278
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	5000.21	5046.29	3387276
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	5000.21	5000.09	3387252
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	? (TO)	5000.23	5000.12	3387264
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	5000.23	5000.11	3387040
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	5000.25	5000.2	3387280
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	5000.27	5000.16	3387628
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	5000.27	5042.51	3387554
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	5000.28	5000.18	3387258
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	5000.29	5000.14	3387246
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	5000.33	5000.22	3387242
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	5000.33	5000.43	3387266
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	5000.36	5000.24	3387558
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (TO)	5000.38	5000.2	3387626
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	5000.4	5000.33	3387282

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (problem)	4227.45	4227.51	3387288
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (problem)	4676.88	4676.74	3387272
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (problem)	4838.76	4838.58	3387298
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (problem)	4939.82	4939.71	3387274

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver minisat hack: cir_minisat 2011-05-13 (simp) (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (103 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (99 runs) [Show/Hide]

Solver timed out (no solution given) (94 runs) [Show/Hide]

No recognized solution line (4 runs) [Show/Hide]