SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.023996	0.024471	3372811
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.025995	0.025995	3372814
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.051992	0.0521811	3372958
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.737887	0.742724	3372934
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	0.823874	0.824271	3372940
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	0.900862	0.90679	3372598
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	1.25481	1.25542	3372217
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	1.27481	1.27419	3372142
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	1.9497	1.95055	3372991
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	2.49762	2.49744	3372802
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	2.5996	2.60024	3372139
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	3.17552	3.17514	3372778
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	3.9464	3.94664	3372565
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	3.99439	3.9944	3372862
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	5.43217	5.43165	3372589
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	5.71113	5.72615	3372601
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	5.76312	5.76351	3372937
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	6.75197	6.76519	3372622
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	8.58269	8.58299	3372301
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	10.6424	10.6453	3372799
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	12.3891	12.3893	3372583
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	13.467	13.4705	3372865
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	14.5088	14.5127	3372619
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	16.0536	16.0535	3372094
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	16.6175	16.6172	3372607
velev-pipe-o-uns-1.1-6.cnf	UNSAT	17.8043	17.8053	3372361
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	UNSAT	19.0061	19.008	3372946
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	19.3651	19.364	3372568
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	20.2289	20.246	3372988
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	20.4479	20.4499	3372595
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	24.7632	24.8008	3372475
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	26.6599	26.6596	3372586
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	27.8018	27.8014	3372511
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	33.127	33.1275	3372136
manol-pipe-c6bidw_i.cnf	UNSAT	36.4845	36.4835	3372199
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	37.4123	37.4119	3372820
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	38.0582	38.0575	3372295
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	38.1652	38.166	3372304
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	38.6811	38.6809	3372547
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	39.476	39.477	3372775
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	39.515	39.5157	3372154
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	41.7966	41.799	3372394
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	42.0626	42.0626	3372529
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	42.7945	42.7938	3372769
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	46.8479	46.8507	3372592
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	49.9534	49.9549	3372967
manol-pipe-f7nidw.cnf	UNSAT	50.8743	50.9201	3372205
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	61.3697	61.3672	3372283
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	64.7682	64.769	3372625
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	66.4879	66.488	3372532
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	66.9188	66.9179	3372931
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	75.8865	75.8866	3372403
velev-pipe-o-uns-1.0-7.cnf	UNSAT	87.3537	87.3543	3372364
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	90.3383	90.3367	3372538
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	91.3891	91.3943	3372517
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	100.972	100.97	3372985
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	112.275	112.273	3372604
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	128.164	128.159	3372478
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	128.511	128.508	3372691
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	133.931	133.926	3372280
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	149.531	149.53	3372253
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	162.15	162.152	3372118
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	162.663	162.661	3372616
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	164.762	164.758	3372613
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	173.435	173.431	3372316
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	176.695	176.693	3372493
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	188.633	188.631	3372499
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	262.589	262.581	3372289
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	267.932	267.928	3372949
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	270.123	270.126	3372649
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	270.171	270.171	3372526
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	286.199	286.192	3372652
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	296.77	296.914	3372637
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	304.633	304.632	3372631
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	315.287	315.302	3372640
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	327.56	327.553	3372655
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	346.671	346.661	3372580
manol-pipe-c10nidw.cnf	UNSAT	390.882	390.875	3372193
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	491.896	491.884	3372466
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	517.759	517.767	3372124
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	592.258	592.25	3372919
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	UNSAT	604.533	604.53	3372982
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	616.058	616.045	3372313
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	675.016	674.997	3372463
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	719.795	719.785	3372688
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT	720.348	720.337	3372871
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	849.728	849.711	3372520
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	883.436	883.423	3372796
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	UNSAT	891.683	891.663	3372610
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	911.704	911.7	3372847
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	1039.44	1039.49	3372973
velev-vliw-uns-4.0-9-i1.cnf	UNSAT	1100.02	1100	3372190
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	UNSAT	1105.32	1105.28	3372175
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	1325.55	1325.51	3372421
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	UNSAT	1519.95	1519.95	3372823
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	1537.44	1537.41	3372970
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT	1553.69	1553.71	3372829
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	1641.24	1641.22	3372148
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	UNSAT	1759.66	1759.65	3372250
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT	1803.04	1802.99	3372310
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	UNSAT	1816.28	1816.25	3372868
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	UNSAT	1828.6	1828.57	3372832
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	1966.71	1966.64	3372433
APPLICATIONS/bitverif/ maxor/maxor128.cnf	UNSAT	2123.23	2123.18	3372241
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	UNSAT	2164.05	2164.04	3372577
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	UNSAT	2209.49	2209.43	3372976
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	UNSAT	2351.41	2351.33	3372787
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	UNSAT	2536.87	2536.79	3372109
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	UNSAT	2654.56	2654.51	3372874
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	UNSAT	2915.6	2915.56	3372571
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	3425.26	3425.19	3372388
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	3795.16	3795.07	3372214
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	3814.38	3814.3	3372844
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	UNSAT	4149.84	4149.65	3372106
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	4240.7	4240.55	3372115
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	UNSAT	4491.35	4491.23	3372805
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	UNSAT	4758.42	4758.29	3372562

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.008997	0.014159	3372901
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.009997	0.0106591	3372916
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.011998	0.0129449	3372904
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.026995	0.0277599	3372907
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.082986	0.0840649	3372757
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.116981	0.11711	3372910
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.163975	0.164956	3372952
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	0.573912	0.573911	3372754
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.859869	0.860627	3372955
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1.11683	1.11695	3372346
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.2828	1.28284	3372340
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	1.9657	1.96612	3372928
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	3.76943	3.7828	3372307
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	4.33234	4.33986	3372370
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	4.6073	4.65062	3372544
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	4.69729	4.69734	3372853
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	7.8708	7.95184	3372334
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	8.65768	8.66705	3372382
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	9.42257	9.4493	3372559
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	12.3841	12.4008	3372376
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	14.2258	14.2839	3372412
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	15.0027	15.0385	3372556
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	15.7246	15.7507	3372541
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	18.2122	18.2142	3372271
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	18.3222	18.3403	3372877
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	18.8481	18.8845	3372550
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	19.869	19.8801	3372373
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	23.5794	23.6265	3372397
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	24.4563	24.4678	3372187
velev-pipe-sat-1.0-b9.cnf	SAT	24.6533	24.6707	3372358
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	34.9647	35.0184	3372385
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	38.1012	38.0999	3372784
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	40.0659	40.128	3372379
application/manthey/ traffic/traffic_r_sat.cnf	SAT	40.6208	40.6309	3372646
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	42.8155	42.8158	3372514
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	43.0764	43.097	3372880
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	44.2923	44.2923	3372349
ibm-2004-01-k90.cnf	SAT	47.7887	47.8133	3372211
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	48.7826	48.7832	3372772
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	49.9224	50.018	3372391
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	50.2214	50.2517	3372328
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	51.2592	51.2591	3372262
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	53.8768	54.1248	3372487
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	54.2188	54.217	3372889
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	55.6835	55.6925	3372490
ibm-2002-21r-k95.cnf	SAT	59.7069	59.7636	3372367
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	59.9189	59.9188	3372793
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	60.9007	61.112	3372427
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	61.8446	62.0129	3372178
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	63.0044	63.0538	3372331
velev-npe-1.0-9dlx-b71.cnf	SAT	64.1512	64.3969	3372355
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	68.4036	68.4416	3372292
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	69.5254	69.7573	3372472
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	74.1107	74.3716	3372418
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	80.5637	80.5864	3372508
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	88.7575	88.9323	3372181
mizh-sha0-36-4.cnf	SAT	96.2434	96.2461	3372196
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	105.399	105.396	3372781
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	124.81	124.818	3372964
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	131.021	131.018	3372817
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	135.472	135.473	3372961
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	SAT	137.384	141.175	3372286
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	142.02	142.074	3372496
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	184.184	184.227	3372502
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	213.712	213.723	3372643
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	215.296	215.334	3372319
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	245.772	245.817	3372298
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	280.449	280.513	3372100
ibm-2004-23-k100.cnf	SAT	360.761	360.787	3372202
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	376.67	376.673	3372709
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	405.098	405.086	3372886
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	482.679	482.676	3372151
ibm-2002-30r-k85.cnf	SAT	483.83	483.842	3372208
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	508.444	508.43	3372790
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	584.549	585.007	3372913
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	591.241	591.232	3372523
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	611.057	611.044	3372277
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	673.354	673.345	3372703
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	797.082	797.129	3372634
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	1267.98	1268.06	3372535
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	1360.07	1360.04	3372172
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	SAT	1363.5	1363.46	3372856
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	1401.06	1401.09	3372322
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	SAT	1418.51	1418.47	3372265
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	1490.97	1491.13	3372481
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	1707.88	1707.84	3372766
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	2432.96	2432.94	3372325
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	2617.69	2617.66	3372169
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	3673.2	3673.26	3372442
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	SAT	3990.07	3990.02	3372130
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	4860.35	4860.25	3372274

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	? (TO)	5000.02	4999.92	3372160
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	5000.02	4999.92	3372841
SAT_RACE08/Q1/ SAT_dat.k85.cnf	? (TO)	5000.03	4999.92	3372184
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	5000.03	4999.91	3372223
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	? (TO)	5000.03	4999.92	3372883
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	5000.03	4999.91	3372268
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	5000.04	4999.93	3372730
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	5000.04	4999.92	3372751
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	5000.04	4999.92	3372763
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	5000.04	4999.93	3372718
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	5000.04	4999.92	3372220
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	5000.04	4999.92	3372742
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	5000.04	4999.92	3372670
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	5000.05	4999.93	3372679
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	5000.05	4999.92	3372628
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	5000.05	4999.93	3372112
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	5000.05	4999.93	3372121
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	? (TO)	5000.05	4999.92	3372157
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	5000.05	4999.82	3372337
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	5000.05	4999.93	3372925
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	5000.05	4999.82	3372895
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	5000.05	4999.92	3372859
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	5000.05	5000.11	3372760
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	5000.05	4999.93	3372400
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	5000.05	4999.93	3372715
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	5000.05	5000.03	3372451
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	5000.05	4999.93	3372682
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	5000.06	4999.93	3372127
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	5000.06	4999.92	3372736
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	5000.06	4999.95	3372712
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	5000.06	4999.92	3372145
industrial/palacios/medium/ cube-11-h14-sat.cnf	? (TO)	5000.06	4999.93	3372133
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	5000.07	4999.95	3372826
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	? (TO)	5000.07	4999.84	3372103
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	5000.07	4999.92	3372226
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	5000.07	4999.93	3372460
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	5000.07	5000.02	3372739
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	5000.07	5000.14	3372724
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	? (TO)	5000.07	4999.95	3372658
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	5000.07	4999.96	3372700
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	5000.08	4999.93	3372979
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	? (TO)	5000.08	5000.13	3372163
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	? (TO)	5000.08	5000.02	3372166
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (TO)	5000.08	4999.96	3372445
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	5000.08	4999.96	3372673
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	5000.08	5000.34	3372685
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	5000.08	4999.92	3372745
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	? (TO)	5000.08	4999.92	3372748
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	5000.08	4999.92	3372898
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	? (TO)	5000.08	4999.94	3372943
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	5000.09	4999.94	3372553
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	5000.09	4999.93	3372808
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	5000.09	4999.94	3372721
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (TO)	5000.09	4999.98	3372448
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	5000.1	5000.05	3372406
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	5000.1	4999.93	3372256
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	5000.1	5000.02	3372733
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	? (TO)	5000.1	5000.24	3372697
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	5000.11	5000.07	3372424
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	5000.11	4999.96	3372415
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	5000.11	4999.92	3372343
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	5000.11	4999.95	3372247
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	5000.11	5000.04	3372706
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	? (TO)	5000.11	4999.92	3372259
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	5000.11	5000.02	3372352
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	5000.11	4999.96	3372235
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	5000.12	5000.03	3372664
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	5000.12	5000.02	3372229
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	5000.12	5000.01	3372454
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	5000.12	4999.95	3372727
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	5000.12	5000.07	3372835
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	5000.12	4999.93	3372238
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	5000.12	5000.12	3372232
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	5000.12	4999.99	3372574
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	? (TO)	5000.12	4999.99	3372505
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	5000.12	5000.03	3372667
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	5000.13	4999.95	3372694
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	5000.13	5000.23	3372097
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	5000.13	5000.06	3372244
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	? (TO)	5000.13	5000.03	3372892
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	5000.13	4999.98	3372838
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	5000.14	4999.96	3372661
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	5000.14	5000.23	3372676
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	? (TO)	5000.15	4999.94	3372922
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	5000.15	5000.01	3372436
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	5000.15	5000.17	3372457
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	5000.16	5000.08	3372850
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	5000.16	4999.98	3372430
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	5000.16	5000.02	3372439
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	5000.17	5000.02	3372469
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	5000.17	5000.1	3372409
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	5000.19	5000.03	3372484

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver Lingeling 587f (fixed) (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (117 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (91 runs) [Show/Hide]

Solver timed out (no solution given) (92 runs) [Show/Hide]