SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.024995	0.0176039	3362419
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.034993	0.0343541	3362321
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.075987	0.077127	3362323
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.315951	0.122719	3362403
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	0.413936	0.414763	3362157
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.809876	0.259439	3361925
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	0.812875	0.642997	3362315
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	1.26581	1.26597	3361873
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	1.37079	1.30786	3362179
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	1.9397	1.66047	3362181
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	2.28365	1.77276	3362195
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	2.75958	2.23699	3362173
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	3.16752	3.17664	3361875
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	3.90141	1.29451	3362299
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	5.11422	1.32056	3362407
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	5.65614	3.51601	3362169
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	6.06808	3.69002	3362185
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	12.0472	4.33981	3362193
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	12.0572	3.91039	3362117
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	12.7251	5.68645	3362177
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	12.817	12.8177	3362441
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	12.849	5.99315	3361981
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	15.0397	12.9389	3362439
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	15.7206	5.71062	3362171
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	17.2434	12.3129	3361871
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	17.3634	4.71417	3362355
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	18.0503	5.59163	3362159
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	27.4488	19.1256	3362145
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	34.8687	12.6367	3362121
manol-pipe-c6bidw_i.cnf	UNSAT	35.8226	10.0062	3361913
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	36.4455	9.48124	3362357
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	40.0379	10.2465	3362297
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	49.2345	12.4748	3362313
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	50.6823	14.0941	3362043
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	62.6695	17.8796	3362425
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	65.2211	19.8472	3362097
manol-pipe-f7nidw.cnf	UNSAT	66.1099	20.0044	3361917
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	68.3236	18.6823	3361843
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	70.8852	17.935	3362293
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	73.5898	21.465	3361983
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	75.5715	21.7278	3361883
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	88.5815	24.4804	3361977
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	89.3124	23.8945	3362175
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	89.5384	24.14	3362197
velev-pipe-o-uns-1.1-6.cnf	UNSAT	103.693	26.9378	3362021
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	107.891	30.581	3362327
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	108.05	27.1288	3361859
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	116.712	30.2523	3362183
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	166.986	43.1092	3362413
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	169.949	44.3632	3361969
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	184.415	166.466	3362133
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	234.083	58.7828	3362405
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	245.312	62.3282	3361967
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	397.009	363.945	3362139
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	436.365	111.11	3362099
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	448.118	113.726	3362215
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	452.664	114.919	3362213
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	476.545	120.935	3362201
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	483.743	122.743	3362207
velev-pipe-o-uns-1.0-7.cnf	UNSAT	490.865	127.83	3362023
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	491.609	149.818	3361973
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	510.06	129.393	3362109
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	526.053	133.141	3362205
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	562.496	142.005	3362217
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	622.254	156.299	3362241
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	642.475	164.605	3361991
manol-pipe-c10nidw.cnf	UNSAT	656.786	169.48	3361909
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	976.385	246.991	3362191
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	1043.43	272.165	3362393
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	1139.26	287.359	3362113
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	1157.97	291.538	3362189
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	1240.85	1238.14	3362135
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	1292.93	326.92	3362091
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	1323.27	332.864	3362401
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	1330.09	333.793	3362239
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	1357.53	341.428	3362167
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	1400.24	357.697	3361923
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	1497.1	375.571	3362311
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	1610.07	404.175	3362131
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	1780.68	446.737	3361863
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	2011.1	504.438	3361949
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	2419.18	611.106	3361989
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT	2432.4	610.334	3361887
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	2660.77	675.414	3362345
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT	2703.07	678.551	3361889
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT	2930.4	735.46	3361891
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	3484.06	874.01	3361885
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	3653.74	917.916	3362127
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	3960.36	993.144	3361879
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	4573.36	1153.06	3362039
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	4716.27	1200.61	3362343

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.023995	0.022649	3362385
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.025995	0.0154791	3362383
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.028995	0.017594	3362391
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.049991	0.0348781	3362387
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.05999	0.024467	3362285
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.072988	0.0420011	3362415
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.302953	0.173575	3362417
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.803877	0.661548	3362399
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1.05584	0.971941	3362011
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	1.2888	0.942176	3362027
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.42678	1.35539	3362007
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	1.72774	1.44776	3362123
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	2.10368	1.55848	3362035
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	2.32565	1.95156	3361985
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	3.2925	2.25597	3362349
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	3.3085	0.837954	3362283
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	3.9224	3.67422	3362153
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	4.28635	2.39555	3362031
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	4.95325	4.55619	3362151
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	5.15221	1.39996	3362373
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	5.21921	4.27769	3362141
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	5.56315	4.5971	3362045
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	6.567	6.01945	3362147
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	6.61299	2.30356	3361961
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	6.79197	4.5068	3362003
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	8.49971	6.48792	3362037
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	9.54255	5.8228	3362033
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	11.9192	3.99609	3362029
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	13.6469	11.4742	3362041
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	20.5259	5.57547	3362303
application/manthey/ traffic/traffic_r_sat.cnf	SAT	21.3977	11.6191	3362211
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	21.4407	21.4272	3362143
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	24.6113	21.4841	3362365
ibm-2004-01-k90.cnf	SAT	24.7332	7.09499	3361921
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	24.9192	20.8684	3362367
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	32.66	13.2459	3362055
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	38.3062	11.3567	3361905
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	49.7114	13.0562	3361881
ibm-2002-21r-k95.cnf	SAT	64.7891	19.9332	3362025
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	70.9192	19.1094	3362301
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	72.0161	21.5452	3362325
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	114.132	29.3163	3361955
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	124.304	37.9242	3361975
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	129.787	35.8214	3362001
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	142.297	44.1274	3362111
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	151.988	38.1178	3362291
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	157.888	41.9836	3361999
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	167.338	43.2242	3362245
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	174.292	48.7797	3362309
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	174.887	45.5607	3362107
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	182.662	66.4264	3362307
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	186.884	47.7184	3362423
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	191.558	52.4344	3362119
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	284.947	74.2208	3362209
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	304.958	78.4422	3362295
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	384.106	100.775	3361993
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	399.683	100.411	3362371
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	507.017	128.147	3362129
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	705.575	177.568	3361965
ibm-2004-23-k100.cnf	SAT	760.824	194.679	3361915
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	765.327	195.852	3361979
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	1038.52	262.099	3361895
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	1050.89	269.096	3362075
mizh-sha0-36-4.cnf	SAT	1132.67	284.637	3361911
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	1224.74	319.429	3361869
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	SAT	1325.66	333.526	3362237
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	1761.63	450.985	3362203
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	SAT	2167.99	544.679	3362247
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	2216.32	557.167	3362253
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	2450.24	615.248	3362421
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	2539.64	638.189	3362249
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	2638.55	664.102	3361893
ibm-2002-30r-k85.cnf	SAT	2704.07	681.221	3361919
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	3613.31	905.896	3362369
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	3669.15	921.187	3362219
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	4299.52	1082.21	3361849
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	4366.1	1100.25	3361995
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	SAT	4589.91	1160.42	3361867

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	4800.01	1204.12	3362063
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	4800.02	1204.33	3361935
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	4800.03	1203.82	3362225
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	4800.04	1203.72	3361861
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	4800.04	1204.72	3362221
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (TO)	4800.04	1209.52	3362077
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	4800.05	1203.34	3362397
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	4800.06	1204.12	3362235
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	4800.06	1203.92	3362015
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	4800.08	1205.54	3361865
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	? (TO)	4800.08	1211.33	3362429
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	4800.08	1206.23	3361855
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	4800.08	1205.82	3362199
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	4800.09	1203.82	3362265
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	4800.09	1204.22	3362251
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	4800.09	1207.74	3361941
velev-vliw-uns-4.0-9-i1.cnf	? (TO)	4800.1	1221.83	3361907
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	4800.1	1204.02	3361931
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	? (TO)	4800.1	1203.44	3362395
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	4800.11	1207.52	3362051
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	4800.11	1203.62	3362267
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	4800.11	1203.72	3362271
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	4800.12	1204.63	3362411
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	4800.12	1227.12	3362317
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	4800.12	1205.54	3362081
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	4800.12	1208.94	3362087
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	4800.13	1205.02	3362351
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	4800.14	1203.92	3362005
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	4800.14	1208.53	3361845
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	4800.15	1204.13	3361957
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	4800.15	1203.72	3362287
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	? (TO)	4800.15	1208.53	3361997
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	? (TO)	4800.15	1203.22	3362375
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	4800.15	1203.73	3362289
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	? (TO)	4800.16	1204.32	3361963
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	4800.16	1203.02	3362341
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	4800.16	1208.63	3362047
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	4800.16	1204.04	3362335
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	4800.17	1203.93	3362269
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	4800.17	1203.32	3362009
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	4800.17	1205.73	3362155
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	4800.17	1204.04	3362333
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	4800.17	1203.53	3362337
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	4800.17	1204.23	3361959
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	4800.18	1204.03	3362379
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	? (TO)	4800.18	1202.82	3362279
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	4800.18	1205.83	3361939
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	4800.19	1206.02	3362071
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	4800.19	1242.82	3362319
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	4800.2	1204.93	3362223
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	? (TO)	4800.2	1207.92	3361847
SAT_RACE08/Q1/ SAT_dat.k85.cnf	? (TO)	4800.2	1206.02	3361903
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	4800.2	1203.22	3362353
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	4800.2	1204.44	3362243
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	4800.2	1204.32	3362263
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	4800.21	1204.33	3362305
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	4800.21	1204.72	3361937
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	4800.22	1204.62	3362083
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	4800.22	1210.04	3361927
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	4800.22	1204.02	3361951
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	4800.23	1203.52	3361929
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	? (TO)	4800.23	1203.62	3362409
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	4800.23	1222.23	3362433
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	4800.24	1204.44	3362231
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	4800.25	1203.53	3362161
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	4800.25	1204.04	3362261
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	4800.25	1206.42	3362149
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	? (TO)	4800.26	1207.02	3362013
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	? (TO)	4800.26	1207.42	3361853
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	4800.26	1202.93	3362275
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	? (TO)	4800.28	1205.83	3362069
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	4800.29	1203.73	3362281
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	4800.29	1206.13	3362165
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	4800.29	1204.23	3362377
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	4800.3	1202.92	3361877
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	4800.3	1203.12	3361943
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	4800.3	1204.12	3361947
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	4800.3	1205.63	3362187
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	4800.32	1203.53	3362277
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	4800.33	1204.23	3362339
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	4800.35	1205.03	3362227
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	4800.36	1204.62	3362073
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	4800.37	1204.13	3362255
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	? (TO)	4800.37	1206.02	3361857
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	4800.38	1204.23	3362229
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	4800.38	1208.23	3361987
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	4800.38	1203.42	3362257
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	4800.39	1203.82	3361933
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	4800.39	1203.92	3362259
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	? (TO)	4800.39	1203.53	3361953
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	4800.39	1203.72	3362233
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	4800.4	1208.72	3362347
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	4800.4	1204.02	3362331
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	4800.4	1205.43	3362163
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	4800.41	1204.53	3362273
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	? (TO)	4800.41	1212.44	3362427
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	4800.42	1205.22	3362085
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	4800.42	1203.84	3362329
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	? (TO)	4800.42	1207.73	3362137
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (TO)	4800.43	1207.73	3361851
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	4800.43	1205.74	3362057
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	4800.44	1207.74	3361945

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	? (exit code)	0.028994	0.016104	3362381
velev-pipe-sat-1.0-b9.cnf	? (exit code)	13.5619	9.95246	3362019
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	? (exit code)	18.1762	23.8876	3361971
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	? (exit code)	21.0428	11.0929	3362437
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	? (exit code)	55.3446	25.3597	3361901
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	? (exit code)	62.0166	26.5343	3361899
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	? (exit code)	73.9508	29.0895	3362105
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	? (exit code)	77.2153	30.4385	3362065
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	? (exit code)	135.055	38.4071	3362115
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	? (exit code)	160.578	44.4239	3362125
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	? (exit code)	169.71	53.0557	3362095
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	? (exit code)	184.474	57.5371	3362059
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	? (exit code)	307.404	85.9374	3362049
velev-npe-1.0-9dlx-b71.cnf	? (exit code)	609.472	164.979	3362017
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (exit code)	1714.77	447.005	3362435
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (exit code)	1885.29	486.387	3362079
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (exit code)	1893.3	491.576	3362067
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	? (exit code)	1924.5	493.304	3362101
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (exit code)	2014	520.24	3362093
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (exit code)	2195.49	585.475	3362363
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (exit code)	2267.39	586.754	3362103
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (exit code)	2456.46	637.423	3362053
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	? (exit code)	2593.31	660.468	3362089
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (exit code)	2783.97	714.033	3362359
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (exit code)	2981.62	757.22	3361897
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (exit code)	3139.09	814.777	3362431
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	? (exit code)	3465.84	876.856	3362389
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	? (exit code)	3938.09	995.88	3362061
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (exit code)	3965.68	1024.65	3362361

SAT 2011 Competition: main competition (phase 1): benchmarks results per solver

Result page for solver SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (91 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (78 runs) [Show/Hide]

Solver timed out (no solution given) (102 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (29 runs) [Show/Hide]