SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.020996	0.0163999	3362420
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.032994	0.033206	3362322
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.074988	0.07483	3362324
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.333948	0.128076	3362404
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	0.400938	0.400477	3362158
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.919859	0.282922	3361926
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	0.990848	0.68791	3362316
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	1.26781	1.26753	3361874
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	1.47778	1.33542	3362180
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	1.86172	1.54073	3362182
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	2.48562	1.81833	3362196
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	2.74358	2.23676	3362174
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	3.16952	3.17221	3361876
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	4.39833	1.13982	3362408
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	4.67529	3.33581	3362170
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	6.68198	3.87723	3362186
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	7.67683	2.25132	3362300
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	12.3891	12.3891	3362442
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	12.6741	4.50236	3362194
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	13.048	6.13702	3361982
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	13.444	5.65826	3362178
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	15.5396	13.3953	3362440
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	16.4265	4.99829	3362118
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	17.0024	12.2487	3361872
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	17.8133	6.067	3362172
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	19.809	6.09601	3362160
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	22.4176	6.00325	3362356
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	26.381	18.8924	3362146
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	33.092	11.7794	3362098
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	41.2117	10.5144	3362298
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	41.2777	11.7113	3362044
manol-pipe-c6bidw_i.cnf	UNSAT	41.8606	11.5881	3361914
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	43.8543	14.7783	3362122
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	51.5442	15.7068	3361884
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	51.5982	13.2489	3362358
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	56.2175	14.2166	3362294
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	57.8112	16.1418	3362198
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	59.178	16.3085	3362176
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	62.9814	18.0369	3362426
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	65.0121	17.9669	3361844
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	74.8086	21.7597	3361984
manol-pipe-f7nidw.cnf	UNSAT	79.4199	23.188	3361918
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	82.2385	20.7058	3362314
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	89.4324	22.446	3361860
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	111.398	30.1502	3361978
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	125.905	32.7134	3362414
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	126.651	35.2207	3362328
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	128.04	32.9521	3362184
velev-pipe-o-uns-1.1-6.cnf	UNSAT	132.934	34.1662	3362022
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	159.172	41.5599	3361970
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	190.772	177.638	3362134
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	234.24	59.143	3361968
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	277.677	69.5194	3362406
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	357.46	89.6229	3362242
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	410.206	104.076	3362100
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	431.976	109.615	3362110
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	440.196	400.863	3362140
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	447.042	113.218	3362208
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	451.325	138.517	3361974
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	466.659	118.046	3362216
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	480.11	121.528	3362202
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	491.287	126.384	3361992
velev-pipe-o-uns-1.0-7.cnf	UNSAT	499.079	126.84	3362024
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	526.978	133.18	3362214
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	534.659	135.04	3362206
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	568.09	143.203	3362218
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	664.615	166.212	3362394
manol-pipe-c10nidw.cnf	UNSAT	723.068	186.121	3361910
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	930.143	233.596	3362114
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	934.669	234.202	3362132
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	1137.71	285.654	3362190
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	1200.63	302.659	3361950
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	1218.18	304.909	3362240
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	1241.68	312.437	3362192
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	1241.8	1238.76	3362136
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	1269.89	324.186	3361924
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	1302.58	326.788	3362168
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	1356.4	341.949	3362092
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	1676.57	419.348	3362402
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	1680.08	423.8	3361864
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	2141.12	540.323	3361990
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT	2358.87	590.622	3361890
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT	2440.35	611.025	3361888
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	2725.98	686.112	3362312
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	2855.8	721.989	3362346
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	UNSAT	3012.87	754.385	3362412
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT	3040.25	761.114	3361892
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	3451.62	863.966	3361886
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	4173.63	1045.43	3362128
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	UNSAT	4859.13	1220.99	3361928
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	4910.02	1232.02	3362040
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	5227.39	1325.86	3362344
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	5453.06	1365.78	3361880
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	5589.33	1423.52	3362396
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	UNSAT	6232.73	1569.79	3361854
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT	6235.05	1563.24	3361988
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	UNSAT	7166.17	1792.19	3362336
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	UNSAT	7470.5	1896.44	3362200
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	9351.99	2338.73	3361954
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT	9955.02	2579.79	3362334
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	UNSAT	10476.5	2619.27	3362398
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	UNSAT	11077.2	2772.5	3362252
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	11498.6	2935.75	3361858
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	UNSAT	12985.4	3263.16	3361852
industrial/fuhs/hard/ AProVE07-01.cnf	UNSAT	13610.5	3403.78	3361862
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	UNSAT	14307.2	3577.22	3362006
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	UNSAT	18085.4	4525.12	3362156
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	UNSAT	18199.9	4560.81	3362236
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	UNSAT	19905.5	4979.78	3361938

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.009998	0.0125311	3362384
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.021995	0.013491	3362392
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.025995	0.02262	3362386
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.030995	0.023879	3362416
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.034994	0.0160331	3362286
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.065989	0.04019	3362388
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.420935	0.200586	3362418
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.827873	0.671372	3362400
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1.09583	0.984045	3362012
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	1.3248	0.941759	3362028
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.44578	1.35823	3362008
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	2.13468	1.56826	3362036
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	2.37864	1.61271	3362124
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	2.44663	1.9767	3361986
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	3.64045	2.20048	3362032
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	3.85641	2.35933	3362350
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	3.87441	3.60844	3362154
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	4.63729	1.17342	3362284
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	4.84526	4.14342	3362142
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	4.91725	4.45325	3362152
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	5.40118	2.37371	3362030
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	6.58	4.86768	3362046
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	6.69298	4.48277	3362004
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	6.69798	5.93579	3362148
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	7.94879	6.29911	3362038
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	8.5337	5.59234	3362034
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	10.7084	3.11333	3362304
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	13.475	11.1096	3362042
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	15.1187	3.9479	3362372
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	21.0608	5.427	3362374
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	21.1468	21.1362	3362144
application/manthey/ traffic/traffic_r_sat.cnf	SAT	21.8967	11.8162	3362212
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	23.0925	20.3645	3362368
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	25.7611	21.768	3362366
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	39.681	10.5691	3361962
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	41.5647	12.2078	3361906
ibm-2004-01-k90.cnf	SAT	48.2537	12.961	3361922
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	54.3427	17.1398	3362326
ibm-2002-21r-k95.cnf	SAT	61.2667	19.0457	3362026
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	94.3017	28.4592	3362056
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	95.4845	25.2181	3362254
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	114.942	35.566	3361976
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	115.106	33.0906	3362120
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	118.47	30.2664	3361956
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	136.849	42.3667	3362112
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	155.384	40.6816	3362108
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	163.069	44.1084	3362002
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	194.403	49.8953	3362302
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	199.704	52.3523	3362000
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	238.049	66.9824	3362102
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	238.116	64.6636	3362310
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	312.244	82.9445	3361994
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	318.306	81.5173	3362296
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	439.25	111.013	3362250
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	460.972	115.281	3362280
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	547.454	140.665	3361980
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	569.947	163.169	3362308
ibm-2004-23-k100.cnf	SAT	647.122	165.307	3361916
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	669.564	179.861	3361870
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	728.806	182.914	3361882
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	757.173	194.927	3362076
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	822.781	206.767	3362424
mizh-sha0-36-4.cnf	SAT	831.996	208.738	3361912
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	834.967	213.229	3361848
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	986.86	249.178	3361894
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	1008.19	252.809	3362422
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	1131.74	284.069	3362130
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	1298.56	325.005	3362376
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	1302.64	328.514	3362210
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	1409.95	356.934	3361850
ibm-2002-30r-k85.cnf	SAT	1639.11	413.129	3361920
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	2339.59	586.434	3362246
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	2399.96	600.731	3361966
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	3278.73	819.764	3362292
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	4512.33	1131.9	3361904
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	5289.16	1327.63	3361996
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	5406.59	1352.33	3361964
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	5792.71	1450.07	3361896
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	SAT	5896.75	1477.77	3362072
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	6261.8	1566.75	3362220
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	8751.5	2188.68	3362370
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	9881.65	2475.97	3361998
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	10591.8	2660.66	3362204
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	SAT	11618.5	2905.93	3362248
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	SAT	18306.7	4587.34	3361868

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	20235.6	5100.02	3362320
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	20303.7	5100.03	3362318
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	? (TO)	20372.4	5100.03	3362138
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	20376	5100.03	3362348
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	20381.1	5100.02	3361946
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	20381.7	5100.02	3361942
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	20383.8	5100.02	3361856
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	? (TO)	20385.4	5100.02	3362014
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	20385.4	5100.03	3361940
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	20386.1	5100.02	3362074
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	20387.2	5100.02	3362084
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	20387.2	5100.02	3362150
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	20387.6	5100.02	3362188
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	20388.7	5100.02	3362166
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	20389.9	5100.02	3361866
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	20390	5100.03	3362352
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	20390.5	5100.02	3362164
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	20392.5	5100.03	3362228
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	20392.5	5100.03	3362224
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	20392.6	5100.02	3362340
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	20392.7	5100.03	3362222
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	20393	5100.02	3362274
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	? (TO)	20393	5100.02	3361948
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	20393.5	5100.02	3362266
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	20393.9	5100.02	3361932
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	20394.2	5100.02	3362264
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	20394.6	5100.03	3362338
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	20394.8	5100.02	3362238
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	20394.8	5100.02	3362260
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	20394.8	5100.02	3361936
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	20395	5100.03	3362234
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	20395	5100.02	3362230
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	20395.1	5100.02	3362232
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	20395.4	5100.02	3362162
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	20395.6	5100.02	3362380
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	20395.8	5100.03	3362306
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	20395.8	5100.02	3362244
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	20396.4	5100.02	3362268
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	20396.6	5100.02	3362256
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	20396.7	5100.02	3362378
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	20396.7	5100.03	3362332
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	20396.7	5100.02	3362262
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	20397.2	5100.03	3361952
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	20397.3	5100.02	3362258
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	20397.5	5100.02	3362226
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	20397.6	5100.02	3362330
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	20397.6	5100.02	3361958
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	20397.7	5100.02	3361960
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	20397.8	5100.02	3362270
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	20397.8	5100.02	3361944
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	? (TO)	20398.4	5100.02	3362410
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	20398.4	5100.03	3362016
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	20398.4	5100.02	3362010
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	20398.4	5100.02	3361934
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	20398.5	5100.03	3362342
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	20398.7	5100.03	3362282
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	20398.9	5100.02	3361878
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	20398.9	5100.02	3362272
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	20399	5100.02	3362276
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	20399.2	5100.02	3362278
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	20399.4	5100.03	3362290
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	20399.4	5100.02	3361930
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	20399.7	5100.02	3362354
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	20399.9	5100.03	3362288

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	? (exit code)	0.009997	0.0130269	3362382
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	? (exit code)	18.8281	25.2378	3361972
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	? (exit code)	27.2119	12.7649	3362438
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	? (exit code)	32.4891	18.9919	3361900
velev-pipe-sat-1.0-b9.cnf	? (exit code)	41.5047	16.9535	3362020
velev-npe-1.0-9dlx-b71.cnf	? (exit code)	45.808	23.5604	3362018
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	? (exit code)	80.0768	30.944	3361902
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	? (exit code)	88.7805	33.76	3362060
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	? (exit code)	99.2999	36.1022	3362096
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	? (exit code)	112.15	39.0397	3362066
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	? (exit code)	146.411	41.1785	3362116
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	? (exit code)	163.398	44.9461	3362126
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	? (exit code)	245.188	71.7159	3362106
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	? (exit code)	305.376	85.3599	3362050
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (exit code)	1811.89	463.855	3362080
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (exit code)	2075.59	538.131	3362068
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (exit code)	2273.3	579.124	3362094
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (exit code)	2453.03	631.27	3361898
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (exit code)	2461.95	634.59	3362364
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (exit code)	2530.24	642.605	3362360
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (exit code)	2618.55	671.798	3362104
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (exit code)	3081.35	792.491	3362432
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (exit code)	3128.06	817.773	3362362
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	? (exit code)	3137.44	794.966	3362090
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	? (exit code)	3613.52	911.259	3362390
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	? (exit code)	4055.73	1023.05	3362062
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (exit code)	4097.26	1040.22	3362054
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (exit code)	4403.78	1112.5	3362436
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (exit code)	4616.89	1193.58	3362078
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (exit code)	5617.39	1430.62	3362434
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (exit code)	5827.39	1489.63	3362048
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (exit code)	5942.54	1503.13	3362088
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (exit code)	6480.68	1630.09	3362052
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	? (exit code)	6577.36	1652.79	3362430
velev-vliw-uns-4.0-9-i1.cnf	? (exit code)	6664.6	1695.59	3361908
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (exit code)	7280.56	1848.38	3362058
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (exit code)	8129.01	2050.73	3361846
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	? (exit code)	8228.16	2078.85	3362070
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	? (exit code)	10482.4	2629.72	3362428
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (exit code)	12472.9	3126.77	3362086
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (exit code)	12663.1	3201.54	3362082
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (exit code)	14528.7	3644.12	3362064

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (109 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (85 runs) [Show/Hide]

Solver timed out (no solution given) (64 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (42 runs) [Show/Hide]