SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	2.73458	1.19757	3381326
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	3.88341	1.60566	3380577
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	4.90125	1.58845	3381330
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	19.0061	11.9038	3380892
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	19.754	6.97182	3381132
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	24.1623	13.3725	3381148
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	25.1012	6.58753	3380868
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	27.5768	14.5906	3380906
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	31.0503	14.9924	3380884
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	40.6098	7.94799	3381126
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	UNSAT	41.8086	11.8052	3381334
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	49.4195	30.9694	3380525
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	55.9525	7.95948	3381328
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	63.1744	11.0733	3381234
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	70.7013	66.1975	3380527
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	72.311	11.3643	3381146
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	82.4255	18.0951	3380828
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	88.2846	48.9003	3380880
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	97.4732	29.8842	3380904
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	114.48	51.1737	3380896
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	134.402	39.2483	3380870
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	138.087	56.327	3380888
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	151.303	22.3539	3381130
velev-pipe-o-uns-1.1-6.cnf	UNSAT	152.945	28.2602	3380729
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	166.696	23.5639	3381236
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	167.246	23.4257	3380952
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	167.598	45.3344	3380494
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	189.267	114.191	3380638
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	195.504	69.1981	3380522
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	235.451	106.516	3380832
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	237.491	31.0374	3381324
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	241.84	53.8843	3380882
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	275.8	65.0327	3380810
manol-pipe-c6bidw_i.cnf	UNSAT	301.401	55.4919	3380565
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	302.193	58.0209	3380886
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	312.397	227.352	3381362
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	331.507	95.959	3381348
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	332.672	201.937	3380856
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	334.222	61.4483	3380754
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	335.873	65.3376	3380908
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	339.533	193.247	3380846
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	346.726	134.124	3380535
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	350.932	73.9088	3380626
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	366.547	61.3955	3381191
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	411.304	52.5481	3381332
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	420.819	55.7172	3380950
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	437.493	202.35	3380808
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	455.231	149.779	3380844
manol-pipe-f7nidw.cnf	UNSAT	458.5	178.672	3380569
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	459.003	396.259	3381364
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	459.48	83.4917	3380820
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	464.771	100.048	3380634
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	506.424	112.196	3380640
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	528.143	68.1007	3380601
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	538.691	74.529	3381336
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	596.094	246.577	3380836
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	713.33	90.5373	3380510
velev-pipe-o-uns-1.0-7.cnf	UNSAT	753.159	114.664	3380731
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	780.321	329.946	3380850
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	1023.15	132.957	3380842
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	1026.09	166.235	3380902
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	1126.06	626.787	3380760
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	1165.75	160.609	3380894
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	1465.34	195.089	3380824
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	1573.75	224.292	3380624
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	1741.48	236.665	3380900
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	UNSAT	1793.48	225.39	3381320
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	1874.19	235.47	3381316
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	2004.6	266.677	3380878
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	2202.34	377.361	3380648
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	2257	594.767	3380630
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	UNSAT	2280.92	288.679	3381195
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	2283.29	418.624	3380802
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	2577.63	352.317	3380838
manol-pipe-c10nidw.cnf	UNSAT	2838.05	578.367	3380561
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	2881.89	388.21	3380918
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	2919.32	392.492	3380926
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	2943.22	394.579	3380916
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	2983.89	403.427	3380924
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	2985.79	402.803	3380912
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	3536.04	484.784	3380780
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	3594.45	470.864	3380928
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	3870.99	588.463	3380646
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	UNSAT	4181.21	527.365	3380962
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	4372.49	1110.82	3380800
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	4383.11	550.225	3381318
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	4771.63	4689.73	3381360
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	6512.53	818.292	3380514
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	UNSAT	6757.08	857.22	3381138
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT	7783.9	1134.02	3381240
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	UNSAT	8220.39	1191.04	3381358
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	8868.38	1116.25	3381144
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	UNSAT	8871.39	1118.28	3380872
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	UNSAT	8964.94	1126.7	3381197
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	UNSAT	9111.76	1161.71	3380599
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	13383.5	1911.96	3381209
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	18497.7	2321.07	3380531
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	UNSAT	20983.5	2711.68	3380504
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	UNSAT	21373.1	2684.22	3381199
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	21951.5	2788.36	3380508
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT	22886.6	2974.25	3380644
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	24646.3	3128.67	3380575
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	24673	3107.1	3380605
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	UNSAT	25430.4	3078.29	3380579
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	39457.5	4958.22	3380537

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	3.2815	1.62723	3381340
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	4.66929	4.15119	3381322
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	4.75628	3.29719	3381284
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	5.2772	1.45966	3381116
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	7.00094	6.27209	3380668
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	9.40457	8.65917	3380664
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	11.8912	10.28	3380834
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	12.5151	8.64959	3380738
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	18.9851	14.1153	3381228
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	22.8635	7.20917	3380613
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	32.3861	10.7756	3381136
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	34.7867	16.199	3380746
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	36.5854	30.1079	3380642
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	44.3023	22.14	3380742
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	65.4461	57.0395	3380852
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	72.66	49.8637	3380864
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	75.5065	21.2431	3380740
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	75.7455	13.6163	3380615
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	87.5077	74.1315	3380862
ibm-2004-01-k90.cnf	SAT	100.878	24.9215	3380573
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	119.273	93.0404	3380744
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	138.822	85.8324	3380756
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	164.834	113.255	3380858
application/manthey/ traffic/traffic_r_sat.cnf	SAT	164.98	144.974	3380922
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	180.64	51.6355	3380818
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	187.901	118.845	3380660
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	192.734	32.3313	3380607
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	199.94	184.398	3381244
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	202.67	170.775	3381246
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	210.156	50.4523	3380557
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	234.433	188.78	3380848
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	237.001	142.956	3380748
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	241.184	38.5319	3380617
ibm-2002-21r-k95.cnf	SAT	249.721	89.0799	3380733
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	294.341	40.667	3381282
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	299.305	54.2217	3381134
velev-pipe-sat-1.0-b9.cnf	SAT	330.794	298.056	3380727
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	357.455	131.236	3380830
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	380.648	57.154	3381344
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	388.355	53.2851	3381286
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	418.352	198.866	3380766
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	470.605	226.491	3380822
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	474.042	91.578	3381142
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	483.526	88.1382	3381158
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	507.233	398.194	3380752
mizh-sha0-36-4.cnf	SAT	508.837	73.3248	3380563
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	525.822	272.242	3380826
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	530.303	81.3577	3381346
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	571.272	92.4247	3381128
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	581.376	107.569	3380656
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	675.78	157.058	3380658
industrial/crypto/ mizh-sha0-36-2.cnf	SAT	681.328	96.6185	3380533
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	763.54	160.976	3380920
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	SAT	824.805	228.684	3380496
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	876.37	756.635	3380551
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	883.19	192.418	3380650
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	SAT	952.118	147.132	3381230
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	1041.57	209.665	3380632
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	1089.8	851.089	3380806
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	1100.37	149.591	3380840
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	1174.52	849.085	3380816
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	1321.32	180.49	3380670
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	1373.62	198.163	3380547
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	1459.7	1035.59	3380770
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	1469.63	1049.83	3380776
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	1706.12	312.785	3380498
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	1734.67	307.946	3381140
ibm-2004-23-k100.cnf	SAT	1914.92	306.863	3380567
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	1927.48	329.43	3380500
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	2021.84	624.889	3380914
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	SAT	2356.48	303.306	3380609
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	SAT	2530.05	327.541	3380948
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	2695.47	404.455	3380636
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	3335.22	438.242	3380964
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	3498.85	458.342	3380956
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	3572.86	493.796	3380545
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	3984.07	500.296	3381112
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	4806.89	608.394	3381280
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	6256.06	888.633	3380652
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	6286.73	3080.52	3381300
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	7270.12	972.377	3380555
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	SAT	7602.69	953.852	3381120
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	SAT	7862.52	998.904	3380930
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	8751.16	1097.66	3381124
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	SAT	9546.74	1281.22	3380758
ibm-2002-30r-k85.cnf	SAT	10713.7	1402.8	3380571
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	SAT	10852.3	1416.1	3380782
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	SAT	13022	1644.38	3380958
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	13066.2	1653.79	3380960
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	SAT	24817.3	3119.99	3381288

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	?	38314.3	4910.43	3380654
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	?	39020.1	4911.45	3380934
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	?	39029.4	4904.71	3381205
APPLICATIONS/bitverif/ smulo/smulo064.cnf	?	39057.2	4908.46	3380587
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	?	39086.4	4906.32	3380662
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	?	39116.1	4998.56	3380860
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	?	39198.1	4928.95	3380938
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	?	39428.7	5001.65	3380910
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	?	39439.9	4998.94	3380898
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	?	39469.9	5000.86	3380506
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	?	39494.8	5000.75	3380876
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	?	39664.5	4996.01	3380591
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	?	39684.3	4997.88	3380866
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	?	39708	5000.27	3380589
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	?	39729.8	4999.7	3380874
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	?	39733.5	5000.52	3380932
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	?	39746.5	5000.46	3380976
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	?	39746.6	4999.64	3380944
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	?	39748.6	5001.05	3380583
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	?	39765.2	4998.67	3380974
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	?	39766.2	5002.61	3380942
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	?	39771.1	4998.21	3380970
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	?	39774.2	5002.14	3380946
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	?	39780.2	4997.26	3381290
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	?	39780.8	4996.48	3381114
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	?	39781.3	4998.11	3380954
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	?	39781.3	4999.94	3380940
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	?	39781.5	4999.84	3381106
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	?	39786.6	4998.9	3381203
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	?	39788.8	5001.88	3380539
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	?	39790.1	5001.97	3380543
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	?	39794.5	4998.91	3380966
industrial/fuhs/hard/ AProVE07-01.cnf	?	39796.6	4996.57	3380512
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	?	39796.9	4998.66	3380936
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	?	39798	4997.65	3380672
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	?	39800.6	4999.5	3381193
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	?	39801.9	4998.68	3380611
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	?	39808.1	5001.56	3380541
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	?	39814.9	4997.68	3381100
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	?	39816	4999.62	3381201
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	?	39819.9	5000.43	3381232
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	?	39821.2	4998.84	3381102
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	?	39822.5	4999.07	3380972
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	?	39827.2	4999.95	3380968
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	?	39828.9	4999.23	3380666
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	?	39830.5	4997.22	3381122
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	?	39831.8	5000.2	3381110
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	?	39833	4998.95	3380595
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	?	39833.4	5001.91	3380581
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	?	39839.4	5000.57	3380529
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	?	39934.5	5000.2	3381108

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	? (TO)	145	5100.04	3380854
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	? (TO)	916.71	5100.09	3380553
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	? (TO)	5098.91	5100.24	3380628
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	40313.9	4998.06	3380603
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	42043.4	4997.72	3380585
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	42150.2	4997.62	3381104

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (MO)	2085.52	316.012	3380792
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (MO)	2187.6	328.677	3380768
industrial/palacios/medium/ cube-11-h14-sat.cnf	? (MO)	2359.89	598.173	3380520
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	? (MO)	2400.93	723.887	3380786
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	? (MO)	2502.98	936.694	3380812
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	? (MO)	2562.59	1026.83	3380788
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	? (MO)	2590.09	501.694	3380518
velev-npe-1.0-9dlx-b71.cnf	? (MO)	2789.01	1581.84	3380725
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (MO)	2870.74	397.017	3380774
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (MO)	2891.73	399.595	3380796
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (MO)	3284.24	1443.22	3380764
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (MO)	3647.56	1914.65	3380814
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	? (MO)	3866.5	1051.42	3381352
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	? (MO)	3877.12	1239.25	3381350
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (MO)	3938.1	2288.32	3380778
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (MO)	4023.44	528.185	3380516
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (MO)	4549.97	1074.84	3381242
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	? (MO)	4733.03	1046.24	3380772
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (MO)	5062.51	3161.63	3380804
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (MO)	5143.23	975.656	3381238
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	? (MO)	5170.63	3388.04	3380790
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	? (MO)	7150.19	1154.07	3380549
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (MO)	7182.94	1056.08	3381356
velev-vliw-uns-4.0-9-i1.cnf	? (MO)	8888.04	1229.75	3380559
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (MO)	13089.5	1758.32	3381354
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (MO)	13660.9	1735.97	3380794
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (MO)	15733.8	2071.43	3380798
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (MO)	17497.3	2216.12	3380784
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	? (MO)	17793.6	4838.69	3381207
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (MO)	18105.5	2337.76	3380762
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (MO)	19652.2	2557.56	3381211
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (MO)	25524.7	3353.39	3381152
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (MO)	26724.9	3482.79	3381150
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (MO)	28846.3	3675.05	3380593
application/fuhs/ AProVE11/AProVE11-06.cnf	? (MO)	35997.2	4642.09	3380750
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (MO)	36710.8	4662.97	3380597
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	? (MO)	37559.3	4836.81	3380502

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	? (exit code)	0.731888	0.736286	3381294
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	? (exit code)	0.743886	0.954098	3381292
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	? (exit code)	0.863867	0.976092	3381314
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	? (exit code)	0.884864	0.783065	3381342
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	? (exit code)	0.90986	0.836869	3381296
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	? (exit code)	0.943856	0.750979	3381118
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	? (exit code)	1.03984	1.01913	3381338
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	? (exit code)	1.13583	0.922408	3381298
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	? (exit code)	2.74958	2.82166	3381154
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	? (exit code)	2.88956	2.95598	3381156
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	? (exit code)	10.7024	9.60309	3380890

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver borg-sat 11.03.02-par-industrial (fixed) (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (105 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (90 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (51 runs) [Show/Hide]

Solver timed out (no solution given) (6 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (37 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (11 runs) [Show/Hide]