SAT 2011 Competition: plain MUS track: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ cmpadd/ca002.shuffled.cnf	UNSAT	0.285956	0.206396	3493864
SAT02/industrial/biere/ dinphil/dp02u01.shuffled.cnf	UNSAT	0.432933	0.410844	3482908
mus/marques-silva/ bmc-default/barrel2.cnf	UNSAT	0.484926	0.315363	3483059
mus/marques-silva/ bmc-default/longmult0.cnf	UNSAT	0.505922	0.325071	3483064
SAT02/industrial/goldberg/fpga_routing/ term1_gr_rcs_w3.shuffled.cnf	UNSAT	0.757883	0.46024	3482921
mus/marques-silva/product-configuration/ C202_FW_SZ_61.cnf	UNSAT	0.952855	0.6466	3493212
SAT02/industrial/goldberg/ bmc1/23.shuffled.cnf	UNSAT	1.01584	0.612404	3482915
mus/marques-silva/product-configuration/ C208_FA_UT_3254.cnf	UNSAT	1.08783	0.684125	3493208
mus/marques-silva/product-configuration/ C210_FW_UT_8630.cnf	UNSAT	1.13283	0.739411	3483192
mus/marques-silva/ fpga-routing/term1_gr_2pin_w3.shuffled.cnf	UNSAT	1.13683	0.706628	3493520
SAT02/industrial/goldberg/ bmc1/42.shuffled.cnf	UNSAT	1.3138	0.871173	3493776
mus/marques-silva/ atpg/bf1355-621.cnf	UNSAT	1.49377	1.11938	3483045
mus/marques-silva/ atpg/bf1355-530.cnf	UNSAT	1.62875	1.27756	3483042
mus/marques-silva/ atpg/bf1355-359.cnf	UNSAT	1.65275	1.27617	3483035
mus/marques-silva/ atpg/bf1355-741.cnf	UNSAT	1.67174	1.07544	3493308
mus/marques-silva/ atpg/bf1355-228.cnf	UNSAT	1.67474	1.06855	3493296
mus/marques-silva/ atpg/bf1355-666.cnf	UNSAT	1.71074	1.18828	3483047
mus/marques-silva/ atpg/bf1355-665.cnf	UNSAT	1.71474	1.18135	3483046
mus/marques-silva/ atpg/bf1355-227.cnf	UNSAT	1.76473	1.11701	3483034
mus/marques-silva/ atpg/bf1355-446.cnf	UNSAT	1.84772	1.40644	3493288
mus/marques-silva/ atpg/bf1355-123.cnf	UNSAT	1.86472	1.40712	3493304
mus/marques-silva/ atpg/bf1355-127.cnf	UNSAT	1.92571	1.47479	3483030
mus/marques-silva/ atpg/bf1355-598.cnf	UNSAT	1.9357	1.39429	3493292
mus/marques-silva/ atpg/bf1355-445.cnf	UNSAT	2.00969	1.42625	3483037
mus/marques-silva/ bmc-default/queueinvar4.cnf	UNSAT	2.01669	1.57945	3483077
mus/marques-silva/design-debugging/ wb2.dimacs.filtered.cnf	UNSAT	2.04869	1.54269	3493336
application/leberre/ 2dimensionalstrippacking/E13X15.cnf	UNSAT	2.07568	1.35021	3482952
mus/marques-silva/ atpg/bf1355-466.cnf	UNSAT	2.11268	1.45227	3493300
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top20.cnf	UNSAT	2.13168	1.37231	3493732
mus/marques-silva/ atpg/bf1355-462.cnf	UNSAT	2.17567	1.61255	3483039
mus/marques-silva/ fpga-routing/apex7_gr_2pin_w4.shuffled.cnf	UNSAT	2.5866	2.12252	3483143
mus/marques-silva/design-debugging/ mot_comb3._red-gate-0.dimacs.seq.filtered.cnf	UNSAT	2.85456	2.12178	3483111
mus/marques-silva/hardware-verification/ elf.rf7.ucl.sat.chaff.4.1.bryant.cnf	UNSAT	3.21951	2.56356	3483173
application/leberre/ 2dimensionalstrippacking/E10X15.cnf	UNSAT	3.47147	2.78975	3493740
mus/marques-silva/fpga-routing/ example2_gr_rcs_w5.shuffled.cnf	UNSAT	3.72243	2.86257	3493524
mus/marques-silva/ atpg/ssa2670-133.cnf	UNSAT	3.9164	3.24792	3483054
application/leberre/ 2dimensionalstrippacking/E05N15.cnf	UNSAT	3.9504	3.11529	3493760
mus/marques-silva/ atpg/ssa2670-129.cnf	UNSAT	3.98139	3.02353	3493312
mus/marques-silva/design-debugging/ c1_DD_s3_f1_e2_v1-bug-onevec-gate-0.dimacs.seq.filtered.cnf	UNSAT	4.01439	3.29534	3483080
mus/marques-silva/ atpg/ssa2670-132.cnf	UNSAT	4.18936	3.16684	3483053
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	4.30934	3.60947	3482953
mus/marques-silva/ hardware-verification/c6n_s.cnf	UNSAT	4.32434	3.82029	3493408
application/leberre/ 2dimensionalstrippacking/E10N10.cnf	UNSAT	4.41233	3.82204	3482948
mus/marques-silva/ hardware-verification/dlx2_aa.cnf	UNSAT	4.87326	3.86177	3493416
application/leberre/ 2dimensionalstrippacking/E07N10.cnf	UNSAT	5.36418	4.57264	3482947
application/leberre/ 2dimensionalstrippacking/E00N10.cnf	UNSAT	5.46617	4.72536	3482944
mus/marques-silva/ atpg/ssa2670-140.cnf	UNSAT	6.04608	4.74506	3483055
mus/marques-silva/design-debugging/ SM_RX_TOP.dimacs.filtered.cnf	UNSAT	6.69398	5.93287	3493356
SAT02/industrial/goldberg/fpga_routing/ too_large_gr_rcs_w5.shuffled.cnf	UNSAT	6.85596	6.0201	3493788
mus/marques-silva/fpga-routing/ c499_gr_2pin_w5.shuffled.cnf	UNSAT	7.12592	6.49379	3483144
mus/marques-silva/ design-debugging/wb-problem.dimacs_46.filtered.cnf	UNSAT	8.02878	7.25995	3493324
mus/marques-silva/ hardware-verification/c7b_s.cnf	UNSAT	8.22575	7.41087	3493436
mus/marques-silva/ hardware-verification/c7n_s.cnf	UNSAT	8.36773	7.5378	3483163
mus/marques-silva/ fpga-routing/9symml_gr_2pin_w5.shuffled.cnf	UNSAT	8.5667	7.55002	3483142
mus/marques-silva/ bmc-default/queueinvar8.cnf	UNSAT	8.73067	7.92474	3493512
mus/marques-silva/design-debugging/ fpu2-problem.dimacs_16.filtered.cnf	UNSAT	9.75452	9.05605	3493344
SAT02/industrial/goldberg/fpga_routing/ c499_gr_rcs_w5.shuffled.cnf	UNSAT	10.0005	8.94913	3493784
mus/marques-silva/design-debugging/ c1_DD_s3_f1_e2_v1-bug-fourvec-gate-0.dimacs.seq.filtered.cnf	UNSAT	10.0375	9.53219	3493328
SAT02/industrial/biere/ cmpadd/ca064.shuffled.cnf	UNSAT	16.1785	14.8248	3482905
APPLICATIONS/ bitverif/minand/minand016.cnf	UNSAT	17.2224	16.0362	3493608
mus/marques-silva/abstraction-refinement-intel/ edn_5371_4.cnf_0.21000000.unsat.cnf	UNSAT	18.5032	17.0829	3493248
mus/marques-silva/design-debugging/ dividers3.dimacs.filtered.cnf	UNSAT	18.9271	18.0157	3483097
mus/marques-silva/design-debugging/ wb-debug.dimacs.cnf	UNSAT	20.8578	19.2632	3483135
SAT03/industrial/kukula/addm_bench/ am_4_4.shuffled-as.sat03-360.cnf	UNSAT	21.3408	20.0863	3482933
application/leberre/ 2dimensionalstrippacking/E15N10.cnf	UNSAT	22.1866	20.7489	3493748
mus/marques-silva/ hardware-verification/dlx2_ca.cnf	UNSAT	24.1603	22.7795	3483170
mus/marques-silva/design-debugging/ c5_DD_s3_f1_e1_v2-bug-gate-0.dimacs.seq.filtered.cnf	UNSAT	25.0722	23.707	3493380
mus/marques-silva/design-debugging/ c5_DD_s3_f1_e1_v1-bug-gate-0.dimacs.seq.filtered.cnf	UNSAT	25.2042	23.8728	3483086
SAT02/industrial/goldberg/rand_net/ rand_net40-25-1.shuffled.cnf	UNSAT	29.8125	28.7052	3482923
mus/marques-silva/design-debugging/ c6_DD_s3_f1_e1_v1-bug-fourvec-gate-0.dimacs.seq.filtered.cnf	UNSAT	34.7807	33.1351	3493340
mus/marques-silva/design-debugging/ c5_DD_s3_f1_e1_v1-bug-fourvec-gate-0.dimacs.seq.filtered.cnf	UNSAT	36.2965	35.0812	3493396
mus/marques-silva/abstraction-refinement-intel/ edn_20403_8.cnf_0.03000000.unsat.cnf	UNSAT	45.0971	43.9317	3493236
mus/marques-silva/abstraction-refinement-intel/ edn_5371_6.cnf_0.30000000.unsat.cnf	UNSAT	45.3921	42.6919	3493240
mus/marques-silva/design-debugging/ mem_ctrl-debug.dimacs.cnf	UNSAT	46.189	44.6224	3483108
mus/marques-silva/ hardware-verification/dlx2_cc.cnf	UNSAT	46.256	44.5459	3483171
mus/marques-silva/abstraction-refinement-intel/ edn_20403_10.cnf_0.03000000.unsat.cnf	UNSAT	50.1954	48.8307	3483008
mus/marques-silva/design-debugging/ fpu1-problem.dimacs_13.filtered.cnf	UNSAT	55.4406	52.9503	3483101
mus/marques-silva/design-debugging/ c4_DD_s3_f1_e2_v1-bug-onevec-gate-0.dimacs.seq.filtered.cnf	UNSAT	62.3365	60.4348	3493392
application/leberre/ 2dimensionalstrippacking/E13N10.cnf	UNSAT	63.5813	62.1672	3482950
mus/marques-silva/bmc-default/ queueinvar12.cnf	UNSAT	63.8263	62.2203	3493508
mus/marques-silva/design-debugging/ rsdecoder4.dimacs.filtered.cnf	UNSAT	68.8185	120.244	3483118
mus/marques-silva/design-debugging/ c6_DD_s3_f1_e1_v1-bug-gate-0.dimacs.seq.filtered.cnf	UNSAT	73.5148	70.1034	3493384
mus/marques-silva/ bmc-aerielogic/fifo4_33.cnf	UNSAT	84.6051	83.0302	3493404
mus/marques-silva/ bmc-default/longmult6.cnf	UNSAT	92.8919	91.6918	3483069
mus/marques-silva/ hardware-verification/ooo.tag10.ucl.sat.chaff.4.1.bryant.cnf	UNSAT	92.9119	91.0731	3483182
application/leberre/ 2dimensionalstrippacking/E03N15.cnf	UNSAT	92.9249	91.7229	3493752
mus/marques-silva/fpga-routing/ too_large_gr_rcs_w6.shuffled.cnf	UNSAT	99.1139	97.2561	3493528
industrial/babic/dspam/ dspam_dump_vc950.cnf	UNSAT	99.6239	96.9239	3493560
mus/marques-silva/software-verification/ dspam_dump_vc950.cnf	UNSAT	100.929	98.2526	3493500
SAT02/industrial/goldberg/fpga_routing/ too_large_gr_rcs_w6.shuffled.cnf	UNSAT	103.113	101.293	3482922
mus/marques-silva/software-verification/ dspam_dump_vc949.cnf	UNSAT	104.995	102.339	3493480
mus/chen/fdmus_v100/ fdmus_b14_134.cnf	UNSAT	112.674	111.503	3493060
industrial/babic/ dspam/dspam_dump_vc1081.cnf	UNSAT	112.874	111.783	3493564
industrial/babic/hsatv17/ hsat_vc12016.cnf	UNSAT	114.248	111.339	3493580
mus/marques-silva/bmc-default/ queueinvar14.cnf	UNSAT	115.082	113.198	3483072
mus/marques-silva/software-verification/ hsat_vc12016.cnf	UNSAT	116.082	113.315	3483198
industrial/babic/xinetd/ xinetd_vc56703.cnf	UNSAT	118.514	116.23	3493592
mus/chen/fdmus_v100/ fdmus_b20_240.cnf	UNSAT	120.405	118.736	3482972
industrial/babic/hsatv17/ hsat_vc11944.cnf	UNSAT	123.282	120.07	3493576
industrial/babic/xinetd/ xinetd_vc56687.cnf	UNSAT	126.456	124.107	3482935
mus/marques-silva/ software-verification/itox_vc965.cnf	UNSAT	132.01	129.578	3493472
mus/marques-silva/software-verification/ hsat_vc12070.cnf	UNSAT	138.383	135.19	3493488
mus/chen/ fdmus_v100/fdmus_b17_1037.cnf	UNSAT	156.144	153.797	3493108
industrial/babic/hsatv17/ hsat_vc12072.cnf	UNSAT	156.625	153.037	3493568
mus/marques-silva/software-verification/ hsat_vc12072.cnf	UNSAT	157.856	154.152	3493468
mus/marques-silva/design-debugging/ dividers9.dimacs.filtered.cnf	UNSAT	163.242	161.331	3493316
mus/chen/fdmus_v100/ fdmus_b14_210.cnf	UNSAT	176.249	174.176	3493056
mus/marques-silva/software-verification/ bin_libsmbsharemodes_vc4083.cnf	UNSAT	179.689	177.557	3493484
industrial/babic/hsatv17/ hsat_vc11817.cnf	UNSAT	182.23	178.704	3493584
mus/marques-silva/ software-verification/itox_vc1216.cnf	UNSAT	182.723	179.758	3483200
mus/chen/fdmus_v100/ fdmus_b21_96.cnf	UNSAT	183.695	182.318	3493132
mus/chen/fdmus_v100/ fdmus_b17_420.cnf	UNSAT	185.689	183.278	3493160
mus/marques-silva/ hardware-verification/3pipe_1_ooo.cnf	UNSAT	187.104	184.273	3493456
mus/marques-silva/software-verification/ dspam_dump_vc962.cnf	UNSAT	191.289	188.196	3493476
mus/marques-silva/abstraction-refinement-intel/ edn_28491_6.cnf_0.31000000.unsat.cnf	UNSAT	198.769	194.459	3493272
industrial/babic/hsatv17/ hsat_vc11803.cnf	UNSAT	199.022	195.396	3493572
mus/chen/fdmus_v100/ fdmus_b21_250.cnf	UNSAT	201.202	198.757	3493076
mus/chen/fdmus_v100/ fdmus_b20_341.cnf	UNSAT	202.813	200.696	3493100
mus/marques-silva/hardware-verification/ ooo.rf8.ucl.sat.chaff.4.1.bryant.cnf	UNSAT	205.012	202.544	3493444
mus/chen/fdmus_v100/ fdmus_b20_498.cnf	UNSAT	205.359	203.022	3493204
mus/marques-silva/abstraction-refinement-intel/ edn_20403_12.cnf_0.08000000.unsat.cnf	UNSAT	214.673	212.235	3493216
mus/marques-silva/design-debugging/ dividers11.dimacs.filtered.cnf	UNSAT	215.176	213.32	3483094
mus/marques-silva/software-verification/ dspam_dump_vc1093.cnf	UNSAT	226.631	224.081	3493492
mus/marques-silva/software-verification/ hsat_vc11813.cnf	UNSAT	230.873	227.013	3493496
industrial/babic/ dspam/dspam_dump_vc1093.cnf	UNSAT	234.006	231.526	3493552
mus/chen/fdmus_v100/ fdmus_b15_421.cnf	UNSAT	244.321	243.205	3493196
SAT02/industrial/biere/ cmpadd/ca256.shuffled.cnf	UNSAT	250.924	248.275	3482907
mus/marques-silva/software-verification/ dspam_dump_vc973.cnf	UNSAT	255.09	251.24	3493504
mus/marques-silva/ design-debugging/rsdecoder_fsm1.dimacs.filtered.cnf	UNSAT	257.135	253.374	3493376
mus/chen/fdmus_v100/ fdmus_b14_141.cnf	UNSAT	258.547	256.747	3493144
industrial/babic/dspam/ dspam_dump_vc972.cnf	UNSAT	264.396	260.732	3493556
mus/chen/fdmus_v100/ fdmus_b22_133.cnf	UNSAT	271.376	269.145	3493112
mus/marques-silva/ hardware-verification/g6n.cnf	UNSAT	279.667	277.503	3493460
mus/marques-silva/ hardware-verification/g6b.cnf	UNSAT	284.33	282.032	3483177
mus/marques-silva/design-debugging/ wb_conmax3.dimacs.filtered.cnf	UNSAT	295.209	291.606	3483134
mus/chen/fdmus_v100/ fdmus_b20_238.cnf	UNSAT	302.626	300.777	3482971
mus/chen/fdmus_v100/ fdmus_b22_162.cnf	UNSAT	319.535	317.061	3493184
SAT02/industrial/goldberg/rand_net/ rand_net50-30-1.shuffled.cnf	UNSAT	320.631	318.807	3493832
mus/marques-silva/ bmc-default/barrel6.cnf	UNSAT	323.724	321.799	3483061
mus/chen/fdmus_v100/ fdmus_b15_463.cnf	UNSAT	327.899	326.521	3493080
mus/chen/fdmus_v100/ fdmus_b21_167.cnf	UNSAT	329.033	330.308	3482984
APPLICATIONS/ bitverif/maxand/maxand032.cnf	UNSAT	330.852	333.868	3482938
mus/chen/fdmus_v100/ fdmus_b20_492.cnf	UNSAT	336.628	334.228	3493200
mus/marques-silva/ hardware-verification/ooo.tag12.ucl.sat.chaff.4.1.bryant.cnf	UNSAT	351.034	347.464	3493448
mus/chen/ fdmus_v100/fdmus_b17_1456.cnf	UNSAT	366.466	364.771	3493128
mus/chen/ fdmus_v100/fdmus_b17_1324.cnf	UNSAT	417.813	415.374	3493084
mus/chen/fdmus_v100/ fdmus_b20_381.cnf	UNSAT	423.358	421.269	3482976
mus/marques-silva/design-debugging/ wb_4m8s1.dimacs.filtered.cnf	UNSAT	431.367	426.664	3493320
mus/marques-silva/design-debugging/ s38584-bug-onevec-gate-0.dimacs.seq.filtered.cnf	UNSAT	437.565	433.337	3493352
mus/chen/fdmus_v100/ fdmus_b21_242.cnf	UNSAT	447.723	445.247	3493136
mus/chen/fdmus_v100/ fdmus_b15_303.cnf	UNSAT	482.311	480.353	3493172
SAT02/industrial/goldberg/rand_net/ rand_net70-30-1.shuffled.cnf	UNSAT	492.698	489.935	3493812
mus/chen/fdmus_v100/ fdmus_b21_481.cnf	UNSAT	495.462	493.074	3493164
mus/chen/fdmus_v100/ fdmus_b15_294.cnf	UNSAT	530.388	527.725	3493088
mus/chen/fdmus_v100/ fdmus_b21_486.cnf	UNSAT	539.166	536.996	3493104
mus/chen/fdmus_v100/ fdmus_b22_488.cnf	UNSAT	581.116	579.218	3493072
mus/chen/fdmus_v100/ fdmus_b15_307.cnf	UNSAT	596.788	594.802	3482957
SAT02/industrial/goldberg/rand_net/ rand_net40-25-5.shuffled.cnf	UNSAT	601.813	599.966	3493824
mus/chen/fdmus_v100/ fdmus_b22_241.cnf	UNSAT	635.225	633.196	3493176
mus/marques-silva/bmc-default/ queueinvar20.cnf	UNSAT	693.589	691.193	3483075
mus/chen/fdmus_v100/ fdmus_b15_304.cnf	UNSAT	714.634	711.48	3482956
SAT02/industrial/goldberg/rand_net/ rand_net40-30-5.shuffled.cnf	UNSAT	721.637	719.54	3493820
SAT02/industrial/goldberg/rand_net/ rand_net40-25-10.shuffled.cnf	UNSAT	741.808	739.531	3493816
mus/marques-silva/ bmc-default/longmult7.cnf	UNSAT	745.791	743.811	3493516
mus/marques-silva/abstraction-refinement-intel/ edn_5371_10.cnf_0.46000000.unsat.cnf	UNSAT	760.18	751.071	3493256
mus/marques-silva/abstraction-refinement-intel/ edn_9789_6.cnf_0.31000000.unsat.cnf	UNSAT	760.958	755.495	3493232
mus/chen/ fdmus_v100/fdmus_b17_1327.cnf	UNSAT	770.625	767.626	3493052
mus/marques-silva/bmc-aerielogic/ w10_45.shuffled.cnf	UNSAT	798.061	794.587	3493400
mus/chen/fdmus_v100/ fdmus_b15_291.cnf	UNSAT	800.712	796.878	3493048
mus/chen/fdmus_v100/ fdmus_b20_424.cnf	UNSAT	823.896	821.565	3493168
mus/marques-silva/abstraction-refinement-intel/ edn_20259_8.cnf_0.39000000.unsat.cnf	UNSAT	849.826	842.914	3483007
mus/chen/fdmus_v100/ fdmus_b15_296.cnf	UNSAT	920.611	917.196	3493180
mus/marques-silva/ equivalence-checking/c5315-s.cnf	UNSAT	939.625	936.963	3493280
mus/marques-silva/ hardware-verification/f6n.cnf	UNSAT	1054.02	1051.88	3483174
mus/marques-silva/ hardware-verification/c6bidw_s.cnf	UNSAT	1129.48	1127.23	3483156
mus/marques-silva/ hardware-verification/g7n.cnf	UNSAT	1133.37	1130.81	3483180
mus/marques-silva/abstraction-refinement-intel/ edn_20259_10.cnf_0.48000000.unsat.cnf	UNSAT	1156.32	1144.79	3493252
mus/marques-silva/ hardware-verification/g7b.cnf	UNSAT	1168.42	1166.26	3483179
mus/chen/fdmus_v100/ fdmus_b20_349.cnf	UNSAT	1191.88	1197.29	3482974
mus/marques-silva/ hardware-verification/f6b.cnf	UNSAT	1242.89	1241.25	3493452
mus/marques-silva/abstraction-refinement-intel/ edn_24095_8.cnf_0.21000000.unsat.cnf	UNSAT	1322.69	1314.46	3483017
mus/marques-silva/abstraction-refinement-intel/ edn_22134_8.cnf_0.38000000.unsat.cnf	UNSAT	1418.2	1409.02	3483013
mus/chen/fdmus_v100/ fdmus_b21_359.cnf	UNSAT	1441.24	1441.29	3482987
mus/marques-silva/ hardware-verification/4pipe_1_ooo.cnf	UNSAT	1593.54	1588.79	3493464
mus/marques-silva/abstraction-refinement-intel/ edn_22134_10.cnf_0.47000000.unsat.cnf	UNSAT	1607.46	1594.28	3493220
mus/marques-silva/abstraction-refinement-intel/ edn_28491_10.cnf_0.46000000.unsat.cnf	UNSAT	1613.65	1599.63	3493268
mus/chen/fdmus_v100/ fdmus_b22_355.cnf	UNSAT	1614.06	1611.05	3493192
mus/marques-silva/abstraction-refinement-intel/ edn_5371_12.cnf_0.50000000.unsat.cnf	UNSAT	1692.56	1677.48	3493260
mus/marques-silva/ hardware-verification/g6bid.cnf	UNSAT	1798.5	1797.05	3493432

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/goldberg/rand_net/ rand_net60-25-5.shuffled.cnf	? (TO)	1800.11	1798.56	3493808
APPLICATIONS/bitverif/ smulo/smulo016.cnf	? (TO)	1800.12	1798.64	3493616
mus/marques-silva/ software-verification/cvs_vc81760.cnf	? (TO)	1800.13	1797.87	3483194
SAT02/industrial/goldberg/rand_net/ rand_net70-25-5.shuffled.cnf	? (TO)	1800.14	1798.25	3493792
SAT04/industrial/hoonsang/ vis-bmc/luckySeven.used-as.sat04-990.cnf	? (TO)	1800.14	1798.18	3493772
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-viscoherencep3-tseitin.cnf	? (TO)	1800.18	1797.14	3493728
APPLICATIONS/diagnosis/ ACG-10-5p0.cnf	? (TO)	1800.2	1797.07	3493660
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	? (TO)	1800.24	1797.36	3493704
SAT02/industrial/dellacherie/ comb/comb2.shuffled.cnf	? (TO)	1800.26	1796.38	3493844
APPLICATIONS/diagnosis/ UR-10-5p0.cnf	? (TO)	1800.27	1796.98	3493664
industrial/palacios/uts/ uts-l06-ipc5-h31-unknown.cnf	? (TO)	1800.29	1797.19	3493544
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.010-NOTKNOWN.cnf	? (TO)	1800.3	1796.99	3493692

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/goldberg/rand_net/ rand_net70-60-1.shuffled.cnf	No Cert.	1173.2	1169.42	3493804
mus/marques-silva/design-debugging/ rsdecoder6.dimacs.filtered.cnf	No Cert.	1573.33	1850.13	3483120
APPLICATIONS/bitverif/ mulhs/mulhs008.cnf	No Cert.	1800.07	1799.24	3493612
SAT03/industrial/kukula/addm_bench/ am_5_5.shuffled-as.sat03-361.cnf	No Cert.	1800.1	1798.85	3493768
mus/chen/fdmus_v100/ fdmus_b21_112.cnf	No Cert.	1800.11	1798.36	3493044
SAT02/industrial/biere/ dinphil/dp09u08.shuffled.cnf	No Cert.	1800.11	1798.65	3493860
application/leberre/ 2dimensionalstrippacking/E00N15.cnf	No Cert.	1800.11	1798.25	3493744
SAT02/industrial/goldberg/rand_net/ rand_net70-25-1.shuffled.cnf	No Cert.	1800.11	1798.46	3493796
mus/marques-silva/ bmc-default/longmult9.cnf	No Cert.	1800.11	1798.65	3483071
SAT02/industrial/biere/ dinphil/dp08u07.shuffled.cnf	No Cert.	1800.11	1798.07	3482912
SAT03/industrial/goldberg/hard_eq_check/ c7552mul.miter.shuffled-as.sat03-347.cnf	No Cert.	1800.12	1797.67	3493764
mus/marques-silva/design-debugging/ divider-problem.dimacs_1.filtered.cnf	No Cert.	1800.12	1795.51	3483090
SAT02/industrial/ dellacherie/fifo8/fifo8_300.shuffled.cnf	No Cert.	1800.12	1796.68	3493856
mus/chen/fdmus_v100/ fdmus_b22_113.cnf	No Cert.	1800.12	1797.87	3493092
mus/chen/fdmus_v100/ fdmus_b22_669.cnf	No Cert.	1800.12	1797.97	3493068
SAT02/industrial/goldberg/fpga_routing/ c880_gr_rcs_w6.shuffled.cnf	No Cert.	1800.12	1798.56	3493780
mus/marques-silva/ hardware-verification/c8bidw_s.cnf	No Cert.	1800.12	1797.41	3493428
APPLICATIONS/bitverif/ icbrt/icbrt2_32.cnf	No Cert.	1800.13	1798.5	3493620
mus/marques-silva/fpga-routing/ alu2_gr_rcs_w7.shuffled.cnf	No Cert.	1800.13	1798.24	3493532
SAT02/industrial/goldberg/rand_net/ rand_net50-40-5.shuffled.cnf	No Cert.	1800.13	1798.65	3493828
mus/chen/fdmus_v100/ fdmus_b22_141.cnf	No Cert.	1800.13	1798.18	3493156
mus/marques-silva/abstraction-refinement-intel/ edn_9789_8.cnf_0.51000000.unsat.cnf	No Cert.	1800.14	1790.92	3493244
application/leberre/ 2dimensionalstrippacking/E04F15.cnf	No Cert.	1800.14	1798.34	3493736
mus/chen/fdmus_v100/ fdmus_b21_111.cnf	No Cert.	1800.14	1798.07	3493116
mus/chen/fdmus_v100/ fdmus_b22_102.cnf	No Cert.	1800.14	1797.31	3493064
mus/marques-silva/fpga-routing/ vda_gr_rcs_w7.shuffled.cnf	No Cert.	1800.15	1798.75	3483149
mus/marques-silva/design-debugging/ divider-problem.dimacs_7.filtered.cnf	No Cert.	1800.15	1795.82	3483093
mus/chen/fdmus_v100/ fdmus_b22_662.cnf	No Cert.	1800.15	1798.21	3493148
SAT02/industrial/goldberg/rand_net/ rand_net60-30-10.shuffled.cnf	No Cert.	1800.15	1798.85	3493836
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	No Cert.	1800.15	1797.5	3493756
APPLICATIONS/diagnosis/ UR-20-5t0.cnf	No Cert.	1800.15	1794.2	3493668
mus/marques-silva/design-debugging/ divider-problem.dimacs_9.filtered.cnf	No Cert.	1800.16	1795.3	3493332
mus/marques-silva/design-debugging/ mrisc_mem2wire-problem.dimacs_29.filtered.cnf	No Cert.	1800.16	1788.65	3493360
APPLICATIONS/crypto/ md5gen/gus-md5-05.cnf	No Cert.	1800.16	1798.19	3493632
mus/chen/fdmus_v100/ fdmus_b20_171.cnf	No Cert.	1800.16	1797.66	3493140
mus/chen/fdmus_v100/ fdmus_b20_141.cnf	No Cert.	1800.16	1798.26	3493124
industrial/jarvisalo/ eq.atree.braun.7.unsat.cnf	No Cert.	1800.17	1798.36	3493588
APPLICATIONS/diagnosis/ UCG-10-10t0.cnf	No Cert.	1800.17	1795.93	3493672
SAT02/industrial/dellacherie/ w10/w10_70.shuffled.cnf	No Cert.	1800.17	1798.18	3493840
APPLICATIONS/ bitverif/minxor/minxor032.cnf	No Cert.	1800.17	1797.78	3493600
APPLICATIONS/diagnosis/ UR-15-5t0.cnf	No Cert.	1800.17	1795.32	3493656
SAT02/industrial/goldberg/rand_net/ rand_net50-25-5.shuffled.cnf	No Cert.	1800.17	1798.15	3493800
APPLICATIONS/c32sat/ post-cbmc-aes-d-r1-noholes.cnf	No Cert.	1800.17	1797.33	3493636
APPLICATIONS/bitverif/ minxorminand/minxorminand032.cnf	No Cert.	1800.18	1796.74	3493596
APPLICATIONS/bitverif/ maxor/maxor032.cnf	No Cert.	1800.18	1796.82	3493624
mus/chen/fdmus_v100/ fdmus_b22_172.cnf	No Cert.	1800.18	1797.83	3493096
mus/chen/fdmus_v100/ fdmus_b20_388.cnf	No Cert.	1800.18	1797.54	3493120
mus/marques-silva/ bmc-default/barrel7.cnf	No Cert.	1800.18	1798.03	3483062
mus/marques-silva/design-debugging/ dividers7.dimacs.filtered.cnf	No Cert.	1800.18	1798	3483099
mus/chen/fdmus_v100/ fdmus_b22_600.cnf	No Cert.	1800.18	1797.34	3493188
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bc57sensorsp0neg-tseitin.cnf	No Cert.	1800.18	1796.94	3493716
mus/marques-silva/design-debugging/ divider-problem.dimacs_2.filtered.cnf	No Cert.	1800.19	1794.7	3493388
industrial/anbulagan/ medium-unsat/total-5-11-u.cnf	No Cert.	1800.19	1796.55	3493536
APPLICATIONS/diagnosis/ UR-15-10t0.cnf	No Cert.	1800.19	1794.73	3493676
APPLICATIONS/ bitverif/minand/minand064.cnf	No Cert.	1800.19	1798	3493604
APPLICATIONS/diagnosis/ UR-10-10t0.cnf	No Cert.	1800.19	1795.53	3493652
mus/marques-silva/abstraction-refinement-intel/ edn_9789_21.cnf_46.05000000.unsat.cnf	No Cert.	1800.19	1773.18	3493264
APPLICATIONS/diagnosis/ ACG-20-5t0.cnf	No Cert.	1800.2	1793.81	3493640
APPLICATIONS/diagnosis/ UCG-20-5t0.cnf	No Cert.	1800.2	1794.31	3493680
industrial/palacios/uts/ uts-l06-ipc5-h28-unknown.cnf	No Cert.	1800.2	1796.45	3493548
mus/marques-silva/design-debugging/ rsdecoder-problem.dimacs_31.filtered.cnf	No Cert.	1800.2	1783.75	3493364
mus/marques-silva/abstraction-refinement-intel/ edn_25208_10.cnf_0.58000000.unsat.cnf	No Cert.	1800.2	1790.94	3483018
mus/marques-silva/ hardware-verification/c10nidw_s.cnf	No Cert.	1800.2	1796.14	3493440
APPLICATIONS/diagnosis/ UTI-20-5t0.cnf	No Cert.	1800.2	1794.61	3493648
mus/marques-silva/abstraction-refinement-intel/ edn_28491_12.cnf_0.50000000.unsat.cnf	No Cert.	1800.2	1781.37	3493224
mus/chen/fdmus_v100/ fdmus_b21_422.cnf	No Cert.	1800.21	1796.65	3493152
mus/marques-silva/abstraction-refinement-intel/ edn_2948_14.cnf_0.97000000.unsat.cnf	No Cert.	1800.21	1781.35	3493228
mus/marques-silva/abstraction-refinement-intel/ edn_25208_14.cnf_37.38000000.unsat.cnf	No Cert.	1800.21	1781.99	3483019
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.010-NOTKNOWN.cnf	No Cert.	1800.21	1792.56	3493688
mus/marques-silva/design-debugging/ rsdecoder_multivec1.dimacs.filtered.cnf	No Cert.	1800.21	1793.62	3483121
mus/marques-silva/ hardware-verification/f7.cnf	No Cert.	1800.22	1796.36	3493420
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-nusmvtcastp2-tseitin.cnf	No Cert.	1800.22	1795.92	3493712
mus/marques-silva/design-debugging/ rsdecoder-problem.dimacs_38.filtered.cnf	No Cert.	1800.23	1785.66	3493372
mus/marques-silva/ hardware-verification/c8idw_s.cnf	No Cert.	1800.23	1797.34	3493424
mus/marques-silva/ equivalence-checking/c3540-s.cnf	No Cert.	1800.23	1798.55	3483140
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_06_UNSAT.cnf	No Cert.	1800.24	1795.96	3493684
mus/marques-silva/design-debugging/ divider-problem.dimacs_5.filtered.cnf	No Cert.	1800.24	1795.83	3483092
SAT02/industrial/ dellacherie/fifo8/fifo8_100.shuffled.cnf	No Cert.	1800.25	1795.89	3493852
mus/marques-silva/design-debugging/ rsdecoder-problem.dimacs_39.filtered.cnf	No Cert.	1800.25	1784.56	3493368
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvguidancep1-tseitin.cnf	No Cert.	1800.25	1795.98	3493696
mus/chen/fdmus_v100/ fdmus_b22_356.cnf	No Cert.	1800.26	1796.29	3482996
APPLICATIONS/crypto/ md5gen/gus-md5-06.cnf	No Cert.	1800.26	1797.87	3493628
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	No Cert.	1800.27	1796.59	3493724
industrial/palacios/uts/ uts-l05-ipc5-h26-unsat.cnf	No Cert.	1800.27	1796.78	3493540
SAT02/industrial/dellacherie/ w08/w08_10.shuffled.cnf	No Cert.	1800.28	1796.37	3493848
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-nusmvguidancep9-tseitin.cnf	No Cert.	1800.3	1795.25	3493720
mus/marques-silva/design-debugging/ rsdecoder-problem.dimacs_37.filtered.cnf	No Cert.	1800.3	1783.31	3483124
mus/marques-silva/ hardware-verification/f7b.cnf	No Cert.	1800.31	1796.91	3483175
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	No Cert.	1800.31	1795.6	3493700
mus/marques-silva/ equivalence-checking/c7552.cnf	No Cert.	1800.32	1797.81	3493284
mus/marques-silva/ hardware-verification/4pipe_4_ooo.cnf	No Cert.	1800.33	1795.47	3493412
APPLICATIONS/diagnosis/ ACG-10-10t0.cnf	No Cert.	1800.35	1793.81	3493644
mus/marques-silva/ hardware-verification/4pipe_3_ooo.cnf	No Cert.	1800.36	1794	3483153
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	No Cert.	1800.38	1795.36	3493708

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
mus/marques-silva/product-configuration/ C168_FW_UT_851.cnf	Wrong Cert.	1.04284	0.605052	3483185
mus/marques-silva/design-debugging/ c5315-bug-gate-0.dimacs.seq.filtered.cnf	Wrong Cert.	1.17182	0.763802	3483085
mus/marques-silva/design-debugging/ c7552-bug-gate-0.dimacs.seq.filtered.cnf	Wrong Cert.	2.86056	2.29158	3493348
mus/marques-silva/ equivalence-checking/c2670.cnf	Wrong Cert.	97.2452	95.4682	3493276

SAT 2011 Competition: plain MUS track: benchmarks results per solver

Result page for solver SAT4J MUS 2.3.0-SNAPSHOT 2011-02-06 (complete)

Category "MUS" (MUS)

Solver proved unsatisfiability (UNSATISFIABLE) (189 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (1 run) [Show/Hide]

Solver timed out (no solution given) (12 runs) [Show/Hide]

Solver answered SATISFIABLE but gave no complete certificate (94 runs) [Show/Hide]

Solver gave a wrong solution (4 runs) [Show/Hide]