SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.020996	0.0216621	3366071
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.025995	0.025559	3365973
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.025995	0.0269899	3365975
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	0.178972	0.17919	3365831
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.18897	0.194564	3366055
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.330948	0.331005	3365577
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	0.368943	0.369657	3365809
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	0.893863	0.894082	3366059
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	1.00285	1.00926	3365525
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	1.2988	1.29988	3365527
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	1.44778	1.45304	3365833
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	1.67774	1.67858	3365847
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	1.84672	1.84655	3365825
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	3.3125	3.3128	3365951
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	4.09038	4.09091	3365967
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	4.21636	4.21632	3365821
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	5.45817	5.45869	3365837
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	5.86611	5.86597	3366093
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	7.10892	7.10898	3365845
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	8.90664	8.90737	3365823
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	9.8625	9.86191	3365829
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	13.5459	13.5466	3365945
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	14.5968	14.6095	3366007
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	14.8537	14.8549	3365811
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	17.2384	17.2382	3365633
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	20.8188	20.8185	3366091
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	20.8638	20.8815	3365797
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	24.8462	24.8462	3365535
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	25.7001	25.7117	3366057
manol-pipe-c6bidw_i.cnf	UNSAT	28.0107	28.037	3365565
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	28.1907	28.1955	3365495
manol-pipe-f7nidw.cnf	UNSAT	31.3102	31.3173	3365569
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	31.3692	31.3706	3365695
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	31.6322	31.632	3365751
velev-pipe-o-uns-1.1-6.cnf	UNSAT	32.3361	32.3386	3365673
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	33.5349	33.5438	3366009
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	33.9918	34.0029	3365749
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	39.608	39.6078	3365979
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	39.615	39.6156	3365635
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	40.1089	40.1137	3365621
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	41.4827	41.4844	3365949
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	48.8886	48.8885	3365523
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	55.3866	55.3864	3365791
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	56.3264	56.3254	3365773
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	56.8584	56.8698	3365965
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	58.5941	58.5959	3365629
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	66.1999	66.199	3366077
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	73.7928	73.7898	3365761
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	84.8151	84.8135	3365849
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	86.9108	86.9089	3365787
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	87.6327	87.6303	3365601
velev-pipe-o-uns-1.0-7.cnf	UNSAT	99.4469	99.4446	3365675
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	102.169	102.167	3365827
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	108.834	108.832	3365785
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	120.071	120.068	3366065
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	UNSAT	130.69	130.688	3365891
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	130.866	130.863	3365765
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	137.864	137.861	3365619
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	155.502	155.499	3365777
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	175.008	175.01	3365835
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	175.032	175.028	3365701
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	179.191	179.198	3365783
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	184.65	184.646	3366089
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	218.303	218.298	3365779
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	229.485	229.476	3365743
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	234.082	234.075	3365893
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	240.704	240.699	3365643
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	252.021	252.011	3365769
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	293.426	293.429	3365867
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	310.203	310.196	3365853
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	331.765	331.757	3365865
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	338.347	338.34	3365859
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	348.11	348.105	3366053
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	359.32	359.314	3365841
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	360.656	360.647	3365625
manol-pipe-c10nidw.cnf	UNSAT	366.489	366.488	3365561
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	379.896	379.916	3365857
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	381.297	381.317	3365511
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	396.845	396.835	3365869
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	418.987	418.978	3365741
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	477.605	477.589	3365721
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	551.32	551.344	3365843
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	583.66	583.646	3365713
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	675.087	675.073	3365963
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	1004.3	1004.31	3365819
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	UNSAT	1004.79	1004.77	3365815
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	1126.09	1126.06	3365997
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	1222.4	1222.37	3366045
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	UNSAT	1350.8	1350.75	3365657
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	UNSAT	1650.26	1650.23	3366087
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	UNSAT	1664.58	1664.54	3365599
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	1799.3	1799.26	3365531
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	1830.76	1830.72	3365641
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	1893.12	1893.07	3365515
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	1938.6	1938.64	3366081
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	UNSAT	2059.14	2059.09	3365605
APPLICATIONS/bitverif/ maxor/maxor128.cnf	UNSAT	2169.13	2169.12	3365593
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	UNSAT	2240.44	2240.41	3365575
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	UNSAT	2254.91	2254.85	3365579
application/fuhs/ AProVE11/AProVE11-06.cnf	UNSAT	2329.02	2328.98	3365691
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	2483.3	2483.25	3365995
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	UNSAT	2505.47	2505.4	3366083
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	2514.21	2514.15	3366079
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	UNSAT	2663.29	2663.21	3365639
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	UNSAT	2917.88	2917.81	3365957
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	UNSAT	2968.46	2968.4	3365505
velev-vliw-uns-4.0-9-i1.cnf	UNSAT	3636.04	3635.95	3365559
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	UNSAT	4162.9	4162.79	3365549
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	UNSAT	4225.39	4225.3	3365503
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	4493.76	4493.58	3365509

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.001999	0.011359	3366033
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.002999	0.011223	3366035
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.003999	0.0130769	3366043
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.007998	0.0111359	3366037
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.038994	0.039722	3365937
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.044993	0.044943	3366039
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.050991	0.0506509	3366067
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.215966	0.21662	3366069
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.671897	0.671984	3366051
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	1.03684	1.04716	3365679
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	1.21381	1.2139	3365659
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	1.26781	1.26797	3365935
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	1.46378	1.46351	3366001
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	1.52177	1.54307	3365687
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1.63675	1.63646	3365663
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	2.24066	2.26964	3365683
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	2.5956	2.70989	3365795
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	2.85357	2.86094	3365775
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	2.89156	2.94107	3365805
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	3.36549	3.42089	3365803
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	4.43033	4.50403	3365793
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	4.5713	4.66495	3365799
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	SAT	5.02323	5.12278	3365789
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	5.19521	5.21406	3365681
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	5.50216	5.53406	3365637
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	6.91195	6.98674	3365697
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	7.34688	7.46094	3365689
ibm-2002-21r-k95.cnf	SAT	9.94349	10.0197	3365677
ibm-2004-01-k90.cnf	SAT	12.4921	12.5128	3365573
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	14.8117	14.8117	3365955
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	16.5545	16.6303	3365685
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	SAT	17.0374	17.0372	3366003
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	17.3674	17.438	3365655
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	21.9127	21.9384	3365557
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	23.7044	23.8765	3365693
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	31.9361	31.9424	3365607
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	34.8147	34.827	3365613
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	34.9737	35.0259	3366017
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	39.371	39.3703	3365953
velev-pipe-sat-1.0-b9.cnf	SAT	39.513	39.5599	3365671
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	45.4851	45.546	3366019
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	46.6249	46.6452	3365759
application/manthey/ traffic/traffic_r_sat.cnf	SAT	48.9956	49.093	3365863
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	51.5192	51.5178	3365961
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	54.5857	54.5861	3366025
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	64.9741	65.0645	3365653
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	83.1724	83.2084	3365651
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	93.3178	93.4439	3365763
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	109.579	109.639	3365627
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	117.279	117.342	3365771
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	117.99	118.046	3365781
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	140.529	140.524	3365977
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	142.353	142.559	3365753
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	147.851	147.917	3365645
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	SAT	151.026	151.029	3365615
ibm-2004-23-k100.cnf	SAT	157.792	157.853	3365567
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	171.927	172.133	3365747
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	173.457	173.52	3365861
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	197.246	197.393	3365553
ibm-2002-30r-k85.cnf	SAT	197.843	197.895	3365571
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	198.454	198.519	3365767
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	211.899	211.91	3366075
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	212.063	212.339	3365757
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	221.177	221.388	3365711
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	239.895	240.195	3365717
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	324.691	324.931	3365551
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	326.407	326.487	3365707
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	SAT	337.072	337.063	3365931
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	345.038	345.09	3365631
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	388.051	388.041	3365959
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	406.315	406.308	3365947
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	457.46	457.481	3365547
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	538.231	538.501	3365727
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	540.168	540.225	3365499
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	655.503	655.547	3365545
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	815.873	815.854	3365617
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	SAT	978.935	978.967	3365897
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	SAT	1095.17	1095.2	3365703
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	1106.96	1106.94	3366023
velev-npe-1.0-9dlx-b71.cnf	SAT	1140.62	1140.9	3365669
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	1237.38	1237.41	3365555
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	SAT	1309.74	1309.74	3365723
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	SAT	1394.79	1394.76	3365665
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	1646.79	1647.37	3366041
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	SAT	1721.71	1722.16	3365731
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	SAT	1744.1	1744.43	3365719
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT	1762.2	1762.42	3365705
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	SAT	1816.74	1816.78	3365501
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	SAT	2302.65	2302.62	3365905
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	2908.57	2908.49	3365943
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	SAT	3076.78	3076.79	3365649
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	SAT	3083.06	3083.19	3365729
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	3155.97	3155.96	3365647
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	SAT	3361.15	3361.15	3365519
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	SAT	3738.36	3738.28	3365901
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	SAT	3762.25	3762.19	3366073

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	5000.02	4999.91	3366049
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	5000.02	4999.91	3365929
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	5000.02	4999.92	3365603
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	5000.02	4999.92	3365985
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	5000.03	4999.92	3365585
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	5000.03	4999.92	3365903
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	5000.03	5000.12	3365899
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	5000.03	4999.92	3365583
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	5000.04	4999.92	3365609
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	5000.04	4999.92	3365981
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	5000.04	4999.92	3365889
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	5000.04	4999.92	3365839
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	? (TO)	5000.04	4999.93	3366029
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	5000.05	4999.93	3365879
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	5000.05	4999.92	3365877
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	5000.05	4999.92	3365873
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	5000.05	4999.92	3366063
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	? (TO)	5000.05	5000.03	3365541
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	? (TO)	5000.05	4999.92	3366031
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	? (TO)	5000.05	4999.92	3366027
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	5000.05	4999.95	3366011
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	5000.05	4999.92	3365661
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	5000.05	4999.92	3365915
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	5000.05	5000.03	3365895
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	5000.05	4999.92	3365887
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	5000.05	4999.92	3365883
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	5000.05	4999.93	3365807
industrial/crypto/ mizh-sha0-36-2.cnf	? (TO)	5000.05	4999.94	3365533
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	5000.06	4999.93	3365999
application/manthey/traffic/ traffic_r_uc_sat.cnf	? (TO)	5000.06	4999.95	3365855
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	5000.06	4999.92	3365517
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	5000.06	4999.95	3365989
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	5000.06	4999.92	3365513
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	? (TO)	5000.06	5000.02	3366061
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	5000.06	4999.91	3366005
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	5000.06	4999.94	3365875
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	5000.07	4999.92	3365941
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	? (TO)	5000.07	4999.93	3365537
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	5000.07	4999.92	3365595
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	5000.07	4999.92	3365667
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	? (TO)	5000.07	4999.93	3365539
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	5000.07	4999.92	3365817
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	5000.07	5000.32	3365881
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	5000.07	4999.92	3365925
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	5000.07	4999.91	3365939
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	? (TO)	5000.07	4999.92	3365983
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	5000.07	4999.96	3366015
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	5000.08	4999.94	3365507
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	5000.08	4999.93	3365591
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	? (TO)	5000.08	4999.91	3366047
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	5000.08	4999.92	3365923
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	5000.08	4999.91	3365581
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	5000.08	4999.92	3365885
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	5000.09	5000.02	3365993
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	5000.09	5000.22	3365909
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	? (TO)	5000.09	4999.92	3365871
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	5000.09	4999.93	3365919
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	5000.09	4999.92	3365921
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	5000.09	4999.96	3366085
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	5000.09	4999.92	3365927
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	5000.09	5000.12	3365529
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	5000.09	4999.93	3365587
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	5000.1	5000.22	3365987
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	5000.1	4999.92	3365933
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	5000.1	4999.92	3365611
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	5000.1	5000.03	3365911
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	5000.1	5000.02	3365913
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	5000.1	4999.92	3365801
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	5000.1	5000.02	3365735
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	5000.11	4999.94	3365589
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	? (TO)	5000.11	5000	3365851
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	? (TO)	5000.12	4999.94	3366013
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	5000.12	5000.05	3365737
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	5000.12	5000.02	3365907
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	5000.12	5000.03	3365725
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	5000.12	5000.04	3365715
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	5000.12	4999.97	3365969
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	? (TO)	5000.12	5000.02	3366021
mizh-sha0-36-4.cnf	? (TO)	5000.12	5000.05	3365563
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	? (TO)	5000.12	4999.92	3365813
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	5000.13	5000.03	3365917
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	5000.13	4999.96	3365597
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	5000.14	4999.98	3365497
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	? (TO)	5000.14	5000.24	3365543
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	? (TO)	5000.15	5000.01	3365755
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	5000.16	4999.98	3365709
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	5000.16	5000.01	3365991
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	5000.16	5000.06	3365971
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	5000.17	5000.07	3365733
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	5000.21	5000.13	3365745

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	Signal 6	101.581	101.578	3365623
industrial/palacios/medium/ cube-11-h14-sat.cnf	Signal 6	446.266	451.856	3365521
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	Signal 6	2236.4	2237.33	3365739
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	Signal 6	2530.46	2530.56	3365699

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver SAT09 reference solver:precosat 236 (complete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (110 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (96 runs) [Show/Hide]

Solver timed out (no solution given) (90 runs) [Show/Hide]

Solver was terminated by a signal (4 runs) [Show/Hide]