Trace number 3280630

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
synit_sat 2011-03-03? (TO) 1300.1 1300.06

General information on the benchmark

Nameindustrial/palacios/hard/
sortnet-8-ipc5-h19-sat.cnf
MD5SUM409f4401e9e8b60ee665ac5567a13e41
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1110.09
Satisfiable
(Un)Satisfiability was proved
Number of variables359341
Number of clauses1254773
Sum of the clauses size3046189
Maximum clause length57
Minimum clause length1
Number of clauses of size 1256
Number of clauses of size 2896240
Number of clauses of size 3346435
Number of clauses of size 4830
Number of clauses of size 5571
Number of clauses of size over 510441

Solver Data 

0.00/0.00	c start  0 total 0
0.79/0.81	c Find Units :        256
0.79/0.87	c Find Invs  :        532
1.09/1.11	c Find Ands  :     358277 AvgFaninNum: 2.49856
1.09/1.12	c Find Xors  :          0 AvgFaninNum: nan
1.09/1.17	c Find Ite   :          0
1.38/1.40	c UnDirect variable: 1064
1.38/1.40	c UnDirect to Direct Gate: 532
1.38/1.40	c Forced Direct Gate: 532 Unuse unDirect Gate: 532
1.38/1.46	c Break Cycle : 0
1.38/1.46	c Total Root : 256 Undef Var: 2316
1.68/1.76	c After covering, Total Root: 256 Leaf: 532
1.68/1.76	c Variable( cover/uncovered/unused ): 359341 0 1784
1.68/1.76	c Unit Clauses: 256
1.68/1.76	c Binary Clauses( cover/uncovered ): 896240 0
1.68/1.76	c Clauses( cover/uncovered ): 358277 0
1.68/1.76	c Total Clauses( cover/uncovered ): 1254773 0 100%
1.68/1.76	c Covered Ands: 358277 Invs: 532 Xors: 0 Ites: 0
1.68/1.77	c Uncover Clauses avg size: nan max size: 0
1.68/1.77	c Final circuit: i/l/o/s     532       0     256    388904
1.68/1.77	c cover rate 100
1.68/1.77	c rocky end  1.76 total 1.76
1.78/1.88	c inp	c lvl 1026	 size 388904
2.99/3.03	c rwt	c lvl 1026	 size 343032
5.19/5.28	c rf 	c lvl 957	 size 306760
5.39/5.43	c bal	c lvl 957	 size 302808
6.60/6.69	c rwb	c lvl 955	 size 290982
6.79/6.83	c bal	c lvl 953	 size 288371
8.49/8.55	c rfi	c lvl 946	 size 271010
9.79/9.84	c rwb	c lvl 945	 size 261434
9.90/9.97	c bal	c lvl 944	 size 257372
10.69/10.77	c rwb	c size 255548
10.69/10.79	c inp	c lvl 944	 size 255548
11.49/11.58	c rwt	c lvl 944	 size 254439
12.99/13.06	c rf 	c lvl 933	 size 253315
13.09/13.17	c bal	c lvl 931	 size 253073
14.19/14.27	c rwb	c lvl 931	 size 250368
14.29/14.39	c bal	c lvl 931	 size 249033
15.69/15.70	c rfi	c lvl 929	 size 247508
16.89/16.95	c rwb	c lvl 929	 size 245117
16.99/17.07	c bal	c lvl 929	 size 244038
17.79/17.85	c rwb	c size 243335
17.89/17.94	c circuit size reduce 430114 243868
17.89/17.94	c opt time  16.18 total 17.94
18.59/18.62	c covering time  0.67 total 18.61
1300.03/1300.00	c interrupt  1281.43 total 1300.04
1300.03/1300.00	c INTERRUPTED ... 
1300.03/1300.00	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280630-1303748353/watcher-3280630-1303748353 -o /tmp/evaluation-result-3280630-1303748353/solver-3280630-1303748353 -C 2400 -W 1300 -M 7680 HOME/synit_sat HOME/instance-3280630-1303748353.cnf 76532943 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 3.98 3.22 4/189 3101
/proc/meminfo: memFree=24109004/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=29716 CPUtime=0 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 1939 0 0 0 0 0 0 0 22 0 1 0 486433110 30429184 1877 33554432000 4194304 4947581 140734618839920 18446744073709551615 4308784 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3101/statm: 7429 1889 320 184 0 2304 0

[startup+0.102558 s]
/proc/loadavg: 4.00 3.98 3.22 4/189 3101
/proc/meminfo: memFree=24109004/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=61680 CPUtime=0.09 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 10181 0 0 0 8 1 0 0 22 0 1 0 486433110 63160320 10116 33554432000 4194304 4947581 140734618839920 18446744073709551615 4816140 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 15420 10116 377 184 0 10295 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 61680

[startup+0.200541 s]
/proc/loadavg: 4.00 3.98 3.22 4/189 3101
/proc/meminfo: memFree=24109004/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=77168 CPUtime=0.19 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 13845 0 0 0 18 1 0 0 23 0 1 0 486433110 79020032 13780 33554432000 4194304 4947581 140734618839920 18446744073709551615 4814748 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 19292 13780 377 184 0 14167 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 77168

[startup+0.300519 s]
/proc/loadavg: 4.00 3.98 3.22 4/189 3101
/proc/meminfo: memFree=24109004/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=89584 CPUtime=0.29 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 17246 0 0 0 28 1 0 0 23 0 1 0 486433110 91734016 17181 33554432000 4194304 4947581 140734618839920 18446744073709551615 4824560 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 22396 17181 377 184 0 17271 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 89584

[startup+0.700459 s]
/proc/loadavg: 4.00 3.98 3.22 4/189 3101
/proc/meminfo: memFree=24109004/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=140016 CPUtime=0.69 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 29913 0 0 0 66 3 0 0 25 0 1 0 486433110 143376384 29848 33554432000 4194304 4947581 140734618839920 18446744073709551615 4824560 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 39100 29855 377 184 0 33975 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 140016

[startup+1.50031 s]
/proc/loadavg: 4.00 3.98 3.22 5/190 3102
/proc/meminfo: memFree=23958956/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=180332 CPUtime=1.48 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 38009 0 0 0 144 4 0 0 25 0 1 0 486433110 184659968 37944 33554432000 4194304 4947581 140734618839920 18446744073709551615 4760896 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 45083 37944 384 184 0 39958 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 180332

[startup+3.10101 s]
/proc/loadavg: 4.00 3.98 3.23 5/190 3102
/proc/meminfo: memFree=23864088/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=299328 CPUtime=3.09 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 65260 0 0 0 301 8 0 0 25 0 1 0 486433110 306511872 65195 33554432000 4194304 4947581 140734618839920 18446744073709551615 4338681 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 74832 65195 421 184 0 69707 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 299328

[startup+6.30045 s]
/proc/loadavg: 4.00 3.98 3.23 5/190 3102
/proc/meminfo: memFree=23739044/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=415828 CPUtime=6.29 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 92530 0 0 0 618 11 0 0 25 0 1 0 486433110 425807872 92465 33554432000 4194304 4947581 140734618839920 18446744073709551615 4224824 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 103957 92465 429 184 0 98832 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 415828

[startup+12.7003 s]
/proc/loadavg: 4.00 3.98 3.24 5/190 3102
/proc/meminfo: memFree=23645296/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=432212 CPUtime=12.69 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 98957 0 0 0 1257 12 0 0 25 0 1 0 486433110 442585088 98595 33554432000 4194304 4947581 140734618839920 18446744073709551615 4330384 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 108053 98595 430 184 0 102928 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 432212

[startup+25.501 s]
/proc/loadavg: 4.00 3.98 3.24 5/190 3103
/proc/meminfo: memFree=23361340/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=728756 CPUtime=25.5 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 161507 0 0 0 2530 20 0 0 25 0 1 0 486433110 746246144 160982 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399502 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 182189 160982 462 184 0 177064 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 728756

[startup+51.1003 s]
/proc/loadavg: 4.00 3.98 3.26 5/190 3103
/proc/meminfo: memFree=23055660/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1059172 CPUtime=51.09 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 227572 0 0 0 5081 28 0 0 25 0 1 0 486433110 1084592128 226859 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399336 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 264793 226859 492 184 0 259668 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 1059172

[startup+102.301 s]
/proc/loadavg: 4.08 3.99 3.31 5/190 3105
/proc/meminfo: memFree=22931516/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1149172 CPUtime=102.3 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 249199 0 0 0 10196 34 0 0 25 0 1 0 486433110 1176752128 248480 33554432000 4194304 4947581 140734618839920 18446744073709551615 4400592 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 287293 248480 493 184 0 282168 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 1149172

[startup+162.3 s]
/proc/loadavg: 4.03 3.99 3.35 5/190 3106
/proc/meminfo: memFree=22829240/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1210480 CPUtime=162.29 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 262756 0 0 0 16192 37 0 0 25 0 1 0 486433110 1239531520 261854 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399850 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 302620 261854 494 184 0 297495 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 1210480

[startup+222.307 s]
/proc/loadavg: 4.01 3.99 3.39 5/190 3108
/proc/meminfo: memFree=22744648/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1253504 CPUtime=222.3 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 271189 0 0 0 22192 38 0 0 25 0 1 0 486433110 1283588096 270284 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399717 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 313376 270284 495 184 0 308251 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 1253504

[startup+282.301 s]
/proc/loadavg: 4.00 3.99 3.42 5/190 3109
/proc/meminfo: memFree=22691056/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1269244 CPUtime=282.3 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 276046 0 0 0 28189 41 0 0 25 0 1 0 486433110 1299705856 275141 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399348 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 317311 275141 495 184 0 312186 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 1269244

[startup+342.301 s]
/proc/loadavg: 4.00 3.99 3.46 5/190 3111
/proc/meminfo: memFree=22656056/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1269244 CPUtime=342.3 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 277021 0 0 0 34189 41 0 0 25 0 1 0 486433110 1299705856 275962 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399850 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 317311 275962 495 184 0 312186 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 1269244

[startup+402.301 s]
/proc/loadavg: 4.00 3.99 3.49 5/190 3113
/proc/meminfo: memFree=22600352/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1285676 CPUtime=402.3 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 281772 0 0 0 40188 42 0 0 25 0 1 0 486433110 1316532224 280713 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399340 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 321419 280713 495 184 0 316294 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 1285676

[startup+462.301 s]
/proc/loadavg: 4.00 3.99 3.52 5/190 3115
/proc/meminfo: memFree=22572304/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1303192 CPUtime=462.31 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 282616 0 0 0 46188 43 0 0 25 0 1 0 486433110 1334468608 281557 33554432000 4194304 4947581 140734618839920 18446744073709551615 4400152 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 325798 281557 495 184 0 320673 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 1303192

[startup+522.3 s]
/proc/loadavg: 4.04 4.01 3.55 5/190 3117
/proc/meminfo: memFree=22528504/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1303192 CPUtime=522.3 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 288123 0 0 0 52186 44 0 0 25 0 1 0 486433110 1334468608 287050 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399717 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 325798 287050 495 184 0 320673 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 1303192

[startup+582.3 s]
/proc/loadavg: 3.49 3.86 3.53 4/184 3139
/proc/meminfo: memFree=22730360/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1303192 CPUtime=582.3 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 288441 0 0 0 58186 44 0 0 25 0 1 0 486433110 1334468608 287368 33554432000 4194304 4947581 140734618839920 18446744073709551615 4398556 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 325798 287368 495 184 0 320673 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 1303192

[startup+642.301 s]
/proc/loadavg: 3.19 3.71 3.50 4/184 3141
/proc/meminfo: memFree=22716428/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1303192 CPUtime=642.31 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 288596 0 0 0 64187 44 0 0 25 0 1 0 486433110 1334468608 287523 33554432000 4194304 4947581 140734618839920 18446744073709551615 4350958 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 325798 287523 495 184 0 320673 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 1303192

[startup+702.301 s]
/proc/loadavg: 3.06 3.57 3.46 4/184 3146
/proc/meminfo: memFree=22713156/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1303192 CPUtime=702.31 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 289106 0 0 0 70187 44 0 0 25 0 1 0 486433110 1334468608 288033 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399720 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 325798 288033 495 184 0 320673 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 1303192

[startup+762.301 s]
/proc/loadavg: 3.02 3.46 3.43 4/184 3147
/proc/meminfo: memFree=22701448/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1303192 CPUtime=762.31 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 289689 0 0 0 76187 44 0 0 25 0 1 0 486433110 1334468608 288616 33554432000 4194304 4947581 140734618839920 18446744073709551615 4398560 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 325798 288616 495 184 0 320673 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 1303192

[startup+822.301 s]
/proc/loadavg: 3.01 3.38 3.40 4/184 3149
/proc/meminfo: memFree=22676484/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1303192 CPUtime=822.31 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 289837 0 0 0 82187 44 0 0 25 0 1 0 486433110 1334468608 288764 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399850 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 325798 288764 495 184 0 320673 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 1303192

[startup+882.307 s]
/proc/loadavg: 3.04 3.32 3.37 4/184 3150
/proc/meminfo: memFree=22645080/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1324364 CPUtime=882.32 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 293700 0 0 0 88185 47 0 0 25 0 1 0 486433110 1356148736 292627 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399405 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 331091 292627 495 184 0 325966 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 1324364

[startup+942.3 s]
/proc/loadavg: 3.01 3.26 3.35 4/184 3152
/proc/meminfo: memFree=22609212/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1324364 CPUtime=942.32 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 294717 0 0 0 94184 48 0 0 25 0 1 0 486433110 1356148736 293644 33554432000 4194304 4947581 140734618839920 18446744073709551615 4398665 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 331091 293644 495 184 0 325966 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 1324364

[startup+1002.3 s]
/proc/loadavg: 3.00 3.21 3.32 4/184 3154
/proc/meminfo: memFree=22612392/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1346588 CPUtime=1002.31 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 298572 0 0 0 100183 48 0 0 25 0 1 0 486433110 1378906112 292615 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399453 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 336647 292615 500 184 0 331522 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 1346588

[startup+1062.3 s]
/proc/loadavg: 3.06 3.18 3.31 4/184 3155
/proc/meminfo: memFree=22585316/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1369244 CPUtime=1062.32 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 303706 0 0 0 106182 50 0 0 25 0 1 0 486433110 1402105856 297749 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399850 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 342311 297749 500 184 0 337186 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 1369244

[startup+1122.3 s]
/proc/loadavg: 3.02 3.15 3.28 4/184 3157
/proc/meminfo: memFree=22576960/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1369244 CPUtime=1122.33 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 305802 0 0 0 112181 52 0 0 25 0 1 0 486433110 1402105856 299845 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399336 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 342311 299845 500 184 0 337186 0
Current children cumulated CPU time (s) 1122.33
Current children cumulated vsize (KiB) 1369244

[startup+1182.3 s]
/proc/loadavg: 3.01 3.12 3.26 4/184 3158
/proc/meminfo: memFree=22548160/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1392476 CPUtime=1182.33 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 310986 0 0 0 118179 54 0 0 25 0 1 0 486433110 1425895424 305029 33554432000 4194304 4947581 140734618839920 18446744073709551615 4399720 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 348119 305029 500 184 0 342994 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 1392476

[startup+1242.3 s]
/proc/loadavg: 2.47 2.95 3.20 3/178 3178
/proc/meminfo: memFree=22803468/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1392476 CPUtime=1242.33 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 311604 0 0 0 124179 54 0 0 25 0 1 0 486433110 1425895424 305647 33554432000 4194304 4947581 140734618839920 18446744073709551615 4400060 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 348119 305647 500 184 0 342994 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 1392476



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 2.11 2.78 3.12 2/173 3199
/proc/meminfo: memFree=23297088/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1512040 CPUtime=1300.03 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 315517 0 0 0 129948 55 0 0 25 0 1 0 486433110 1548328960 309560 33554432000 4194304 4947581 140734618839920 18446744073709551615 4400023 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 378010 309560 500 184 0 372885 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 1512040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 2.11 2.78 3.12 2/173 3199
/proc/meminfo: memFree=23297088/32951124 swapFree=67111412/67111528
[pid=3101] ppid=3098 vsize=1512040 CPUtime=1300.03 cores=1,3
/proc/3101/stat : 3101 (synit_sat) R 3098 3101 2713 0 -1 4202496 315517 0 0 0 129948 55 0 0 25 0 1 0 486433110 1548328960 309560 33554432000 4194304 4947581 140734618839920 18446744073709551615 4400023 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/3101/statm: 378010 309560 500 184 0 372885 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 1512040

Child status: 1
Real time (s): 1300.06
CPU time (s): 1300.1
CPU user time (s): 1299.49
CPU system time (s): 0.607907
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 1512040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.49
system time used= 0.607907
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 315522
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1440

runsolver used 2.05369 second user time and 5.04223 second system time

The end

Launcher Data 

Begin job on node137 at 2011-04-25 18:19:14
IDJOB=3280630
IDBENCH=20410
IDSOLVER=1571
FILE ID=node137/3280630-1303748353
RUNJOBID= node137-1303746806-2734
PBS_JOBID= 13154025
Free space on /tmp= 71756 MiB

SOLVER NAME= synit_sat 2011-03-03
BENCH NAME= SAT07/industrial/palacios/hard/sortnet-8-ipc5-h19-sat.cnf
COMMAND LINE= HOME/synit_sat BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280630-1303748353/watcher-3280630-1303748353 -o /tmp/evaluation-result-3280630-1303748353/solver-3280630-1303748353 -C 2400 -W 1300 -M 7680  HOME/synit_sat HOME/instance-3280630-1303748353.cnf 76532943

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 409f4401e9e8b60ee665ac5567a13e41
RANDOM SEED=76532943

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24109028 kB
Buffers:       1716304 kB
Cached:        6099484 kB
SwapCached:        112 kB
Active:        1811464 kB
Inactive:      6479616 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24109028 kB
SwapTotal:    67111528 kB
SwapFree:     67111412 kB
Dirty:           33964 kB
Writeback:           0 kB
AnonPages:      474648 kB
Mapped:          17036 kB
Slab:           486048 kB
PageTables:       5684 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   776132 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71768 MiB
End job on node137 at 2011-04-25 18:40:56