Trace number 3386378

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3995.11 1300.07

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.12.unsat.cnf
MD5SUM8d6acb9f6b752ad76c024133f5175c69
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1694
Number of clauses5726
Sum of the clauses size14874
Maximum clause length23
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22490
Number of clauses of size 33143
Number of clauses of size 439
Number of clauses of size 538
Number of clauses of size over 513

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386378-1305576782/watcher-3386378-1305576782 -o /tmp/evaluation-result-3386378-1305576782/solver-3386378-1305576782 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386378-1305576782.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.12 11.14 11.22 8/394 6041
/proc/meminfo: memFree=17303512/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=50560 CPUtime=0 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 768 0 0 0 0 0 0 0 25 0 4 0 669276112 51773440 705 33554432000 4194304 4625164 140734039069776 18446744073709551615 47332037646258 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 12640 705 304 106 0 8143 0
[pid=6041/tid=6042] ppid=6039 vsize=50560 CPUtime=0 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669276112 51773440 705 33554432000 4194304 4625164 140734039069776 18446744073709551615 271550594033 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=50560 CPUtime=0 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669276112 51773440 705 33554432000 4194304 4625164 140734039069776 18446744073709551615 271550594033 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=50560 CPUtime=0 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 669276112 51773440 705 33554432000 4194304 4625164 140734039069776 18446744073709551615 47332037646258 0 0 4096 2 0 0 0 -1 2 0 0 0

[startup+0.148679 s]
/proc/loadavg: 10.12 11.14 11.22 8/394 6041
/proc/meminfo: memFree=17303512/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=252188 CPUtime=2.49 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 6490 0 0 0 249 0 0 0 18 0 4 0 669276112 258240512 3633 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 63047 3633 346 106 0 58550 0
[pid=6041/tid=6042] ppid=6039 vsize=252188 CPUtime=0.82 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1012 0 0 0 82 0 0 0 18 0 4 0 669276112 258240512 3633 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=252188 CPUtime=0.82 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1393 0 0 0 82 0 0 0 19 0 4 0 669276112 258240512 3633 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352404 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=252188 CPUtime=0.34 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1255 0 0 0 34 0 0 0 18 0 4 0 669276112 258240512 3633 33554432000 4194304 4625164 140734039069776 18446744073709551615 4579601 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.49
Current children cumulated vsize (KiB) 252188

[startup+0.946778 s]
/proc/loadavg: 10.12 11.14 11.22 8/394 6041
/proc/meminfo: memFree=17303512/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=253024 CPUtime=2.79 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 7007 0 0 0 279 0 0 0 18 0 4 0 669276112 259096576 3835 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 63256 3835 346 106 0 58759 0
[pid=6041/tid=6042] ppid=6039 vsize=253024 CPUtime=0.91 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1348 0 0 0 91 0 0 0 19 0 4 0 669276112 259096576 3835 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=253024 CPUtime=0.92 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1488 0 0 0 92 0 0 0 19 0 4 0 669276112 259096576 3835 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=253024 CPUtime=0.41 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1336 0 0 0 41 0 0 0 18 0 4 0 669276112 259096576 3835 33554432000 4194304 4625164 140734039069776 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.79
Current children cumulated vsize (KiB) 253024

[startup+1.04673 s]
/proc/loadavg: 10.12 11.14 11.22 8/394 6041
/proc/meminfo: memFree=17303512/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=253288 CPUtime=3.1 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 7303 0 0 0 309 1 0 0 18 0 4 0 669276112 259366912 4036 33554432000 4194304 4625164 140734039069776 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 63322 4036 346 106 0 58825 0
[pid=6041/tid=6042] ppid=6039 vsize=253288 CPUtime=1.01 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1413 0 0 0 101 0 0 0 19 0 4 0 669276112 259366912 4036 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=253288 CPUtime=1.02 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1578 0 0 0 102 0 0 0 19 0 4 0 669276112 259366912 4036 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=253288 CPUtime=0.44 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1470 0 0 0 44 0 0 0 18 0 4 0 669276112 259366912 4036 33554432000 4194304 4625164 140734039069776 18446744073709551615 4327715 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 253288

[startup+1.14671 s]
/proc/loadavg: 10.12 11.14 11.22 8/394 6041
/proc/meminfo: memFree=17303512/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=253552 CPUtime=3.4 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 7699 0 0 0 339 1 0 0 18 0 4 0 669276112 259637248 4258 33554432000 4194304 4625164 140734039069776 18446744073709551615 4338092 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 63388 4258 346 106 0 58891 0
[pid=6041/tid=6042] ppid=6039 vsize=253552 CPUtime=1.11 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1479 0 0 0 111 0 0 0 19 0 4 0 669276112 259637248 4258 33554432000 4194304 4625164 140734039069776 18446744073709551615 4464984 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=253552 CPUtime=1.12 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1676 0 0 0 112 0 0 0 19 0 4 0 669276112 259637248 4258 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352859 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=253552 CPUtime=0.5 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1700 0 0 0 50 0 0 0 18 0 4 0 669276112 259637248 4258 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.4
Current children cumulated vsize (KiB) 253552

[startup+1.50065 s]
/proc/loadavg: 10.12 11.14 11.22 8/394 6041
/proc/meminfo: memFree=17303512/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=255252 CPUtime=4.46 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 8718 0 0 0 445 1 0 0 18 0 4 0 669276112 261378048 4799 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512159 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 63813 4799 346 106 0 59316 0
[pid=6041/tid=6042] ppid=6039 vsize=255252 CPUtime=1.47 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1547 0 0 0 147 0 0 0 20 0 4 0 669276112 261378048 4799 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=255252 CPUtime=1.47 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 2299 0 0 0 147 0 0 0 20 0 4 0 669276112 261378048 4799 33554432000 4194304 4625164 140734039069776 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=255252 CPUtime=0.69 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 2015 0 0 0 69 0 0 0 18 0 4 0 669276112 261378048 4799 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352731 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.46
Current children cumulated vsize (KiB) 255252

[startup+3.10036 s]
/proc/loadavg: 10.27 11.16 11.22 12/398 6075
/proc/meminfo: memFree=17497052/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=257528 CPUtime=9.22 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 13106 0 0 0 921 1 0 0 20 0 4 0 669276112 263708672 6945 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511926 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 64382 6945 347 106 0 59885 0
[pid=6041/tid=6042] ppid=6039 vsize=257528 CPUtime=3.07 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 2563 0 0 0 307 0 0 0 25 0 4 0 669276112 263708672 6945 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=257528 CPUtime=2.62 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 3585 0 0 0 262 0 0 0 22 0 4 0 669276112 263708672 6945 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=257528 CPUtime=1.57 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 4008 0 0 0 157 0 0 0 19 0 4 0 669276112 263708672 6945 33554432000 4194304 4625164 140734039069776 18446744073709551615 4552402 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 9.22
Current children cumulated vsize (KiB) 257528

[startup+6.31478 s]
/proc/loadavg: 10.49 11.19 11.23 12/398 6075
/proc/meminfo: memFree=17470268/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=263224 CPUtime=18.83 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 20210 0 0 0 1881 2 0 0 25 0 4 0 669276112 269541376 10381 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 65806 10381 347 106 0 61309 0
[pid=6041/tid=6042] ppid=6039 vsize=263224 CPUtime=6.28 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 5275 0 0 0 628 0 0 0 25 0 4 0 669276112 269541376 10381 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=263224 CPUtime=4.11 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 3867 0 0 0 411 0 0 0 25 0 4 0 669276112 269541376 10381 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=263224 CPUtime=3.24 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 7262 0 0 0 324 0 0 0 25 0 4 0 669276112 269541376 10381 33554432000 4194304 4625164 140734039069776 18446744073709551615 4548692 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 18.83
Current children cumulated vsize (KiB) 263224

[startup+12.7006 s]
/proc/loadavg: 10.53 11.18 11.23 12/398 6076
/proc/meminfo: memFree=17432684/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=273364 CPUtime=37.91 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 36033 0 0 0 3786 5 0 0 25 0 4 0 669276112 279924736 15661 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 68341 15661 349 106 0 63844 0
[pid=6041/tid=6042] ppid=6039 vsize=273364 CPUtime=11.35 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 8639 0 0 0 1134 1 0 0 25 0 4 0 669276112 279924736 15661 33554432000 4194304 4625164 140734039069776 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=273364 CPUtime=8.58 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 5535 0 0 0 858 0 0 0 25 0 4 0 669276112 279924736 15661 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=273364 CPUtime=6.4 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 16743 0 0 0 638 2 0 0 25 0 4 0 669276112 279924736 15661 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37.91
Current children cumulated vsize (KiB) 273364

[startup+25.5003 s]
/proc/loadavg: 10.60 11.18 11.22 13/398 6076
/proc/meminfo: memFree=17378236/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=287092 CPUtime=76.14 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 60068 0 0 0 7605 9 0 0 25 0 4 0 669276112 293982208 22467 33554432000 4194304 4625164 140734039069776 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 71773 22467 351 106 0 67276 0
[pid=6041/tid=6042] ppid=6039 vsize=287092 CPUtime=23.55 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 11971 0 0 0 2353 2 0 0 25 0 4 0 669276112 293982208 22467 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352080 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=287092 CPUtime=21.22 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 8916 0 0 0 2121 1 0 0 25 0 4 0 669276112 293982208 22467 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=287092 CPUtime=12.74 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 33061 0 0 0 1270 4 0 0 25 0 4 0 669276112 293982208 22467 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 76.14
Current children cumulated vsize (KiB) 287092

[startup+51.1006 s]
/proc/loadavg: 10.80 11.18 11.22 13/398 6077
/proc/meminfo: memFree=17304944/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=300872 CPUtime=152.62 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 98181 0 0 0 15245 17 0 0 25 0 4 0 669276112 308092928 32990 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512869 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 75218 32990 355 106 0 70721 0
[pid=6041/tid=6042] ppid=6039 vsize=300872 CPUtime=37.52 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 13618 0 0 0 3750 2 0 0 25 0 4 0 669276112 308092928 32990 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=300872 CPUtime=40.81 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 12782 0 0 0 4078 3 0 0 25 0 4 0 669276112 308092928 32990 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=300872 CPUtime=31.08 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 63293 0 0 0 3099 9 0 0 25 0 4 0 669276112 308092928 32990 33554432000 4194304 4625164 140734039069776 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 152.62
Current children cumulated vsize (KiB) 300872

[startup+102.3 s]
/proc/loadavg: 11.01 11.17 11.22 13/398 6078
/proc/meminfo: memFree=17177816/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=327980 CPUtime=305.55 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 182263 0 0 0 30525 30 0 0 25 0 4 0 669276112 335851520 50377 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6041/statm: 81995 50377 502 106 0 77498 0
[pid=6041/tid=6042] ppid=6039 vsize=327980 CPUtime=75.92 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 19543 0 0 0 7588 4 0 0 25 0 4 0 669276112 335851520 50377 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=327980 CPUtime=84.56 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 18511 0 0 0 8452 4 0 0 25 0 4 0 669276112 335851520 50377 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=327980 CPUtime=58.6 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 126124 0 0 0 5842 18 0 0 25 0 4 0 669276112 335851520 50377 33554432000 4194304 4625164 140734039069776 18446744073709551615 4551665 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 305.55
Current children cumulated vsize (KiB) 327980

[startup+162.3 s]

################
# More data... #
################

[pid=6041] ppid=6039 vsize=964780 CPUtime=2097.84 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1394528 0 0 0 209554 230 0 0 25 0 4 0 669276112 987934720 186417 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6041/statm: 241195 186417 375 106 0 236698 0
[pid=6041/tid=6042] ppid=6039 vsize=964780 CPUtime=505.28 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 69666 0 0 0 50510 18 0 0 25 0 4 0 669276112 987934720 186417 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=964780 CPUtime=570.6 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 28545 0 0 0 57053 7 0 0 25 0 4 0 669276112 987934720 186417 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=964780 CPUtime=489.43 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1147033 0 0 0 48763 180 0 0 25 0 4 0 669276112 987934720 186417 33554432000 4194304 4625164 140734039069776 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2097.84
Current children cumulated vsize (KiB) 964780

[startup+762.3 s]
/proc/loadavg: 11.23 11.21 11.20 12/398 6096
/proc/meminfo: memFree=16114616/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=979624 CPUtime=2277.05 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1402200 0 0 0 227473 232 0 0 25 0 4 0 669276112 1003134976 193944 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 244906 193944 375 106 0 240409 0
[pid=6041/tid=6042] ppid=6039 vsize=979624 CPUtime=556.45 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 71588 0 0 0 55626 19 0 0 25 0 4 0 669276112 1003134976 193944 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=979624 CPUtime=630.6 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 29045 0 0 0 63052 8 0 0 25 0 4 0 669276112 1003134976 193944 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=979624 CPUtime=527.62 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1150943 0 0 0 52582 180 0 0 25 0 4 0 669276112 1003134976 193944 33554432000 4194304 4625164 140734039069776 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2277.05
Current children cumulated vsize (KiB) 979624

[startup+822.301 s]
/proc/loadavg: 11.36 11.25 11.21 12/398 6097
/proc/meminfo: memFree=16031144/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1049444 CPUtime=2456.3 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1438590 0 0 0 245392 238 0 0 25 0 4 0 669276112 1074630656 207833 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512167 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 262361 207833 375 106 0 257864 0
[pid=6041/tid=6042] ppid=6039 vsize=1049444 CPUtime=586.15 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 74417 0 0 0 58594 21 0 0 25 0 4 0 669276112 1074630656 207833 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1049444 CPUtime=690.34 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 29394 0 0 0 69026 8 0 0 25 0 4 0 669276112 1074630656 207833 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1049444 CPUtime=587.62 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1157091 0 0 0 58581 181 0 0 25 0 4 0 669276112 1074630656 207833 33554432000 4194304 4625164 140734039069776 18446744073709551615 4547468 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2456.3
Current children cumulated vsize (KiB) 1049444

[startup+882.301 s]
/proc/loadavg: 11.13 11.20 11.19 13/398 6099
/proc/meminfo: memFree=15971356/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1071324 CPUtime=2635.51 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1448682 0 0 0 263311 240 0 0 25 0 4 0 669276112 1097035776 217783 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512023 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 267831 217783 374 106 0 263334 0
[pid=6041/tid=6042] ppid=6039 vsize=1071324 CPUtime=616.17 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 75315 0 0 0 61595 22 0 0 25 0 4 0 669276112 1097035776 217783 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352002 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1071324 CPUtime=723.43 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 29644 0 0 0 72335 8 0 0 25 0 4 0 669276112 1097035776 217783 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1071324 CPUtime=644.5 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1162933 0 0 0 64268 182 0 0 25 0 4 0 669276112 1097035776 217783 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2635.51
Current children cumulated vsize (KiB) 1071324

[startup+942.301 s]
/proc/loadavg: 11.15 11.19 11.18 12/398 6100
/proc/meminfo: memFree=15926312/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1082124 CPUtime=2814.77 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1454851 0 0 0 281233 244 0 0 25 0 4 0 669276112 1108094976 223871 33554432000 4194304 4625164 140734039069776 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 270531 223871 364 106 0 266034 0
[pid=6041/tid=6042] ppid=6039 vsize=1082124 CPUtime=664.33 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 76593 0 0 0 66409 24 0 0 25 0 4 0 669276112 1108094976 223872 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1082124 CPUtime=765.31 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 30220 0 0 0 76522 9 0 0 25 0 4 0 669276112 1108094976 223872 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352089 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1082124 CPUtime=674.5 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1165664 0 0 0 67267 183 0 0 25 0 4 0 669276112 1108094976 223872 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2814.77
Current children cumulated vsize (KiB) 1082124

[startup+1002.3 s]
/proc/loadavg: 11.25 11.22 11.19 12/398 6102
/proc/meminfo: memFree=15877564/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1193032 CPUtime=2993.98 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1480541 0 0 0 299148 250 0 0 25 0 4 0 669276112 1221664768 232387 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 298258 232387 347 106 0 293761 0
[pid=6041/tid=6042] ppid=6039 vsize=1193032 CPUtime=722.33 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 96887 0 0 0 72205 28 0 0 25 0 4 0 669276112 1221664768 232387 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1193032 CPUtime=797.34 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 30351 0 0 0 79725 9 0 0 25 0 4 0 669276112 1221664768 232387 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352404 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1193032 CPUtime=704.44 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1168548 0 0 0 70260 184 0 0 25 0 4 0 669276112 1221664768 232387 33554432000 4194304 4625164 140734039069776 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2993.98
Current children cumulated vsize (KiB) 1193032

[startup+1062.32 s]
/proc/loadavg: 11.28 11.23 11.19 12/398 6104
/proc/meminfo: memFree=15820368/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1273432 CPUtime=3173.23 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1523103 0 0 0 317066 257 0 0 25 0 4 0 669276112 1303994368 242188 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 318358 242188 347 106 0 313861 0
[pid=6041/tid=6042] ppid=6039 vsize=1273432 CPUtime=752.13 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 97988 0 0 0 75183 30 0 0 25 0 4 0 669276112 1303994368 242188 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1273432 CPUtime=857.36 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 38944 0 0 0 85726 10 0 0 25 0 4 0 669276112 1303994368 242188 33554432000 4194304 4625164 140734039069776 18446744073709551615 4462312 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1273432 CPUtime=752.24 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1172913 0 0 0 75039 185 0 0 25 0 4 0 669276112 1303994368 242188 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3173.23
Current children cumulated vsize (KiB) 1273432

[startup+1122.3 s]
/proc/loadavg: 11.35 11.26 11.20 12/398 6105
/proc/meminfo: memFree=15749424/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1361920 CPUtime=3375.33 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1536699 0 0 0 337272 261 0 0 25 0 4 0 669276112 1394606080 255394 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 340480 255394 347 106 0 335983 0
[pid=6041/tid=6042] ppid=6039 vsize=1361920 CPUtime=782.02 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 99001 0 0 0 78171 31 0 0 25 0 4 0 669276112 1394606080 255394 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1361920 CPUtime=917.34 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 40900 0 0 0 91724 10 0 0 25 0 4 0 669276112 1394606080 255394 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1361920 CPUtime=812.22 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1178618 0 0 0 81036 186 0 0 25 0 4 0 669276112 1394606080 255394 33554432000 4194304 4625164 140734039069776 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3375.33
Current children cumulated vsize (KiB) 1361920

[startup+1182.3 s]
/proc/loadavg: 11.28 11.26 11.20 12/398 6107
/proc/meminfo: memFree=15668064/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1419224 CPUtime=3584.55 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1552203 0 0 0 358191 264 0 0 25 0 4 0 669276112 1453285376 270374 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 354806 270374 401 106 0 350309 0
[pid=6041/tid=6042] ppid=6039 vsize=1419224 CPUtime=812.01 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 99997 0 0 0 81170 31 0 0 25 0 4 0 669276112 1453285376 270374 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1419224 CPUtime=977.35 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 41030 0 0 0 97724 11 0 0 25 0 4 0 669276112 1453285376 270374 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1419224 CPUtime=872.23 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1189615 0 0 0 87035 188 0 0 25 0 4 0 669276112 1453285376 270374 33554432000 4194304 4625164 140734039069776 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3584.55
Current children cumulated vsize (KiB) 1419224

[startup+1242.3 s]
/proc/loadavg: 11.26 11.25 11.20 12/398 6108
/proc/meminfo: memFree=15638260/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1419224 CPUtime=3793.77 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1554939 0 0 0 379111 266 0 0 25 0 4 0 669276112 1453285376 272795 33554432000 4194304 4625164 140734039069776 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 354806 272795 347 106 0 350309 0
[pid=6041/tid=6042] ppid=6039 vsize=1419224 CPUtime=842.01 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 100907 0 0 0 84169 32 0 0 25 0 4 0 669276112 1453285376 272795 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1419224 CPUtime=1037.35 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 41118 0 0 0 103724 11 0 0 25 0 4 0 669276112 1453285376 272795 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1419224 CPUtime=932.23 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1189672 0 0 0 93035 188 0 0 25 0 4 0 669276112 1453285376 272795 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3793.77
Current children cumulated vsize (KiB) 1419224



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 11.14 11.22 11.19 12/398 6110
/proc/meminfo: memFree=15537300/32951124 swapFree=67056796/67111528
[pid=6041] ppid=6039 vsize=1435932 CPUtime=3995.02 cores=0,2,4,6
/proc/6041/stat : 6041 (SArTagnan) R 6039 6041 5970 0 -1 4202496 1563761 0 0 0 399233 269 0 0 25 0 4 0 669276112 1470394368 281051 33554432000 4194304 4625164 140734039069776 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6041/statm: 358983 281051 347 106 0 354486 0
[pid=6041/tid=6042] ppid=6039 vsize=1435932 CPUtime=870.89 cores=0,2,4,6
/proc/6041/task/6042/stat : 6042 (SArTagnan) R 6039 6041 5970 0 -1 4202560 101915 0 0 0 87056 33 0 0 25 0 4 0 669276112 1470394368 281051 33554432000 4194304 4625164 140734039069776 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6041/tid=6043] ppid=6039 vsize=1435932 CPUtime=1095.07 cores=0,2,4,6
/proc/6041/task/6043/stat : 6043 (SArTagnan) R 6039 6041 5970 0 -1 4202560 41222 0 0 0 109496 11 0 0 25 0 4 0 669276112 1470394368 281051 33554432000 4194304 4625164 140734039069776 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6041/tid=6044] ppid=6039 vsize=1435932 CPUtime=989.94 cores=0,2,4,6
/proc/6041/task/6044/stat : 6044 (SArTagnan) R 6039 6041 5970 0 -1 4202560 1194101 0 0 0 98805 189 0 0 25 0 4 0 669276112 1470394368 281051 33554432000 4194304 4625164 140734039069776 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3995.02
Current children cumulated vsize (KiB) 1435932

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.07
CPU time (s): 3995.11
CPU user time (s): 3992.37
CPU system time (s): 2.73958
CPU usage (%): 307.3
Max. virtual memory (cumulated for all children) (KiB): 1435932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3992.37
system time used= 2.73958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1563761
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 545
involuntary context switches= 85014

runsolver used 4.72228 second user time and 11.8382 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-16 22:13:02
IDJOB=3386378
IDBENCH=20468
IDSOLVER=1871
FILE ID=node133/3386378-1305576782
RUNJOBID= node133-1305576779-5988
PBS_JOBID= 13350209
Free space on /tmp= 73392 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.12.unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386378-1305576782/watcher-3386378-1305576782 -o /tmp/evaluation-result-3386378-1305576782/solver-3386378-1305576782 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386378-1305576782.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d6acb9f6b752ad76c024133f5175c69
RANDOM SEED=883050761

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17303668 kB
Buffers:        326068 kB
Cached:        4520520 kB
SwapCached:       7668 kB
Active:       12020564 kB
Inactive:      3310684 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17303668 kB
SwapTotal:    67111528 kB
SwapFree:     67056796 kB
Dirty:           12288 kB
Writeback:          16 kB
AnonPages:    10482872 kB
Mapped:          32328 kB
Slab:           202656 kB
PageTables:      45460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 85240060 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73400 MiB
End job on node133 at 2011-05-16 22:34:44