Trace number 3386121

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.32 1203.97

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n180-s33098896-unsat.cnf
MD5SUM1221fb51c407dee7559369d7c6eedb4e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables181
Number of clauses372
Sum of the clauses size1116
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3372
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386121-1305580345/watcher-3386121-1305580345 -o /tmp/evaluation-result-3386121-1305580345/solver-3386121-1305580345 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386121-1305580345.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.18 8.09 8.03 5/401 2041
/proc/meminfo: memFree=12344148/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=49212 CPUtime=0 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 453 0 0 0 0 0 0 0 25 0 4 0 669634125 50393088 390 33554432000 4194304 4625164 140737265790768 18446744073709551615 47376144713644 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 12303 390 300 106 0 7806 0
[pid=2041/tid=2042] ppid=2039 vsize=180592 CPUtime=0 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 4 0 669634125 184926208 575 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=180592 CPUtime=0 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 37 0 0 0 0 0 0 0 25 0 4 0 669634125 184926208 579 33554432000 4194304 4625164 140737265790768 18446744073709551615 4465337 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=180592 CPUtime=0 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 63 0 0 0 0 0 0 0 25 0 4 0 669634125 184926208 580 33554432000 4194304 4625164 140737265790768 18446744073709551615 208096216091 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.11555 s]
/proc/loadavg: 8.18 8.09 8.03 5/401 2041
/proc/meminfo: memFree=12344148/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=182768 CPUtime=0.43 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2086 0 0 0 43 0 0 0 25 0 4 0 669634125 187154432 1622 33554432000 4194304 4625164 140737265790768 18446744073709551615 4512315 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 45692 1622 343 106 0 41195 0
[pid=2041/tid=2042] ppid=2039 vsize=182768 CPUtime=0.1 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 374 0 0 0 10 0 0 0 25 0 4 0 669634125 187154432 1622 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=182768 CPUtime=0.1 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 396 0 0 0 10 0 0 0 25 0 4 0 669634125 187154432 1622 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=182768 CPUtime=0.1 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 564 0 0 0 10 0 0 0 25 0 4 0 669634125 187154432 1622 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 182768

[startup+0.200535 s]
/proc/loadavg: 8.18 8.09 8.03 5/401 2041
/proc/meminfo: memFree=12344148/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=249668 CPUtime=0.77 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 3051 0 0 0 77 0 0 0 25 0 4 0 669634125 255660032 2283 33554432000 4194304 4625164 140737265790768 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 62417 2283 343 106 0 57920 0
[pid=2041/tid=2042] ppid=2039 vsize=249668 CPUtime=0.19 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 588 0 0 0 19 0 0 0 25 0 4 0 669634125 255660032 2283 33554432000 4194304 4625164 140737265790768 18446744073709551615 4295458 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=249668 CPUtime=0.18 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 600 0 0 0 18 0 0 0 25 0 4 0 669634125 255660032 2283 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=249668 CPUtime=0.19 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 932 0 0 0 19 0 0 0 25 0 4 0 669634125 255660032 2283 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 249668

[startup+0.300516 s]
/proc/loadavg: 8.18 8.09 8.03 5/401 2041
/proc/meminfo: memFree=12344148/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=251104 CPUtime=1.16 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 4006 0 0 0 116 0 0 0 25 0 4 0 669634125 257130496 2886 33554432000 4194304 4625164 140737265790768 18446744073709551615 4338090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 62776 2886 343 106 0 58279 0
[pid=2041/tid=2042] ppid=2039 vsize=251104 CPUtime=0.29 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 696 0 0 0 29 0 0 0 25 0 4 0 669634125 257130496 2886 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=251104 CPUtime=0.28 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 954 0 0 0 28 0 0 0 25 0 4 0 669634125 257130496 2886 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=251104 CPUtime=0.29 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1195 0 0 0 29 0 0 0 25 0 4 0 669634125 257130496 2886 33554432000 4194304 4625164 140737265790768 18446744073709551615 4339874 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 251104

[startup+0.700441 s]
/proc/loadavg: 8.18 8.09 8.03 5/401 2041
/proc/meminfo: memFree=12344148/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=255364 CPUtime=2.76 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 7181 0 0 0 276 0 0 0 25 0 4 0 669634125 261492736 4861 33554432000 4194304 4625164 140737265790768 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 63841 4861 343 106 0 59344 0
[pid=2041/tid=2042] ppid=2039 vsize=255364 CPUtime=0.69 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1590 0 0 0 69 0 0 0 25 0 4 0 669634125 261492736 4861 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=255364 CPUtime=0.68 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1661 0 0 0 68 0 0 0 25 0 4 0 669634125 261492736 4861 33554432000 4194304 4625164 140737265790768 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=255364 CPUtime=0.69 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 2298 0 0 0 69 0 0 0 25 0 4 0 669634125 261492736 4861 33554432000 4194304 4625164 140737265790768 18446744073709551615 208096216091 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 255364

[startup+1.50029 s]
/proc/loadavg: 8.18 8.09 8.03 9/405 2045
/proc/meminfo: memFree=12318708/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=260536 CPUtime=5.95 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 14522 0 0 0 593 2 0 0 25 0 4 0 669634125 266788864 7961 33554432000 4194304 4625164 140737265790768 18446744073709551615 4356324 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 65134 7961 344 106 0 60637 0
[pid=2041/tid=2042] ppid=2039 vsize=260536 CPUtime=1.48 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 2804 0 0 0 148 0 0 0 25 0 4 0 669634125 266788864 7961 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=260536 CPUtime=1.46 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 3651 0 0 0 146 0 0 0 25 0 4 0 669634125 266788864 7961 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=260536 CPUtime=1.48 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 5639 0 0 0 148 0 0 0 25 0 4 0 669634125 266788864 7961 33554432000 4194304 4625164 140737265790768 18446744073709551615 208079929491 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 260536

[startup+3.10098 s]
/proc/loadavg: 8.16 8.09 8.03 9/405 2045
/proc/meminfo: memFree=12303456/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=265276 CPUtime=12.34 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 26010 0 0 0 1230 4 0 0 25 0 4 0 669634125 271642624 11872 33554432000 4194304 4625164 140737265790768 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 66319 11872 362 106 0 61822 0
[pid=2041/tid=2042] ppid=2039 vsize=265276 CPUtime=3.09 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 4116 0 0 0 308 1 0 0 25 0 4 0 669634125 271642624 11872 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=265276 CPUtime=3.05 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 5767 0 0 0 305 0 0 0 25 0 4 0 669634125 271642624 11872 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=265276 CPUtime=3.08 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 12673 0 0 0 307 1 0 0 25 0 4 0 669634125 271642624 11872 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 265276

[startup+6.30038 s]
/proc/loadavg: 8.16 8.09 8.03 9/405 2045
/proc/meminfo: memFree=12275792/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=276684 CPUtime=25.1 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 40683 0 0 0 2503 7 0 0 25 0 4 0 669634125 283324416 17606 33554432000 4194304 4625164 140737265790768 18446744073709551615 4337998 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 69171 17606 346 106 0 64674 0
[pid=2041/tid=2042] ppid=2039 vsize=276684 CPUtime=6.28 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 6298 0 0 0 627 1 0 0 25 0 4 0 669634125 283324416 17606 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=276684 CPUtime=6.21 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 8999 0 0 0 620 1 0 0 25 0 4 0 669634125 283324416 17606 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=276684 CPUtime=6.29 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 20498 0 0 0 626 3 0 0 25 0 4 0 669634125 283324416 17606 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 276684

[startup+12.7012 s]
/proc/loadavg: 8.14 8.09 8.03 9/405 2045
/proc/meminfo: memFree=12210700/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=307292 CPUtime=50.61 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 91024 0 0 0 5046 15 0 0 25 0 4 0 669634125 314667008 27163 33554432000 4194304 4625164 140737265790768 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 76823 27163 516 106 0 72326 0
[pid=2041/tid=2042] ppid=2039 vsize=307292 CPUtime=12.69 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 12423 0 0 0 1266 3 0 0 25 0 4 0 669634125 314667008 27163 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=307292 CPUtime=12.53 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 13200 0 0 0 1250 3 0 0 25 0 4 0 669634125 314667008 27163 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=307292 CPUtime=12.69 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 56410 0 0 0 1261 8 0 0 25 0 4 0 669634125 314667008 27163 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.61
Current children cumulated vsize (KiB) 307292

[startup+25.5007 s]
/proc/loadavg: 8.12 8.08 8.03 9/405 2045
/proc/meminfo: memFree=12150560/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=332672 CPUtime=101.64 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 127516 0 0 0 10141 23 0 0 25 0 4 0 669634125 340656128 39893 33554432000 4194304 4625164 140737265790768 18446744073709551615 4511926 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 83168 39893 676 106 0 78671 0
[pid=2041/tid=2042] ppid=2039 vsize=332672 CPUtime=25.49 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 19300 0 0 0 2545 4 0 0 25 0 4 0 669634125 340656128 39893 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=332672 CPUtime=25.16 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 21199 0 0 0 2509 7 0 0 25 0 4 0 669634125 340656128 39893 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=332672 CPUtime=25.49 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 74765 0 0 0 2539 10 0 0 25 0 4 0 669634125 340656128 39893 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.64
Current children cumulated vsize (KiB) 332672

[startup+51.1008 s]
/proc/loadavg: 8.14 8.09 8.03 9/405 2046
/proc/meminfo: memFree=12065968/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=372248 CPUtime=203.73 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 156609 0 0 0 20337 36 0 0 25 0 4 0 669634125 381181952 58208 33554432000 4194304 4625164 140737265790768 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 93062 58208 671 106 0 88565 0
[pid=2041/tid=2042] ppid=2039 vsize=372248 CPUtime=51.08 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 29411 0 0 0 5100 8 0 0 25 0 4 0 669634125 381181952 58208 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=372248 CPUtime=50.44 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 32336 0 0 0 5030 14 0 0 25 0 4 0 669634125 381181952 58208 33554432000 4194304 4625164 140737265790768 18446744073709551615 4462936 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=372248 CPUtime=51.09 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 75242 0 0 0 5099 10 0 0 25 0 4 0 669634125 381181952 58208 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.73
Current children cumulated vsize (KiB) 372248

[startup+102.301 s]
/proc/loadavg: 8.16 8.10 8.04 9/405 2047
/proc/meminfo: memFree=11887988/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=483672 CPUtime=407.89 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 394921 0 0 0 40707 82 0 0 25 0 4 0 669634125 495280128 79873 33554432000 4194304 4625164 140737265790768 18446744073709551615 4329225 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 120918 79874 385 106 0 116421 0
[pid=2041/tid=2042] ppid=2039 vsize=483672 CPUtime=102.3 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 44864 0 0 0 10216 14 0 0 25 0 4 0 669634125 495280128 80074 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=483672 CPUtime=100.98 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 47299 0 0 0 10078 20 0 0 25 0 4 0 669634125 495280128 80074 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=483672 CPUtime=102.3 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 255391 0 0 0 10192 38 0 0 25 0 4 0 669634125 495280128 80074 33554432000 4194304 4625164 140737265790768 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.89
Current children cumulated vsize (KiB) 483672

[startup+162.301 s]

################
# More data... #
################

[pid=2041] ppid=2039 vsize=1053404 CPUtime=2560.96 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 1651284 0 0 0 255767 329 0 0 25 0 4 0 669634125 1078685696 206139 33554432000 4194304 4625164 140737265790768 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 263351 206139 402 106 0 258854 0
[pid=2041/tid=2042] ppid=2039 vsize=1053404 CPUtime=642.31 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 113088 0 0 0 64199 32 0 0 25 0 4 0 669634125 1078685696 206139 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1053404 CPUtime=634.02 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 115038 0 0 0 63343 59 0 0 25 0 4 0 669634125 1078685696 206139 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1053404 CPUtime=642.3 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1085476 0 0 0 64057 173 0 0 25 0 4 0 669634125 1078685696 206139 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2560.96
Current children cumulated vsize (KiB) 1053404

[startup+702.301 s]
/proc/loadavg: 8.21 8.14 8.07 9/405 2063
/proc/meminfo: memFree=10893364/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1110420 CPUtime=2800.2 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 1700483 0 0 0 279678 342 0 0 25 0 4 0 669634125 1137070080 217710 33554432000 4194304 4625164 140737265790768 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 277605 217710 348 106 0 273108 0
[pid=2041/tid=2042] ppid=2039 vsize=1110420 CPUtime=702.31 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 118116 0 0 0 70197 34 0 0 25 0 4 0 669634125 1137070080 217710 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1110420 CPUtime=693.23 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 144545 0 0 0 69258 65 0 0 25 0 4 0 669634125 1137070080 217710 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1110420 CPUtime=702.31 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1089037 0 0 0 70057 174 0 0 25 0 4 0 669634125 1137070080 217710 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2800.2
Current children cumulated vsize (KiB) 1110420

[startup+762.3 s]
/proc/loadavg: 8.13 8.12 8.07 9/405 2065
/proc/meminfo: memFree=10810852/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1243812 CPUtime=3039.43 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 1861529 0 0 0 303572 371 0 0 25 0 4 0 669634125 1273663488 234892 33554432000 4194304 4625164 140737265790768 18446744073709551615 4329225 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 310953 234892 403 106 0 306456 0
[pid=2041/tid=2042] ppid=2039 vsize=1243812 CPUtime=762.32 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 154682 0 0 0 76194 38 0 0 25 0 4 0 669634125 1273663488 234880 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1243812 CPUtime=752.45 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 147693 0 0 0 75177 68 0 0 25 0 4 0 669634125 1273663488 234880 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1243812 CPUtime=762.32 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1135595 0 0 0 76052 180 0 0 25 0 4 0 669634125 1273663488 234880 33554432000 4194304 4625164 140737265790768 18446744073709551615 4579367 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3039.43
Current children cumulated vsize (KiB) 1243812

[startup+822.301 s]
/proc/loadavg: 8.28 8.16 8.09 9/405 2067
/proc/meminfo: memFree=10730320/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1300792 CPUtime=3278.65 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 1981067 0 0 0 327468 397 0 0 25 0 4 0 669634125 1332011008 249334 33554432000 4194304 4625164 140737265790768 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 325198 249334 403 106 0 320701 0
[pid=2041/tid=2042] ppid=2039 vsize=1300792 CPUtime=822.32 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 157972 0 0 0 82192 40 0 0 25 0 4 0 669634125 1332011008 249334 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1300792 CPUtime=811.67 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 157694 0 0 0 81095 72 0 0 25 0 4 0 669634125 1332011008 249334 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1300792 CPUtime=822.32 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1135924 0 0 0 82051 181 0 0 25 0 4 0 669634125 1332011008 249334 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3278.65
Current children cumulated vsize (KiB) 1300792

[startup+882.316 s]
/proc/loadavg: 8.22 8.16 8.09 9/405 2068
/proc/meminfo: memFree=10629952/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1384528 CPUtime=3517.93 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2011549 0 0 0 351386 407 0 0 25 0 4 0 669634125 1417756672 264487 33554432000 4194304 4625164 140737265790768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 346132 264487 403 106 0 341635 0
[pid=2041/tid=2042] ppid=2039 vsize=1384528 CPUtime=882.34 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 166169 0 0 0 88192 42 0 0 25 0 4 0 669634125 1417756672 264487 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1384528 CPUtime=870.9 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 161050 0 0 0 87013 77 0 0 25 0 4 0 669634125 1417756672 264487 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1384528 CPUtime=882.33 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1136433 0 0 0 88052 181 0 0 25 0 4 0 669634125 1417756672 264487 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3517.93
Current children cumulated vsize (KiB) 1384528

[startup+942.301 s]
/proc/loadavg: 8.25 8.17 8.10 9/405 2070
/proc/meminfo: memFree=10582532/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1384528 CPUtime=3757.12 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2016271 0 0 0 375302 410 0 0 25 0 4 0 669634125 1417756672 269197 33554432000 4194304 4625164 140737265790768 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 346132 269197 403 106 0 341635 0
[pid=2041/tid=2042] ppid=2039 vsize=1384528 CPUtime=942.32 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 167827 0 0 0 94190 42 0 0 25 0 4 0 669634125 1417756672 269197 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1384528 CPUtime=930.13 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 163728 0 0 0 92933 80 0 0 25 0 4 0 669634125 1417756672 269197 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1384528 CPUtime=942.31 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1136751 0 0 0 94050 181 0 0 25 0 4 0 669634125 1417756672 269197 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3757.12
Current children cumulated vsize (KiB) 1384528

[startup+1002.3 s]
/proc/loadavg: 8.28 8.19 8.10 9/405 2071
/proc/meminfo: memFree=10535608/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1384528 CPUtime=3996.34 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2019414 0 0 0 399221 413 0 0 25 0 4 0 669634125 1417756672 272325 33554432000 4194304 4625164 140737265790768 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 346132 272325 403 106 0 341635 0
[pid=2041/tid=2042] ppid=2039 vsize=1384528 CPUtime=1002.32 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 168079 0 0 0 100190 42 0 0 25 0 4 0 669634125 1417756672 272325 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1384528 CPUtime=989.34 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 166012 0 0 0 98852 82 0 0 25 0 4 0 669634125 1417756672 272325 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1384528 CPUtime=1002.32 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1137100 0 0 0 100050 182 0 0 25 0 4 0 669634125 1417756672 272325 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3996.34
Current children cumulated vsize (KiB) 1384528

[startup+1062.3 s]
/proc/loadavg: 8.20 8.18 8.10 9/405 2073
/proc/meminfo: memFree=10438456/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1385848 CPUtime=4235.58 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2023821 0 0 0 423141 417 0 0 25 0 4 0 669634125 1419108352 276712 33554432000 4194304 4625164 140737265790768 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 346462 276712 403 106 0 341965 0
[pid=2041/tid=2042] ppid=2039 vsize=1385848 CPUtime=1062.32 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 168805 0 0 0 106190 42 0 0 25 0 4 0 669634125 1419108352 276712 33554432000 4194304 4625164 140737265790768 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1385848 CPUtime=1048.58 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 168292 0 0 0 104773 85 0 0 25 0 4 0 669634125 1419108352 276712 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1385848 CPUtime=1062.32 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1137168 0 0 0 106050 182 0 0 25 0 4 0 669634125 1419108352 276712 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4235.58
Current children cumulated vsize (KiB) 1385848

[startup+1122.3 s]
/proc/loadavg: 5.85 7.54 7.89 5/396 2092
/proc/meminfo: memFree=11498364/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1458248 CPUtime=4474.82 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2029045 0 0 0 447057 425 0 0 25 0 4 0 669634125 1493245952 281912 33554432000 4194304 4625164 140737265790768 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 364562 281912 403 106 0 360065 0
[pid=2041/tid=2042] ppid=2039 vsize=1458248 CPUtime=1122.33 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 170765 0 0 0 112189 44 0 0 25 0 4 0 669634125 1493245952 281912 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1458248 CPUtime=1107.81 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 171008 0 0 0 110690 91 0 0 25 0 4 0 669634125 1493245952 281912 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1458248 CPUtime=1122.32 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1137392 0 0 0 112050 182 0 0 25 0 4 0 669634125 1493245952 281912 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552357 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4474.82
Current children cumulated vsize (KiB) 1458248

[startup+1182.3 s]
/proc/loadavg: 4.72 6.91 7.65 5/396 2093
/proc/meminfo: memFree=11459144/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1465640 CPUtime=4714.07 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2038791 0 0 0 470972 435 0 0 25 0 4 0 669634125 1500815360 291627 33554432000 4194304 4625164 140737265790768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 366410 291627 403 106 0 361913 0
[pid=2041/tid=2042] ppid=2039 vsize=1465640 CPUtime=1182.33 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 176441 0 0 0 118187 46 0 0 25 0 4 0 669634125 1500815360 291627 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1465640 CPUtime=1167.05 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 174069 0 0 0 116605 100 0 0 25 0 4 0 669634125 1500815360 291627 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1465640 CPUtime=1182.32 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1137641 0 0 0 118050 182 0 0 25 0 4 0 669634125 1500815360 291627 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4714.07
Current children cumulated vsize (KiB) 1465640



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.9 s]
/proc/loadavg: 4.58 6.74 7.57 5/396 2094
/proc/meminfo: memFree=11450548/32950928 swapFree=57376972/67111528
[pid=2041] ppid=2039 vsize=1467884 CPUtime=4800.2 cores=0,2,4,6
/proc/2041/stat : 2041 (SArTagnan) R 2039 2041 1658 0 -1 4202496 2041654 0 0 0 479582 438 0 0 25 0 4 0 669634125 1503113216 293700 33554432000 4194304 4625164 140737265790768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2041/statm: 366971 293700 403 106 0 362474 0
[pid=2041/tid=2042] ppid=2039 vsize=1467884 CPUtime=1203.95 cores=0,2,4,6
/proc/2041/task/2042/stat : 2042 (SArTagnan) R 2039 2041 1658 0 -1 4202560 177241 0 0 0 120349 46 0 0 25 0 4 0 669634125 1503113216 293701 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2041/tid=2043] ppid=2039 vsize=1467884 CPUtime=1188.38 cores=0,2,4,6
/proc/2041/task/2043/stat : 2043 (SArTagnan) R 2039 2041 1658 0 -1 4202560 174785 0 0 0 118735 103 0 0 25 0 4 0 669634125 1503113216 293701 33554432000 4194304 4625164 140737265790768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2041/tid=2044] ppid=2039 vsize=1467884 CPUtime=1203.94 cores=0,2,4,6
/proc/2041/task/2044/stat : 2044 (SArTagnan) R 2039 2041 1658 0 -1 4202560 1137730 0 0 0 120212 182 0 0 25 0 4 0 669634125 1503113216 293701 33554432000 4194304 4625164 140737265790768 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 1467884

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.97
CPU time (s): 4800.32
CPU user time (s): 4795.88
CPU system time (s): 4.44132
CPU usage (%): 398.706
Max. virtual memory (cumulated for all children) (KiB): 1467884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.88
system time used= 4.44132
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2041655
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 555
involuntary context switches= 32285

runsolver used 4.37134 second user time and 11.2003 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-16 23:12:25
IDJOB=3386121
IDBENCH=83140
IDSOLVER=1871
FILE ID=node127/3386121-1305580345
RUNJOBID= node127-1305577123-1676
PBS_JOBID= 13350216
Free space on /tmp= 73384 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n180-s33098896-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386121-1305580345/watcher-3386121-1305580345 -o /tmp/evaluation-result-3386121-1305580345/solver-3386121-1305580345 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386121-1305580345.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1221fb51c407dee7559369d7c6eedb4e
RANDOM SEED=1779027494

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12344428 kB
Buffers:         82292 kB
Cached:         470912 kB
SwapCached:     117904 kB
Active:        5834988 kB
Inactive:     14551220 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12344428 kB
SwapTotal:    67111528 kB
SwapFree:     57376972 kB
Dirty:             416 kB
Writeback:           0 kB
AnonPages:    19721392 kB
Mapped:          27020 kB
Slab:            72116 kB
PageTables:      81288 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 84974980 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73384 MiB
End job on node127 at 2011-05-16 23:32:31