Trace number 3439651

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001.2 5010.33

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/c6288.shuffled.cnf
MD5SUM75bd8319132b47c2d2e6f0889735a248
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.774881
Satisfiable
(Un)Satisfiability was proved
Number of variables5008
Number of clauses14813
Sum of the clauses size34485
Maximum clause length33
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 29982
Number of clauses of size 34829
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439651-1306965643/watcher-3439651-1306965643 -o /tmp/evaluation-result-3439651-1306965643/solver-3439651-1306965643 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439651-1306965643.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 8.06 8.00 1/462 28400
/proc/meminfo: memFree=24564300/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=96980 CPUtime=0.01 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 1818 0 0 0 1 0 0 0 25 0 8 0 886794753 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000684 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 24245 1724 304 106 0 19748 0
[pid=28400/tid=28401] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000684 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000680 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000684 0 0 4096 2 0 0 0 -1 2 0 0 0

[startup+0.026121 s]
/proc/loadavg: 8.06 8.06 8.00 1/462 28400
/proc/meminfo: memFree=24564300/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=96980 CPUtime=0.08 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 1818 0 0 0 8 0 0 0 25 0 8 0 886794753 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 24245 1724 304 106 0 19748 0
[pid=28400/tid=28401] ppid=28398 vsize=96980 CPUtime=0.01 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=96980 CPUtime=0.01 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000680 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=96980 CPUtime=0.01 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000690 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=96980 CPUtime=0 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886794754 99307520 1724 33554432000 4194304 4625164 140737128263136 18446744073709551615 46986420000680 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 96980

[startup+0.141709 s]
/proc/loadavg: 8.06 8.06 8.00 1/462 28400
/proc/meminfo: memFree=24564300/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=514844 CPUtime=6.33 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 18588 0 0 0 631 2 0 0 25 0 8 0 886794753 527200256 9145 33554432000 4194304 4625164 140737128263136 18446744073709551615 252458170911 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 128711 9146 353 106 0 124214 0
[pid=28400/tid=28401] ppid=28398 vsize=514844 CPUtime=0.79 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1817 0 0 0 79 0 0 0 25 0 8 0 886794754 527200256 9146 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=514844 CPUtime=0.76 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1316 0 0 0 76 0 0 0 25 0 8 0 886794754 527200256 9168 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=514844 CPUtime=0.78 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2824 0 0 0 78 0 0 0 25 0 8 0 886794754 527200256 9180 33554432000 4194304 4625164 140737128263136 18446744073709551615 252458170911 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=514844 CPUtime=0.79 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1904 0 0 0 79 0 0 0 18 0 8 0 886794754 527200256 9181 33554432000 4194304 4625164 140737128263136 18446744073709551615 252458170911 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=514844 CPUtime=0.8 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1855 0 0 0 80 0 0 0 19 0 8 0 886794754 527200256 9173 33554432000 4194304 4625164 140737128263136 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=514844 CPUtime=0.81 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1900 0 0 0 81 0 0 0 25 0 8 0 886794754 527200256 9173 33554432000 4194304 4625164 140737128263136 18446744073709551615 4288883 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=514844 CPUtime=0.8 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1663 0 0 0 80 0 0 0 25 0 8 0 886794754 527200256 9173 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.33
Current children cumulated vsize (KiB) 514844

[startup+0.926923 s]
/proc/loadavg: 8.06 8.06 8.00 1/462 28400
/proc/meminfo: memFree=24564300/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=514844 CPUtime=7.26 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 19170 0 0 0 724 2 0 0 25 0 8 0 886794753 527200256 9356 33554432000 4194304 4625164 140737128263136 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 128711 9356 353 106 0 124214 0
[pid=28400/tid=28401] ppid=28398 vsize=514844 CPUtime=0.91 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1825 0 0 0 91 0 0 0 25 0 8 0 886794754 527200256 9357 33554432000 4194304 4625164 140737128263136 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=514844 CPUtime=0.88 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1347 0 0 0 88 0 0 0 25 0 8 0 886794754 527200256 9357 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=514844 CPUtime=0.9 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 3294 0 0 0 89 1 0 0 25 0 8 0 886794754 527200256 9357 33554432000 4194304 4625164 140737128263136 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=514844 CPUtime=0.91 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1904 0 0 0 91 0 0 0 18 0 8 0 886794754 527200256 9357 33554432000 4194304 4625164 140737128263136 18446744073709551615 4278669 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=514844 CPUtime=0.9 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1858 0 0 0 90 0 0 0 19 0 8 0 886794754 527200256 9357 33554432000 4194304 4625164 140737128263136 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=514844 CPUtime=0.91 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1902 0 0 0 91 0 0 0 25 0 8 0 886794754 527200256 9357 33554432000 4194304 4625164 140737128263136 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=514844 CPUtime=0.9 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1668 0 0 0 90 0 0 0 25 0 8 0 886794754 527200256 9364 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.26
Current children cumulated vsize (KiB) 514844

[startup+1.0269 s]
/proc/loadavg: 8.06 8.06 8.00 1/462 28400
/proc/meminfo: memFree=24564300/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=515572 CPUtime=8.07 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 20188 0 0 0 804 3 0 0 25 0 8 0 886794753 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 128893 9497 353 106 0 124396 0
[pid=28400/tid=28401] ppid=28398 vsize=515572 CPUtime=1.01 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1831 0 0 0 101 0 0 0 25 0 8 0 886794754 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=515572 CPUtime=0.98 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1356 0 0 0 98 0 0 0 25 0 8 0 886794754 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=515572 CPUtime=1 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 3897 0 0 0 99 1 0 0 25 0 8 0 886794754 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=515572 CPUtime=1.01 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1906 0 0 0 101 0 0 0 18 0 8 0 886794754 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=515572 CPUtime=1 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1864 0 0 0 100 0 0 0 19 0 8 0 886794754 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=515572 CPUtime=1.01 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1905 0 0 0 101 0 0 0 25 0 8 0 886794754 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 252474049563 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=515572 CPUtime=1 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1678 0 0 0 100 0 0 0 25 0 8 0 886794754 527945728 9497 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 8.07
Current children cumulated vsize (KiB) 515572

[startup+1.50082 s]
/proc/loadavg: 8.06 8.06 8.00 1/462 28400
/proc/meminfo: memFree=24564300/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=516296 CPUtime=11.86 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 22724 0 0 0 1183 3 0 0 25 0 8 0 886794753 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 129074 10107 353 106 0 124577 0
[pid=28400/tid=28401] ppid=28398 vsize=516296 CPUtime=1.48 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1855 0 0 0 148 0 0 0 25 0 8 0 886794754 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=516296 CPUtime=1.45 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1789 0 0 0 145 0 0 0 25 0 8 0 886794754 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=516296 CPUtime=1.47 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 5798 0 0 0 146 1 0 0 25 0 8 0 886794754 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=516296 CPUtime=1.48 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1921 0 0 0 148 0 0 0 18 0 8 0 886794754 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4352582 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=516296 CPUtime=1.47 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1899 0 0 0 147 0 0 0 19 0 8 0 886794754 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=516296 CPUtime=1.48 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1923 0 0 0 148 0 0 0 25 0 8 0 886794754 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=516296 CPUtime=1.48 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1735 0 0 0 148 0 0 0 25 0 8 0 886794754 528687104 10107 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.86
Current children cumulated vsize (KiB) 516296

[startup+3.10052 s]
/proc/loadavg: 8.21 8.09 8.01 9/470 28410
/proc/meminfo: memFree=24514396/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=519920 CPUtime=24.62 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 30864 0 0 0 2456 6 0 0 25 0 8 0 886794753 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4509011 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 129980 12886 353 106 0 125483 0
[pid=28400/tid=28401] ppid=28398 vsize=519920 CPUtime=3.08 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2023 0 0 0 308 0 0 0 25 0 8 0 886794754 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4288697 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=519920 CPUtime=3.05 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1954 0 0 0 305 0 0 0 25 0 8 0 886794754 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4352855 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=519920 CPUtime=3.08 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 12246 0 0 0 305 3 0 0 25 0 8 0 886794754 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=519920 CPUtime=3.08 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2064 0 0 0 308 0 0 0 21 0 8 0 886794754 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=519920 CPUtime=3.03 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2128 0 0 0 303 0 0 0 25 0 8 0 886794754 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4349779 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=519920 CPUtime=3.08 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2133 0 0 0 308 0 0 0 25 0 8 0 886794754 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4464333 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=519920 CPUtime=3.07 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 1860 0 0 0 307 0 0 0 25 0 8 0 886794754 532398080 12886 33554432000 4194304 4625164 140737128263136 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.62
Current children cumulated vsize (KiB) 519920

[startup+6.30093 s]
/proc/loadavg: 8.20 8.09 8.01 9/470 28410
/proc/meminfo: memFree=24491828/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=529948 CPUtime=50.17 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 50507 0 0 0 5008 9 0 0 25 0 8 0 886794753 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 132487 18733 353 106 0 127990 0
[pid=28400/tid=28401] ppid=28398 vsize=529948 CPUtime=6.28 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2915 0 0 0 628 0 0 0 25 0 8 0 886794754 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=529948 CPUtime=6.25 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2840 0 0 0 625 0 0 0 25 0 8 0 886794754 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=529948 CPUtime=6.28 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 26270 0 0 0 623 5 0 0 25 0 8 0 886794754 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4327632 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=529948 CPUtime=6.28 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2852 0 0 0 628 0 0 0 25 0 8 0 886794754 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=529948 CPUtime=6.18 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 3067 0 0 0 618 0 0 0 25 0 8 0 886794754 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4348854 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=529948 CPUtime=6.28 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 3058 0 0 0 628 0 0 0 25 0 8 0 886794754 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4352183 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=529948 CPUtime=6.27 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 2796 0 0 0 627 0 0 0 22 0 8 0 886794754 542666752 18733 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 7079156

[startup+4722.3 s]
/proc/loadavg: 8.12 8.07 8.01 9/470 28563
/proc/meminfo: memFree=18504380/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=7150868 CPUtime=37703.6 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 15281453 0 0 0 3767223 3135 0 0 25 0 8 0 886794753 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 1787717 1511489 354 106 0 1783220 0
[pid=28400/tid=28401] ppid=28398 vsize=7150868 CPUtime=4722.36 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 211259 0 0 0 472146 90 0 0 25 0 8 0 886794754 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=7150868 CPUtime=4721.52 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 219321 0 0 0 472016 136 0 0 25 0 8 0 886794754 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=7150868 CPUtime=4722.15 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 13124008 0 0 0 469893 2322 0 0 25 0 8 0 886794754 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4547283 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=7150868 CPUtime=4722.35 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 216151 0 0 0 472126 109 0 0 25 0 8 0 886794754 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=7150868 CPUtime=4649.22 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 277706 0 0 0 464802 120 0 0 25 0 8 0 886794754 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=7150868 CPUtime=4722.33 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 532586 0 0 0 472086 147 0 0 25 0 8 0 886794754 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=7150868 CPUtime=4722.38 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 222169 0 0 0 472117 121 0 0 25 0 8 0 886794754 7322488832 1511489 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37703.6
Current children cumulated vsize (KiB) 7150868

[startup+4782.3 s]
/proc/loadavg: 8.09 8.07 8.01 9/470 28565
/proc/meminfo: memFree=18473972/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=7150868 CPUtime=38182.8 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 15460963 0 0 0 3815103 3172 0 0 25 0 8 0 886794753 7322488832 1519585 33554432000 4194304 4625164 140737128263136 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 1787717 1519585 354 106 0 1783220 0
[pid=28400/tid=28401] ppid=28398 vsize=7150868 CPUtime=4782.37 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 211262 0 0 0 478147 90 0 0 25 0 8 0 886794754 7322488832 1519587 33554432000 4194304 4625164 140737128263136 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=7150868 CPUtime=4781.54 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 219344 0 0 0 478018 136 0 0 25 0 8 0 886794754 7322488832 1519587 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=7150868 CPUtime=4782.17 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 13300128 0 0 0 475859 2358 0 0 25 0 8 0 886794754 7322488832 1519587 33554432000 4194304 4625164 140737128263136 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=7150868 CPUtime=4782.37 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 216180 0 0 0 478128 109 0 0 25 0 8 0 886794754 7322488832 1519587 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=7150868 CPUtime=4708.29 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 277797 0 0 0 470709 120 0 0 25 0 8 0 886794754 7322488832 1519587 33554432000 4194304 4625164 140737128263136 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=7150868 CPUtime=4782.35 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 535250 0 0 0 478087 148 0 0 25 0 8 0 886794754 7322488832 1519587 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=7150868 CPUtime=4782.4 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 222178 0 0 0 478119 121 0 0 25 0 8 0 886794754 7322488832 1519587 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38182.8
Current children cumulated vsize (KiB) 7150868

[startup+4842.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/470 28566
/proc/meminfo: memFree=18442940/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=7150868 CPUtime=38661.7 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 15651695 0 0 0 3862958 3214 0 0 25 0 8 0 886794753 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 1787717 1527305 363 106 0 1783220 0
[pid=28400/tid=28401] ppid=28398 vsize=7150868 CPUtime=4842.36 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 211282 0 0 0 484146 90 0 0 25 0 8 0 886794754 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=7150868 CPUtime=4841.52 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 219366 0 0 0 484016 136 0 0 25 0 8 0 886794754 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=7150868 CPUtime=4842.15 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 13488317 0 0 0 481817 2398 0 0 25 0 8 0 886794754 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=7150868 CPUtime=4842.35 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 216214 0 0 0 484126 109 0 0 25 0 8 0 886794754 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=7150868 CPUtime=4767.34 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 277883 0 0 0 476614 120 0 0 25 0 8 0 886794754 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=7150868 CPUtime=4842.34 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 536827 0 0 0 484085 149 0 0 25 0 8 0 886794754 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=7150868 CPUtime=4842.38 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 222212 0 0 0 484117 121 0 0 25 0 8 0 886794754 7322488832 1527305 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38661.7
Current children cumulated vsize (KiB) 7150868

[startup+4902.32 s]
/proc/loadavg: 8.09 8.06 8.01 9/470 28568
/proc/meminfo: memFree=18417864/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=7150868 CPUtime=39140.9 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 15845505 0 0 0 3910834 3256 0 0 25 0 8 0 886794753 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 1787717 1533578 354 106 0 1783220 0
[pid=28400/tid=28401] ppid=28398 vsize=7150868 CPUtime=4902.38 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 211314 0 0 0 490148 90 0 0 25 0 8 0 886794754 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=7150868 CPUtime=4901.54 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 219387 0 0 0 490018 136 0 0 25 0 8 0 886794754 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=7150868 CPUtime=4902.16 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 13680209 0 0 0 487778 2438 0 0 25 0 8 0 886794754 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=7150868 CPUtime=4902.37 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 216249 0 0 0 490128 109 0 0 25 0 8 0 886794754 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=7150868 CPUtime=4826.42 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 277941 0 0 0 482521 121 0 0 25 0 8 0 886794754 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=7150868 CPUtime=4902.35 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 537971 0 0 0 490086 149 0 0 25 0 8 0 886794754 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=7150868 CPUtime=4902.4 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 222246 0 0 0 490119 121 0 0 25 0 8 0 886794754 7322488832 1533578 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39140.9
Current children cumulated vsize (KiB) 7150868

[startup+4962.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/470 28570
/proc/meminfo: memFree=18389688/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=7216404 CPUtime=39619.8 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 16022110 0 0 0 3958688 3294 0 0 25 0 8 0 886794753 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 1804101 1540534 364 106 0 1799604 0
[pid=28400/tid=28401] ppid=28398 vsize=7216404 CPUtime=4962.36 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 211370 0 0 0 496146 90 0 0 25 0 8 0 886794754 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=7216404 CPUtime=4961.53 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 219409 0 0 0 496017 136 0 0 25 0 8 0 886794754 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=7216404 CPUtime=4962.15 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 13855007 0 0 0 493740 2475 0 0 25 0 8 0 886794754 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=7216404 CPUtime=4962.36 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 216280 0 0 0 496127 109 0 0 25 0 8 0 886794754 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330844 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=7216404 CPUtime=4885.47 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 277984 0 0 0 488426 121 0 0 25 0 8 0 886794754 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=7216404 CPUtime=4962.34 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 538668 0 0 0 496083 151 0 0 25 0 8 0 886794754 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=7216404 CPUtime=4962.38 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 222279 0 0 0 496117 121 0 0 25 0 8 0 886794754 7389597696 1540534 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39619.8
Current children cumulated vsize (KiB) 7216404



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010 s]
/proc/loadavg: 8.06 8.05 8.00 10/470 28572
/proc/meminfo: memFree=18375644/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=7216404 CPUtime=40000.9 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) R 28398 28400 28183 0 -1 4202496 16186159 0 0 0 3996763 3326 0 0 25 0 8 0 886794753 7389597696 1544458 33554432000 4194304 4625164 140737128263136 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 1804101 1544459 363 106 0 1799604 0
[pid=28400/tid=28401] ppid=28398 vsize=7216404 CPUtime=5010.1 cores=0-7
/proc/28400/task/28401/stat : 28401 (SArTagnan) R 28398 28400 28183 0 -1 4202560 211402 0 0 0 500920 90 0 0 25 0 8 0 886794754 7389597696 1544468 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28400/tid=28403] ppid=28398 vsize=7216404 CPUtime=5009.26 cores=0-7
/proc/28400/task/28403/stat : 28403 (SArTagnan) R 28398 28400 28183 0 -1 4202560 219426 0 0 0 500790 136 0 0 25 0 8 0 886794754 7389597696 1544468 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28400/tid=28404] ppid=28398 vsize=7216404 CPUtime=5009.88 cores=0-7
/proc/28400/task/28404/stat : 28404 (SArTagnan) R 28398 28400 28183 0 -1 4202560 14018446 0 0 0 498482 2506 0 0 25 0 8 0 886794754 7389597696 1544468 33554432000 4194304 4625164 140737128263136 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28400/tid=28405] ppid=28398 vsize=7216404 CPUtime=5010.09 cores=0-7
/proc/28400/task/28405/stat : 28405 (SArTagnan) R 28398 28400 28183 0 -1 4202560 216305 0 0 0 500900 109 0 0 25 0 8 0 886794754 7389597696 1544468 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=7216404 CPUtime=4932.42 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4202560 278014 0 0 0 493121 121 0 0 25 0 8 0 886794754 7389597696 1544468 33554432000 4194304 4625164 140737128263136 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28400/tid=28408] ppid=28398 vsize=7216404 CPUtime=5010.08 cores=0-7
/proc/28400/task/28408/stat : 28408 (SArTagnan) R 28398 28400 28183 0 -1 4202560 538698 0 0 0 500857 151 0 0 25 0 8 0 886794754 7389597696 1544468 33554432000 4194304 4625164 140737128263136 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28400/tid=28409] ppid=28398 vsize=7216404 CPUtime=5010.12 cores=0-7
/proc/28400/task/28409/stat : 28409 (SArTagnan) R 28398 28400 28183 0 -1 4202560 222305 0 0 0 500891 121 0 0 25 0 8 0 886794754 7389597696 1544468 33554432000 4194304 4625164 140737128263136 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 7216404

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.14 s]
/proc/loadavg: 8.06 8.05 8.00 10/470 28572
/proc/meminfo: memFree=18375644/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=0 CPUtime=40001.1 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) Z 28398 28400 28183 0 -1 4203548 16186177 0 0 0 3996770 3336 0 0 25 0 2 0 886794753 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 0 0 0 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=0 CPUtime=4932.53 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4203588 278014 0 0 0 493122 131 0 0 25 0 2 0 886794754 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 0

[startup+5010.3 s]
/proc/loadavg: 8.06 8.05 8.00 10/470 28572
/proc/meminfo: memFree=18375644/32951124 swapFree=56297244/67111528
[pid=28400] ppid=28398 vsize=0 CPUtime=40001.2 cores=0-7
/proc/28400/stat : 28400 (SArTagnan) Z 28398 28400 28183 0 -1 4203548 16186177 0 0 0 3996770 3352 0 0 25 0 2 0 886794753 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28400/statm: 0 0 0 0 0 0 0
[pid=28400/tid=28407] ppid=28398 vsize=0 CPUtime=4932.69 cores=0-7
/proc/28400/task/28407/stat : 28407 (SArTagnan) R 28398 28400 28183 0 -1 4203588 278014 0 0 0 493122 147 0 0 25 0 2 0 886794754 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40001.2
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.33
CPU time (s): 40001.2
CPU user time (s): 39967.7
CPU system time (s): 33.5409
CPU usage (%): 798.376
Max. virtual memory (cumulated for all children) (KiB): 7216404

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39967.7
system time used= 33.5409
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16186177
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 50237
involuntary context switches= 118202

runsolver used 20.6649 second user time and 57.0453 second system time

The end

Launcher Data 

Begin job on node111 at 2011-06-02 00:00:43
IDJOB=3439651
IDBENCH=87734
IDSOLVER=1936
FILE ID=node111/3439651-1306965643
RUNJOBID= node111-1306960629-28198
PBS_JOBID= 13497642
Free space on /tmp= 73856 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT02/handmade/simon/satex-challenges/c6288.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439651-1306965643/watcher-3439651-1306965643 -o /tmp/evaluation-result-3439651-1306965643/solver-3439651-1306965643 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439651-1306965643.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 75bd8319132b47c2d2e6f0889735a248
RANDOM SEED=538612366

node111.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5428.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24564712 kB
Buffers:        201016 kB
Cached:         524216 kB
SwapCached:      11780 kB
Active:        7596312 kB
Inactive:       522340 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24564712 kB
SwapTotal:    67111528 kB
SwapFree:     56297244 kB
Dirty:             820 kB
Writeback:           0 kB
AnonPages:     7391108 kB
Mapped:          27412 kB
Slab:           130392 kB
PageTables:      66444 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 149063568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73856 MiB
End job on node111 at 2011-06-02 01:24:15