Trace number 3439351

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.5 5010.83

General information on the benchmark

NameSAT03/handmade/stanion/hwb/
hwb-n32-02-S1478512323.shuffled-as.sat03-1638.cnf
MD5SUM1d86c7f9cd05c5f2ab070520d802c8e1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables226
Number of clauses1078
Sum of the clauses size3624
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 226
Number of clauses of size 3636
Number of clauses of size 4416
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439351-1306960630/watcher-3439351-1306960630 -o /tmp/evaluation-result-3439351-1306960630/solver-3439351-1306960630 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439351-1306960630.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 3/481 24629
/proc/meminfo: memFree=21855256/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=90768 CPUtime=0.03 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 576 0 0 0 3 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 22692 512 300 106 0 18195 0
[pid=24629/tid=24630] ppid=24627 vsize=90768 CPUtime=0.01 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=90768 CPUtime=0.01 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=90768 CPUtime=0 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=90768 CPUtime=0 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=90768 CPUtime=0 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=90768 CPUtime=0.01 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=90768 CPUtime=0.01 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.025279 s]
/proc/loadavg: 0.00 0.00 0.00 3/481 24629
/proc/meminfo: memFree=21855256/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=90768 CPUtime=0.11 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 576 0 0 0 11 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 22692 512 300 106 0 18195 0
[pid=24629/tid=24630] ppid=24627 vsize=90768 CPUtime=0.02 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1 0 0 0 2 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518504 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=90768 CPUtime=0.02 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 2 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=90768 CPUtime=0 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=90768 CPUtime=0 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=90768 CPUtime=0 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518504 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=90768 CPUtime=0.01 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518514 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=90768 CPUtime=0.01 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 540254222 92946432 512 33554432000 4194304 4625164 140733204608304 18446744073709551615 47229873518512 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 90768

[startup+0.168997 s]
/proc/loadavg: 0.00 0.00 0.00 3/481 24629
/proc/meminfo: memFree=21855256/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=486984 CPUtime=1.21 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 3096 0 0 0 121 0 0 0 18 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 268660767263 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 121746 2205 353 106 0 117249 0
[pid=24629/tid=24630] ppid=24627 vsize=486984 CPUtime=0.16 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 271 0 0 0 16 0 0 0 25 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 4462583 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=486984 CPUtime=0.16 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 231 0 0 0 16 0 0 0 18 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351878 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=486984 CPUtime=0.11 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 461 0 0 0 11 0 0 0 25 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 268660767214 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=486984 CPUtime=0.14 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 301 0 0 0 14 0 0 0 25 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351860 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=486984 CPUtime=0.14 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 326 0 0 0 14 0 0 0 18 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=486984 CPUtime=0.16 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 348 0 0 0 16 0 0 0 25 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=486984 CPUtime=0.16 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 261 0 0 0 16 0 0 0 25 0 8 0 540254222 498671616 2205 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352855 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 486984

[startup+0.301228 s]
/proc/loadavg: 0.00 0.00 0.00 3/481 24629
/proc/meminfo: memFree=21855256/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=489464 CPUtime=2.28 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 5562 0 0 0 227 1 0 0 18 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 122366 3489 353 106 0 117869 0
[pid=24629/tid=24630] ppid=24627 vsize=489464 CPUtime=0.29 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 574 0 0 0 29 0 0 0 25 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=489464 CPUtime=0.29 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 534 0 0 0 29 0 0 0 18 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=489464 CPUtime=0.24 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1011 0 0 0 24 0 0 0 25 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4579567 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=489464 CPUtime=0.27 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 632 0 0 0 27 0 0 0 25 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352596 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=489464 CPUtime=0.27 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 539 0 0 0 27 0 0 0 18 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348821 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=489464 CPUtime=0.29 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 658 0 0 0 29 0 0 0 25 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=489464 CPUtime=0.29 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 572 0 0 0 29 0 0 0 25 0 8 0 540254222 501211136 3489 33554432000 4194304 4625164 140733204608304 18446744073709551615 4288889 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.28
Current children cumulated vsize (KiB) 489464

[startup+0.701158 s]
/proc/loadavg: 0.00 0.00 0.00 3/481 24629
/proc/meminfo: memFree=21855256/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=493184 CPUtime=5.48 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 11694 0 0 0 546 2 0 0 18 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 123296 6586 353 106 0 118799 0
[pid=24629/tid=24630] ppid=24627 vsize=493184 CPUtime=0.69 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1322 0 0 0 69 0 0 0 25 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=493184 CPUtime=0.69 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1249 0 0 0 69 0 0 0 18 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=493184 CPUtime=0.63 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 2960 0 0 0 63 0 0 0 25 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4579312 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=493184 CPUtime=0.67 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1056 0 0 0 67 0 0 0 25 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=493184 CPUtime=0.67 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 987 0 0 0 67 0 0 0 18 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348832 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=493184 CPUtime=0.69 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1466 0 0 0 69 0 0 0 25 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=493184 CPUtime=0.69 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 1329 0 0 0 69 0 0 0 25 0 8 0 540254222 505020416 6586 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.48
Current children cumulated vsize (KiB) 493184

[startup+1.50102 s]
/proc/loadavg: 0.64 0.13 0.04 9/489 24637
/proc/meminfo: memFree=21820496/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=496524 CPUtime=11.86 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 20881 0 0 0 1182 4 0 0 19 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 124131 12113 376 106 0 119634 0
[pid=24629/tid=24630] ppid=24627 vsize=496524 CPUtime=1.49 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 2154 0 0 0 149 0 0 0 25 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4487851 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=496524 CPUtime=1.48 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 2089 0 0 0 148 0 0 0 19 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=496524 CPUtime=1.41 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 5222 0 0 0 141 0 0 0 25 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=496524 CPUtime=1.47 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 2170 0 0 0 147 0 0 0 25 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352423 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=496524 CPUtime=1.47 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 2072 0 0 0 147 0 0 0 20 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4349320 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=496524 CPUtime=1.48 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 3081 0 0 0 148 0 0 0 25 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4353049 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=496524 CPUtime=1.49 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 2207 0 0 0 149 0 0 0 25 0 8 0 540254222 508440576 12113 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.86
Current children cumulated vsize (KiB) 496524

[startup+3.10074 s]
/proc/loadavg: 0.64 0.13 0.04 9/489 24637
/proc/meminfo: memFree=21794332/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=502680 CPUtime=24.65 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 35457 0 0 0 2459 6 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 125670 19343 405 106 0 121173 0
[pid=24629/tid=24630] ppid=24627 vsize=502680 CPUtime=3.08 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 3232 0 0 0 308 0 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4464722 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=502680 CPUtime=3.08 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 3354 0 0 0 308 0 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=502680 CPUtime=3 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 10356 0 0 0 299 1 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=502680 CPUtime=3.07 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 3522 0 0 0 307 0 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=502680 CPUtime=3.07 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 3099 0 0 0 307 0 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4349768 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=502680 CPUtime=3.08 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 6184 0 0 0 308 0 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=502680 CPUtime=3.09 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 3452 0 0 0 309 0 0 0 25 0 8 0 540254222 514744320 19343 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.65
Current children cumulated vsize (KiB) 502680

[startup+6.30117 s]
/proc/loadavg: 0.64 0.13 0.04 9/489 24637
/proc/meminfo: memFree=21745000/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=534744 CPUtime=50.19 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 58865 0 0 0 5011 8 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 133686 31147 571 106 0 129189 0
[pid=24629/tid=24630] ppid=24627 vsize=534744 CPUtime=6.28 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 4939 0 0 0 628 0 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=534744 CPUtime=6.29 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 4836 0 0 0 628 1 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=534744 CPUtime=6.14 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 20615 0 0 0 612 2 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4548692 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=534744 CPUtime=6.27 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 5426 0 0 0 627 0 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352549 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=534744 CPUtime=6.27 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 5894 0 0 0 627 0 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=534744 CPUtime=6.29 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 9025 0 0 0 628 1 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=534744 CPUtime=6.29 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 4938 0 0 0 629 0 0 0 25 0 8 0 540254222 547577856 31147 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=24629/tid=24632] ppid=24627 vsize=5414856 CPUtime=4651.69 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 15316341 0 0 0 462557 2612 0 0 25 0 8 0 540254222 5544812544 1054119 33554432000 4194304 4625164 140733204608304 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=5414856 CPUtime=4662.36 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 248410 0 0 0 466129 107 0 0 25 0 8 0 540254222 5544812544 1054119 33554432000 4194304 4625164 140733204608304 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=5414856 CPUtime=4649.11 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 302611 0 0 0 464750 161 0 0 25 0 8 0 540254222 5544812544 1054119 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=5414856 CPUtime=4662.39 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 420277 0 0 0 466097 142 0 0 25 0 8 0 540254222 5544812544 1054119 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=5414856 CPUtime=4661.46 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 259346 0 0 0 466005 141 0 0 25 0 8 0 540254222 5544812544 1054119 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37220.3
Current children cumulated vsize (KiB) 5414856

[startup+4722.32 s]
/proc/loadavg: 8.08 8.04 7.96 10/490 24778
/proc/meminfo: memFree=17610988/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=5417100 CPUtime=37699.5 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 17657050 0 0 0 3766330 3618 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 1354275 1058591 437 106 0 1349778 0
[pid=24629/tid=24630] ppid=24627 vsize=5417100 CPUtime=4668.55 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 278421 0 0 0 466674 181 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=5417100 CPUtime=4722.36 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 328827 0 0 0 472063 173 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=5417100 CPUtime=4711.71 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 15511462 0 0 0 468525 2646 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=5417100 CPUtime=4722.38 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 249299 0 0 0 472131 107 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=5417100 CPUtime=4708.13 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 303492 0 0 0 470650 163 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=5417100 CPUtime=4722.4 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 420583 0 0 0 472098 142 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=5417100 CPUtime=4721.46 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 260261 0 0 0 472004 142 0 0 25 0 8 0 540254222 5547110400 1058591 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37699.5
Current children cumulated vsize (KiB) 5417100

[startup+4782.3 s]
/proc/loadavg: 8.32 8.13 8.00 9/489 24779
/proc/meminfo: memFree=17590188/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=5419344 CPUtime=38177.5 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 17887160 0 0 0 3814090 3661 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 1354836 1063775 502 106 0 1350339 0
[pid=24629/tid=24630] ppid=24627 vsize=5419344 CPUtime=4728.54 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 279153 0 0 0 472671 183 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351769 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=5419344 CPUtime=4782.34 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 329536 0 0 0 478059 175 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=5419344 CPUtime=4771.7 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 15736929 0 0 0 474487 2683 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=5419344 CPUtime=4782.36 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 250295 0 0 0 478128 108 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=5419344 CPUtime=4766.31 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 304120 0 0 0 476467 164 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=5419344 CPUtime=4782.38 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 420982 0 0 0 478096 142 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=5419344 CPUtime=4781.42 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 261020 0 0 0 477999 143 0 0 25 0 8 0 540254222 5549408256 1063775 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38177.5
Current children cumulated vsize (KiB) 5419344

[startup+4842.3 s]
/proc/loadavg: 8.17 8.12 8.00 9/489 24781
/proc/meminfo: memFree=17572164/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=5487124 CPUtime=38656.5 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 18092732 0 0 0 3861951 3701 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4519410 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 1371781 1068607 537 106 0 1367284 0
[pid=24629/tid=24630] ppid=24627 vsize=5487124 CPUtime=4788.54 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 279868 0 0 0 478670 184 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=5487124 CPUtime=4842.35 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 330236 0 0 0 484059 176 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=5487124 CPUtime=4831.7 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 15937929 0 0 0 480453 2717 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=5487124 CPUtime=4842.37 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 250999 0 0 0 484128 109 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=5487124 CPUtime=4825.31 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 304730 0 0 0 482366 165 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4289968 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=5487124 CPUtime=4842.39 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 421580 0 0 0 484095 144 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=5487124 CPUtime=4841.41 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 261778 0 0 0 483997 144 0 0 25 0 8 0 540254222 5618814976 1068607 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38656.5
Current children cumulated vsize (KiB) 5487124

[startup+4902.3 s]
/proc/loadavg: 8.11 8.11 8.00 9/489 24782
/proc/meminfo: memFree=17562300/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=5423832 CPUtime=39135.6 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 18306136 0 0 0 3909807 3748 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 1355958 1073862 496 106 0 1351461 0
[pid=24629/tid=24630] ppid=24627 vsize=5423832 CPUtime=4848.54 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 280748 0 0 0 484669 185 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=5423832 CPUtime=4902.34 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 330948 0 0 0 490058 176 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=5423832 CPUtime=4891.7 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 16145744 0 0 0 486413 2757 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=5423832 CPUtime=4902.36 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 251675 0 0 0 490127 109 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=5423832 CPUtime=4884.35 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 305327 0 0 0 488268 167 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4349768 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=5423832 CPUtime=4902.38 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 422445 0 0 0 490093 145 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=5423832 CPUtime=4901.4 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 263423 0 0 0 489994 146 0 0 25 0 8 0 540254222 5554003968 1073862 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39135.6
Current children cumulated vsize (KiB) 5423832

[startup+4962.3 s]
/proc/loadavg: 8.08 8.10 8.00 9/489 24784
/proc/meminfo: memFree=17522548/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=5491744 CPUtime=39614.6 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 18526287 0 0 0 3957663 3792 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 1372936 1081111 568 106 0 1368439 0
[pid=24629/tid=24630] ppid=24627 vsize=5491744 CPUtime=4908.54 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 281530 0 0 0 490668 186 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=5491744 CPUtime=4962.34 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 331681 0 0 0 496056 178 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=5491744 CPUtime=4951.71 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 16359798 0 0 0 492377 2794 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=5491744 CPUtime=4962.36 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 252418 0 0 0 496126 110 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=5491744 CPUtime=4943.36 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 307439 0 0 0 494167 169 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348867 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=5491744 CPUtime=4962.39 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 422854 0 0 0 496093 146 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=5491744 CPUtime=4961.38 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 264248 0 0 0 495991 147 0 0 25 0 8 0 540254222 5623545856 1081111 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39614.6
Current children cumulated vsize (KiB) 5491744



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.6 s]
/proc/loadavg: 8.08 8.10 8.00 9/489 24785
/proc/meminfo: memFree=17508988/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=5493592 CPUtime=40000.2 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) R 24627 24629 24603 0 -1 4202496 18726087 0 0 0 3996194 3829 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 1373398 1084362 569 106 0 1368901 0
[pid=24629/tid=24630] ppid=24627 vsize=5493592 CPUtime=4956.86 cores=0-7
/proc/24629/task/24630/stat : 24630 (SArTagnan) R 24627 24629 24603 0 -1 4202560 282075 0 0 0 495499 187 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24629/tid=24631] ppid=24627 vsize=5493592 CPUtime=5010.66 cores=0-7
/proc/24629/task/24631/stat : 24631 (SArTagnan) R 24627 24629 24603 0 -1 4202560 332283 0 0 0 500886 180 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=24629/tid=24632] ppid=24627 vsize=5493592 CPUtime=5000.02 cores=0-7
/proc/24629/task/24632/stat : 24632 (SArTagnan) R 24627 24629 24603 0 -1 4202560 16556094 0 0 0 497178 2824 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24629/tid=24633] ppid=24627 vsize=5493592 CPUtime=5010.68 cores=0-7
/proc/24629/task/24633/stat : 24633 (SArTagnan) R 24627 24629 24603 0 -1 4202560 253105 0 0 0 500958 110 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=5493592 CPUtime=4990.87 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4202560 307943 0 0 0 498917 170 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=24629/tid=24635] ppid=24627 vsize=5493592 CPUtime=5010.7 cores=0-7
/proc/24629/task/24635/stat : 24635 (SArTagnan) R 24627 24629 24603 0 -1 4202560 423144 0 0 0 500924 146 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24629/tid=24636] ppid=24627 vsize=5493592 CPUtime=5009.67 cores=0-7
/proc/24629/task/24636/stat : 24636 (SArTagnan) R 24627 24629 24603 0 -1 4202560 264810 0 0 0 500820 147 0 0 25 0 8 0 540254222 5625438208 1084362 33554432000 4194304 4625164 140733204608304 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 5493592

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.8 s]
/proc/loadavg: 8.08 8.10 8.00 9/489 24785
/proc/meminfo: memFree=17508988/32951124 swapFree=46575304/67111528
[pid=24629] ppid=24627 vsize=0 CPUtime=40000.5 cores=0-7
/proc/24629/stat : 24629 (SArTagnan) Z 24627 24629 24603 0 -1 4203548 18726087 0 0 0 3996202 3847 0 0 25 0 2 0 540254222 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/24629/statm: 0 0 0 0 0 0 0
[pid=24629/tid=24634] ppid=24627 vsize=0 CPUtime=4991.06 cores=0-7
/proc/24629/task/24634/stat : 24634 (SArTagnan) R 24627 24629 24603 0 -1 4203588 307943 0 0 0 498918 188 0 0 25 0 2 0 540254222 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.83
CPU time (s): 40000.5
CPU user time (s): 39962
CPU system time (s): 38.5011
CPU usage (%): 798.281
Max. virtual memory (cumulated for all children) (KiB): 5493592

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39962
system time used= 38.5011
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18726087
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 20788
involuntary context switches= 164636

runsolver used 22.3356 second user time and 59.6819 second system time

The end

Launcher Data 

Begin job on node107 at 2011-06-01 22:37:10
IDJOB=3439351
IDBENCH=84021
IDSOLVER=1936
FILE ID=node107/3439351-1306960630
RUNJOBID= node107-1306960629-24617
PBS_JOBID= 13497646
Free space on /tmp= 73824 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/stanion/hwb/hwb-n32-02-S1478512323.shuffled-as.sat03-1638.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439351-1306960630/watcher-3439351-1306960630 -o /tmp/evaluation-result-3439351-1306960630/solver-3439351-1306960630 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439351-1306960630.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1d86c7f9cd05c5f2ab070520d802c8e1
RANDOM SEED=481871933

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21855544 kB
Buffers:        247592 kB
Cached:        1805864 kB
SwapCached:      22420 kB
Active:        8968828 kB
Inactive:      1785180 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21855544 kB
SwapTotal:    67111528 kB
SwapFree:     46575304 kB
Dirty:             420 kB
Writeback:           0 kB
AnonPages:     8696108 kB
Mapped:          32064 kB
Slab:           176624 kB
PageTables:      94400 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145078240 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73824 MiB
End job on node107 at 2011-06-02 00:00:42