Trace number 3439656

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.6 5011.38

General information on the benchmark

NameSAT02/handmade/simon/satex-challenges/
par32-3.shuffled.cnf
MD5SUM0115a0e26236f3f01aa829c2004452c1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.638902
Satisfiable
(Un)Satisfiability was proved
Number of variables3176
Number of clauses10297
Sum of the clauses size27581
Maximum clause length3
Minimum clause length1
Number of clauses of size 1141
Number of clauses of size 23028
Number of clauses of size 37128
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439656-1306965643/watcher-3439656-1306965643 -o /tmp/evaluation-result-3439656-1306965643/solver-3439656-1306965643 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439656-1306965643.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.15 8.08 8.01 1/507 25208
/proc/meminfo: memFree=19645856/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=96224 CPUtime=0.03 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 1669 0 0 0 3 0 0 0 23 0 8 0 886795049 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 47526836504498 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 24056 1605 304 106 0 19559 0
[pid=25208/tid=25209] ppid=25206 vsize=96224 CPUtime=0 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 8 0 886795050 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 47526836504502 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=96224 CPUtime=0 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886795050 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 47526836504498 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=96224 CPUtime=0 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886795050 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 215988648945 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=96224 CPUtime=0 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886795050 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 47526836504492 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=96224 CPUtime=0 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886795050 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 47526836504498 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=96224 CPUtime=0 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886795050 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 47526836504498 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=96224 CPUtime=0 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886795050 98533376 1605 33554432000 4194304 4625164 140735566071248 18446744073709551615 47526836504498 0 0 4096 2 0 0 0 -1 5 0 0 0

[startup+0.104691 s]
/proc/loadavg: 8.15 8.08 8.01 1/507 25208
/proc/meminfo: memFree=19645856/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=494968 CPUtime=0.7 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 6258 0 0 0 70 0 0 0 25 0 8 0 886795049 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 4329254 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 123742 4452 352 106 0 119245 0
[pid=25208/tid=25209] ppid=25206 vsize=494968 CPUtime=0.09 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 431 0 0 0 9 0 0 0 25 0 8 0 886795050 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=494968 CPUtime=0.07 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 444 0 0 0 7 0 0 0 25 0 8 0 886795050 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351820 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=494968 CPUtime=0.07 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 644 0 0 0 7 0 0 0 25 0 8 0 886795050 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351849 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=494968 CPUtime=0.08 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 444 0 0 0 8 0 0 0 25 0 8 0 886795050 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 215988250433 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=494968 CPUtime=0.09 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 436 0 0 0 9 0 0 0 25 0 8 0 886795050 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=494968 CPUtime=0.09 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 458 0 0 0 9 0 0 0 25 0 8 0 886795050 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=494968 CPUtime=0.09 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 437 0 0 0 9 0 0 0 25 0 8 0 886795050 506847232 4452 33554432000 4194304 4625164 140735566071248 18446744073709551615 4464984 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 494968

[startup+0.200673 s]
/proc/loadavg: 8.15 8.08 8.01 1/507 25208
/proc/meminfo: memFree=19645856/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=497300 CPUtime=1.46 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 7863 0 0 0 146 0 0 0 25 0 8 0 886795049 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4337104 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 124325 4727 353 106 0 119828 0
[pid=25208/tid=25209] ppid=25206 vsize=497300 CPUtime=0.18 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 620 0 0 0 18 0 0 0 25 0 8 0 886795050 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=497300 CPUtime=0.16 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 612 0 0 0 16 0 0 0 25 0 8 0 886795050 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4465280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=497300 CPUtime=0.17 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1099 0 0 0 17 0 0 0 25 0 8 0 886795050 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4278405 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=497300 CPUtime=0.18 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 634 0 0 0 18 0 0 0 25 0 8 0 886795050 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4288950 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=497300 CPUtime=0.18 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 615 0 0 0 18 0 0 0 25 0 8 0 886795050 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4374271 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=497300 CPUtime=0.18 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 469 0 0 0 18 0 0 0 25 0 8 0 886795050 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4278468 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=497300 CPUtime=0.18 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 646 0 0 0 18 0 0 0 25 0 8 0 886795050 509235200 4727 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 497300

[startup+0.300656 s]
/proc/loadavg: 8.15 8.08 8.01 1/507 25208
/proc/meminfo: memFree=19645856/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=497624 CPUtime=2.27 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 8370 0 0 0 226 1 0 0 25 0 8 0 886795049 509566976 5031 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 124406 5032 353 106 0 119909 0
[pid=25208/tid=25209] ppid=25206 vsize=497624 CPUtime=0.28 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 663 0 0 0 28 0 0 0 25 0 8 0 886795050 509566976 5032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=497624 CPUtime=0.26 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 619 0 0 0 26 0 0 0 25 0 8 0 886795050 509566976 5032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4339680 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=497624 CPUtime=0.27 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1210 0 0 0 27 0 0 0 25 0 8 0 886795050 509566976 5032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=497624 CPUtime=0.28 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 665 0 0 0 28 0 0 0 25 0 8 0 886795050 509566976 5032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4288653 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=497624 CPUtime=0.28 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 637 0 0 0 28 0 0 0 25 0 8 0 886795050 509566976 5032 33554432000 4194304 4625164 140735566071248 18446744073709551615 215988253729 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=497624 CPUtime=0.28 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 652 0 0 0 28 0 0 0 25 0 8 0 886795050 509566976 5033 33554432000 4194304 4625164 140735566071248 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=497624 CPUtime=0.28 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 708 0 0 0 28 0 0 0 25 0 8 0 886795050 509566976 5033 33554432000 4194304 4625164 140735566071248 18446744073709551615 215988253729 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.27
Current children cumulated vsize (KiB) 497624

[startup+0.700587 s]
/proc/loadavg: 8.15 8.08 8.01 1/507 25208
/proc/meminfo: memFree=19645856/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=501436 CPUtime=5.47 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 13089 0 0 0 546 1 0 0 25 0 8 0 886795049 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512081 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 125359 6681 353 106 0 120862 0
[pid=25208/tid=25209] ppid=25206 vsize=501436 CPUtime=0.68 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 742 0 0 0 68 0 0 0 25 0 8 0 886795050 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=501436 CPUtime=0.66 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 990 0 0 0 66 0 0 0 25 0 8 0 886795050 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=501436 CPUtime=0.67 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 3439 0 0 0 67 0 0 0 25 0 8 0 886795050 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=501436 CPUtime=0.68 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1044 0 0 0 68 0 0 0 25 0 8 0 886795050 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=501436 CPUtime=0.68 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1027 0 0 0 68 0 0 0 25 0 8 0 886795050 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4339536 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=501436 CPUtime=0.68 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1016 0 0 0 68 0 0 0 25 0 8 0 886795050 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=501436 CPUtime=0.68 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1112 0 0 0 68 0 0 0 25 0 8 0 886795050 513470464 6681 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.47
Current children cumulated vsize (KiB) 501436

[startup+1.50045 s]
/proc/loadavg: 8.14 8.08 8.01 9/515 25216
/proc/meminfo: memFree=19613076/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=508252 CPUtime=11.84 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 23752 0 0 0 1181 3 0 0 25 0 8 0 886795049 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 127063 10032 353 106 0 122566 0
[pid=25208/tid=25209] ppid=25206 vsize=508252 CPUtime=1.46 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1274 0 0 0 146 0 0 0 25 0 8 0 886795050 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=508252 CPUtime=1.46 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1701 0 0 0 146 0 0 0 25 0 8 0 886795050 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=508252 CPUtime=1.47 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 9254 0 0 0 146 1 0 0 25 0 8 0 886795050 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=508252 CPUtime=1.48 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1789 0 0 0 148 0 0 0 25 0 8 0 886795050 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=508252 CPUtime=1.48 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1837 0 0 0 148 0 0 0 25 0 8 0 886795050 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=508252 CPUtime=1.48 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1844 0 0 0 148 0 0 0 25 0 8 0 886795050 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=508252 CPUtime=1.48 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 1726 0 0 0 148 0 0 0 25 0 8 0 886795050 520450048 10032 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352569 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.84
Current children cumulated vsize (KiB) 508252

[startup+3.10117 s]
/proc/loadavg: 8.14 8.08 8.01 9/515 25216
/proc/meminfo: memFree=19595220/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=519656 CPUtime=24.63 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 41705 0 0 0 2455 8 0 0 25 0 8 0 886795049 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 129914 15386 353 106 0 125417 0
[pid=25208/tid=25209] ppid=25206 vsize=519656 CPUtime=3.04 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 2655 0 0 0 304 0 0 0 25 0 8 0 886795050 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=519656 CPUtime=3.06 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 2886 0 0 0 306 0 0 0 25 0 8 0 886795050 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=519656 CPUtime=3.07 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 19979 0 0 0 303 4 0 0 25 0 8 0 886795050 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=519656 CPUtime=3.07 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 2756 0 0 0 307 0 0 0 25 0 8 0 886795050 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=519656 CPUtime=3.08 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 2857 0 0 0 308 0 0 0 25 0 8 0 886795050 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 215988253729 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=519656 CPUtime=3.08 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 2993 0 0 0 308 0 0 0 25 0 8 0 886795050 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351942 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=519656 CPUtime=3.08 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 2886 0 0 0 308 0 0 0 25 0 8 0 886795050 532127744 15386 33554432000 4194304 4625164 140735566071248 18446744073709551615 4464351 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.63
Current children cumulated vsize (KiB) 519656

[startup+6.30061 s]
/proc/loadavg: 8.14 8.08 8.01 9/515 25216
/proc/meminfo: memFree=19557124/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=534348 CPUtime=50.17 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 73958 0 0 0 5003 14 0 0 25 0 8 0 886795049 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 133587 24526 353 106 0 129090 0
[pid=25208/tid=25209] ppid=25206 vsize=534348 CPUtime=6.18 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 4521 0 0 0 618 0 0 0 25 0 8 0 886795050 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352256 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=534348 CPUtime=6.26 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 4686 0 0 0 626 0 0 0 25 0 8 0 886795050 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4464202 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=534348 CPUtime=6.27 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 40390 0 0 0 620 7 0 0 25 0 8 0 886795050 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=534348 CPUtime=6.27 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 4511 0 0 0 627 0 0 0 25 0 8 0 886795050 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=534348 CPUtime=6.28 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 4634 0 0 0 627 1 0 0 25 0 8 0 886795050 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4349768 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=534348 CPUtime=6.28 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 5049 0 0 0 627 1 0 0 25 0 8 0 886795050 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=534348 CPUtime=6.28 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 4528 0 0 0 628 0 0 0 25 0 8 0 886795050 547172352 24526 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=25208/tid=25211] ppid=25206 vsize=6193808 CPUtime=4662.31 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 14136146 0 0 0 463901 2330 0 0 25 0 8 0 886795050 6342459392 1246332 33554432000 4194304 4625164 140735566071248 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=6193808 CPUtime=4662.34 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 223780 0 0 0 466169 65 0 0 25 0 8 0 886795050 6342459392 1246332 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=6193808 CPUtime=4662.38 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 271532 0 0 0 466174 64 0 0 25 0 8 0 886795050 6342459392 1246332 33554432000 4194304 4625164 140735566071248 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=6193808 CPUtime=4661.65 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 321472 0 0 0 466054 111 0 0 25 0 8 0 886795050 6342459392 1246332 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=6193808 CPUtime=4631.04 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 229604 0 0 0 463029 75 0 0 25 0 8 0 886795050 6342459392 1246332 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37215.8
Current children cumulated vsize (KiB) 6193808

[startup+4722.3 s]
/proc/loadavg: 8.05 8.07 8.01 9/515 25363
/proc/meminfo: memFree=14597932/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=6203248 CPUtime=37694.9 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 16737283 0 0 0 3766508 2982 0 0 25 0 8 0 886795049 6352125952 1259751 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 1550812 1259751 353 106 0 1546315 0
[pid=25208/tid=25209] ppid=25206 vsize=6203248 CPUtime=4672.7 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 174056 0 0 0 467208 62 0 0 25 0 8 0 886795050 6352125952 1259752 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=6203248 CPUtime=4722.25 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 307298 0 0 0 472139 86 0 0 25 0 8 0 886795050 6352125952 1259752 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=6203248 CPUtime=4722.33 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 14138518 0 0 0 469903 2330 0 0 25 0 8 0 886795050 6352125952 1259752 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=6203248 CPUtime=4722.36 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 224330 0 0 0 472171 65 0 0 25 0 8 0 886795050 6352125952 1259752 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=6203248 CPUtime=4722.4 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 271596 0 0 0 472176 64 0 0 25 0 8 0 886795050 6352125952 1259752 33554432000 4194304 4625164 140735566071248 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=6203248 CPUtime=4721.67 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 325521 0 0 0 472055 112 0 0 25 0 8 0 886795050 6352125952 1259752 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=6203248 CPUtime=4690.02 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 234350 0 0 0 468924 78 0 0 25 0 8 0 886795050 6352125952 1259752 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37694.9
Current children cumulated vsize (KiB) 6203248

[startup+4782.3 s]
/proc/loadavg: 8.06 8.06 8.01 10/515 25364
/proc/meminfo: memFree=14563184/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=6212148 CPUtime=38173.7 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 16759810 0 0 0 3814379 2993 0 0 25 0 8 0 886795049 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512846 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 1553037 1268472 353 106 0 1548540 0
[pid=25208/tid=25209] ppid=25206 vsize=6212148 CPUtime=4732.68 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 174589 0 0 0 473205 63 0 0 25 0 8 0 886795050 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=6212148 CPUtime=4782.23 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 307916 0 0 0 478136 87 0 0 25 0 8 0 886795050 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=6212148 CPUtime=4782.31 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 14140745 0 0 0 475900 2331 0 0 25 0 8 0 886795050 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=6212148 CPUtime=4782.34 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 224848 0 0 0 478168 66 0 0 25 0 8 0 886795050 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=6212148 CPUtime=4782.38 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 271662 0 0 0 478174 64 0 0 25 0 8 0 886795050 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=6212148 CPUtime=4781.65 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 326126 0 0 0 478051 114 0 0 25 0 8 0 886795050 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=6212148 CPUtime=4748.96 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 237899 0 0 0 474816 80 0 0 25 0 8 0 886795050 6361239552 1268472 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38173.7
Current children cumulated vsize (KiB) 6212148

[startup+4842.32 s]
/proc/loadavg: 8.02 8.05 8.00 9/515 25366
/proc/meminfo: memFree=14516644/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=6223196 CPUtime=38652.8 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 16785536 0 0 0 3862278 3004 0 0 25 0 8 0 886795049 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 1555799 1280043 353 106 0 1551302 0
[pid=25208/tid=25209] ppid=25206 vsize=6223196 CPUtime=4792.71 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 175122 0 0 0 479207 64 0 0 25 0 8 0 886795050 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=6223196 CPUtime=4842.25 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 308472 0 0 0 484136 89 0 0 25 0 8 0 886795050 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=6223196 CPUtime=4842.33 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 14143464 0 0 0 481901 2332 0 0 25 0 8 0 886795050 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=6223196 CPUtime=4842.36 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 225359 0 0 0 484169 67 0 0 25 0 8 0 886795050 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=6223196 CPUtime=4842.4 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 271739 0 0 0 484176 64 0 0 25 0 8 0 886795050 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=6223196 CPUtime=4841.67 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 330213 0 0 0 484051 116 0 0 25 0 8 0 886795050 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=6223196 CPUtime=4807.93 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 240743 0 0 0 480710 83 0 0 25 0 8 0 886795050 6372552704 1280043 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38652.8
Current children cumulated vsize (KiB) 6223196

[startup+4902.3 s]
/proc/loadavg: 8.04 8.05 8.00 9/515 25368
/proc/meminfo: memFree=14479164/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=6231392 CPUtime=39131.6 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 16807900 0 0 0 3910149 3013 0 0 25 0 8 0 886795049 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 1557848 1289518 353 106 0 1553351 0
[pid=25208/tid=25209] ppid=25206 vsize=6231392 CPUtime=4852.69 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 175747 0 0 0 485204 65 0 0 25 0 8 0 886795050 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=6231392 CPUtime=4902.23 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 309086 0 0 0 490133 90 0 0 25 0 8 0 886795050 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4462461 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=6231392 CPUtime=4902.31 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 14145564 0 0 0 487899 2332 0 0 25 0 8 0 886795050 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4335119 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=6231392 CPUtime=4902.35 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 225855 0 0 0 490167 68 0 0 25 0 8 0 886795050 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=6231392 CPUtime=4902.38 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 271813 0 0 0 490174 64 0 0 25 0 8 0 886795050 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4460386 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=6231392 CPUtime=4901.66 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 330851 0 0 0 490048 118 0 0 25 0 8 0 886795050 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=6231392 CPUtime=4866.88 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 242820 0 0 0 486603 85 0 0 25 0 8 0 886795050 6380945408 1289518 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39131.6
Current children cumulated vsize (KiB) 6231392

[startup+4962.3 s]
/proc/loadavg: 8.12 8.07 8.01 10/515 25369
/proc/meminfo: memFree=14453824/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=6241100 CPUtime=39610.6 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 16826642 0 0 0 3958035 3022 0 0 25 0 8 0 886795049 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 1560275 1295800 353 106 0 1555778 0
[pid=25208/tid=25209] ppid=25206 vsize=6241100 CPUtime=4912.7 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 176472 0 0 0 491203 67 0 0 25 0 8 0 886795050 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=6241100 CPUtime=4962.23 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 309685 0 0 0 496133 90 0 0 25 0 8 0 886795050 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=6241100 CPUtime=4962.32 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 14148044 0 0 0 493899 2333 0 0 25 0 8 0 886795050 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=6241100 CPUtime=4962.35 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 226348 0 0 0 496166 69 0 0 25 0 8 0 886795050 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=6241100 CPUtime=4962.39 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 271879 0 0 0 496175 64 0 0 25 0 8 0 886795050 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=6241100 CPUtime=4961.65 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 331491 0 0 0 496047 118 0 0 25 0 8 0 886795050 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=6241100 CPUtime=4925.83 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 243532 0 0 0 492497 86 0 0 25 0 8 0 886795050 6390886400 1295800 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39610.6
Current children cumulated vsize (KiB) 6241100



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.1 s]
/proc/loadavg: 8.05 8.06 8.00 9/515 25370
/proc/meminfo: memFree=14422788/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=6244460 CPUtime=40000.2 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) R 25206 25208 24998 0 -1 4202496 16904844 0 0 0 3996984 3039 0 0 25 0 8 0 886795049 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 1561115 1303424 365 106 0 1556618 0
[pid=25208/tid=25209] ppid=25206 vsize=6244460 CPUtime=4961.51 cores=0-7
/proc/25208/task/25209/stat : 25209 (SArTagnan) R 25206 25208 24998 0 -1 4202560 176872 0 0 0 496083 68 0 0 25 0 8 0 886795050 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25208/tid=25210] ppid=25206 vsize=6244460 CPUtime=5011.05 cores=0-7
/proc/25208/task/25210/stat : 25210 (SArTagnan) R 25206 25208 24998 0 -1 4202560 310158 0 0 0 501014 91 0 0 25 0 8 0 886795050 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25208/tid=25211] ppid=25206 vsize=6244460 CPUtime=5011.13 cores=0-7
/proc/25208/task/25211/stat : 25211 (SArTagnan) R 25206 25208 24998 0 -1 4202560 14207997 0 0 0 498771 2342 0 0 25 0 8 0 886795050 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4579358 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25208/tid=25212] ppid=25206 vsize=6244460 CPUtime=5011.16 cores=0-7
/proc/25208/task/25212/stat : 25212 (SArTagnan) R 25206 25208 24998 0 -1 4202560 226781 0 0 0 501047 69 0 0 25 0 8 0 886795050 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25208/tid=25213] ppid=25206 vsize=6244460 CPUtime=5011.21 cores=0-7
/proc/25208/task/25213/stat : 25213 (SArTagnan) R 25206 25208 24998 0 -1 4202560 271932 0 0 0 501057 64 0 0 25 0 8 0 886795050 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25208/tid=25214] ppid=25206 vsize=6244460 CPUtime=5010.48 cores=0-7
/proc/25208/task/25214/stat : 25214 (SArTagnan) R 25206 25208 24998 0 -1 4202560 331824 0 0 0 500928 120 0 0 25 0 8 0 886795050 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=6244460 CPUtime=4973.79 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4202560 244314 0 0 0 497292 87 0 0 25 0 8 0 886795050 6394327040 1303424 33554432000 4194304 4625164 140735566071248 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 6244460

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.3 s]
/proc/loadavg: 8.05 8.06 8.00 9/515 25370
/proc/meminfo: memFree=14422788/32950940 swapFree=67111364/67111528
[pid=25208] ppid=25206 vsize=0 CPUtime=40000.5 cores=0-7
/proc/25208/stat : 25208 (SArTagnan) Z 25206 25208 24998 0 -1 4203548 16904845 0 0 0 3996991 3057 0 0 25 0 2 0 886795049 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25208/statm: 0 0 0 0 0 0 0
[pid=25208/tid=25215] ppid=25206 vsize=0 CPUtime=4973.97 cores=0-7
/proc/25208/task/25215/stat : 25215 (SArTagnan) R 25206 25208 24998 0 -1 4203588 244314 0 0 0 497293 104 0 0 25 0 2 0 886795050 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.38
CPU time (s): 40000.6
CPU user time (s): 39969.9
CPU system time (s): 30.6493
CPU usage (%): 798.194
Max. virtual memory (cumulated for all children) (KiB): 6244460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39969.9
system time used= 30.6493
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16904845
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1086
involuntary context switches= 163429

runsolver used 23.0715 second user time and 63.8953 second system time

The end

Launcher Data 

Begin job on node117 at 2011-06-02 00:00:43
IDJOB=3439656
IDBENCH=87739
IDSOLVER=1936
FILE ID=node117/3439656-1306965643
RUNJOBID= node117-1306960629-25012
PBS_JOBID= 13497636
Free space on /tmp= 73596 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT02/handmade/simon/satex-challenges/par32-3.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439656-1306965643/watcher-3439656-1306965643 -o /tmp/evaluation-result-3439656-1306965643/solver-3439656-1306965643 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439656-1306965643.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0115a0e26236f3f01aa829c2004452c1
RANDOM SEED=538612366

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      19646136 kB
Buffers:        321492 kB
Cached:        2818000 kB
SwapCached:          0 kB
Active:       10014016 kB
Inactive:      2910172 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      19646136 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             396 kB
Writeback:           0 kB
AnonPages:     9785428 kB
Mapped:          41584 kB
Slab:           251040 kB
PageTables:      57960 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 149469128 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73596 MiB
End job on node117 at 2011-06-02 01:24:16