Trace number 3439421

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.9 5010.32

General information on the benchmark

NameSAT04/handmade/connamacher/connm-d0.02/
connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf
MD5SUM7bb85ebdeae46262f72a4c54d4e16683
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2315.09
Satisfiable
(Un)Satisfiability was proved
Number of variables772
Number of clauses9601
Sum of the clauses size28996
Maximum clause length4
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 39408
Number of clauses of size 4193
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439421-1306962248/watcher-3439421-1306962248 -o /tmp/evaluation-result-3439421-1306962248/solver-3439421-1306962248 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439421-1306962248.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 8.02 6.62 1/467 14963
/proc/meminfo: memFree=20619000/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=94716 CPUtime=0 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 1569 0 0 0 0 0 0 0 25 0 8 0 807824509 96989184 1456 33554432000 4194304 4625164 140735776018528 18446744073709551615 274474023921 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 23679 1456 301 106 0 19182 0
[pid=14963/tid=14964] ppid=14961 vsize=294364 CPUtime=0 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 130 0 0 0 0 0 0 0 25 0 8 0 807824510 301428736 1923 33554432000 4194304 4625164 140735776018528 18446744073709551615 4486986 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=294364 CPUtime=0 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 136 0 0 0 0 0 0 0 25 0 8 0 807824510 301428736 1923 33554432000 4194304 4625164 140735776018528 18446744073709551615 4334473 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=294364 CPUtime=0 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 84 0 0 0 0 0 0 0 25 0 8 0 807824510 301428736 1923 33554432000 4194304 4625164 140735776018528 18446744073709551615 274474072558 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=294364 CPUtime=0 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 129 0 0 0 0 0 0 0 25 0 8 0 807824510 301428736 1923 33554432000 4194304 4625164 140735776018528 18446744073709551615 4467301 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=294364 CPUtime=0 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 144 0 0 0 0 0 0 0 25 0 8 0 807824510 301428736 1923 33554432000 4194304 4625164 140735776018528 18446744073709551615 47915733158438 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=294364 CPUtime=0 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 129 0 0 0 0 0 0 0 25 0 8 0 807824510 301428736 1923 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=294364 CPUtime=0 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 120 0 0 0 0 0 0 0 25 0 8 0 807824510 301428736 1924 33554432000 4194304 4625164 140735776018528 18446744073709551615 274474010759 0 0 4096 2 0 0 0 -1 6 0 0 0

[startup+0.0219199 s]
/proc/loadavg: 8.04 8.02 6.62 1/467 14963
/proc/meminfo: memFree=20619000/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=294512 CPUtime=0.07 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 2662 0 0 0 7 0 0 0 25 0 8 0 807824509 301580288 1989 33554432000 4194304 4625164 140735776018528 18446744073709551615 4508886 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 73628 1989 345 106 0 69131 0
[pid=14963/tid=14964] ppid=14961 vsize=294512 CPUtime=0.01 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 140 0 0 0 1 0 0 0 25 0 8 0 807824510 301580288 1990 33554432000 4194304 4625164 140735776018528 18446744073709551615 4465125 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=294512 CPUtime=0 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 149 0 0 0 0 0 0 0 25 0 8 0 807824510 301580288 1990 33554432000 4194304 4625164 140735776018528 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=294512 CPUtime=0 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 84 0 0 0 0 0 0 0 25 0 8 0 807824510 301580288 1990 33554432000 4194304 4625164 140735776018528 18446744073709551615 274474072558 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=294512 CPUtime=0 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 135 0 0 0 0 0 0 0 25 0 8 0 807824510 301580288 1990 33554432000 4194304 4625164 140735776018528 18446744073709551615 4339549 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=294512 CPUtime=0 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 155 0 0 0 0 0 0 0 25 0 8 0 807824510 301580288 1990 33554432000 4194304 4625164 140735776018528 18446744073709551615 4349325 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=294512 CPUtime=0.01 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 139 0 0 0 1 0 0 0 25 0 8 0 807824510 301580288 1991 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=294512 CPUtime=0 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 130 0 0 0 0 0 0 0 25 0 8 0 807824510 301580288 1991 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352585 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 294512

[startup+0.115575 s]
/proc/loadavg: 8.04 8.02 6.62 1/467 14963
/proc/meminfo: memFree=20619000/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=362880 CPUtime=0.79 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 4447 0 0 0 79 0 0 0 25 0 8 0 807824509 371589120 2918 33554432000 4194304 4625164 140735776018528 18446744073709551615 274473664720 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 90720 2942 353 106 0 86223 0
[pid=14963/tid=14964] ppid=14961 vsize=362880 CPUtime=0.1 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 333 0 0 0 10 0 0 0 25 0 8 0 807824510 371589120 2953 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352843 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=362880 CPUtime=0.1 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 315 0 0 0 10 0 0 0 25 0 8 0 807824510 371589120 2968 33554432000 4194304 4625164 140735776018528 18446744073709551615 4288602 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=362880 CPUtime=0.08 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 649 0 0 0 8 0 0 0 25 0 8 0 807824510 371589120 2979 33554432000 4194304 4625164 140735776018528 18446744073709551615 274473628705 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=362880 CPUtime=0.09 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 324 0 0 0 9 0 0 0 25 0 8 0 807824510 371589120 2991 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352831 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=362880 CPUtime=0.09 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 340 0 0 0 9 0 0 0 25 0 8 0 807824510 371589120 3003 33554432000 4194304 4625164 140735776018528 18446744073709551615 4349320 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=362880 CPUtime=0.1 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 307 0 0 0 10 0 0 0 25 0 8 0 807824510 371589120 3003 33554432000 4194304 4625164 140735776018528 18446744073709551615 4463524 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=362880 CPUtime=0.09 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 309 0 0 0 9 0 0 0 25 0 8 0 807824510 371589120 3003 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352145 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.79
Current children cumulated vsize (KiB) 362880

[startup+0.300876 s]
/proc/loadavg: 8.04 8.02 6.62 1/467 14963
/proc/meminfo: memFree=20619000/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=363228 CPUtime=2.28 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 7389 0 0 0 227 1 0 0 25 0 8 0 807824509 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4512128 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 90807 4046 353 106 0 86310 0
[pid=14963/tid=14964] ppid=14961 vsize=363228 CPUtime=0.28 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 645 0 0 0 28 0 0 0 25 0 8 0 807824510 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4375197 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=363228 CPUtime=0.28 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 637 0 0 0 28 0 0 0 25 0 8 0 807824510 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=363228 CPUtime=0.26 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1592 0 0 0 26 0 0 0 25 0 8 0 807824510 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=363228 CPUtime=0.28 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 610 0 0 0 28 0 0 0 25 0 8 0 807824510 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4291744 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=363228 CPUtime=0.28 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 662 0 0 0 28 0 0 0 25 0 8 0 807824510 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=363228 CPUtime=0.28 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 537 0 0 0 28 0 0 0 25 0 8 0 807824510 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=363228 CPUtime=0.28 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 558 0 0 0 28 0 0 0 25 0 8 0 807824510 371945472 4046 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.28
Current children cumulated vsize (KiB) 363228

[startup+0.700806 s]
/proc/loadavg: 8.04 8.02 6.62 1/467 14963
/proc/meminfo: memFree=20619000/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=366624 CPUtime=5.47 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 11531 0 0 0 546 1 0 0 25 0 8 0 807824509 375422976 5843 33554432000 4194304 4625164 140735776018528 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 91656 5843 353 106 0 87159 0
[pid=14963/tid=14964] ppid=14961 vsize=366624 CPUtime=0.68 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1029 0 0 0 68 0 0 0 25 0 8 0 807824510 375422976 5843 33554432000 4194304 4625164 140735776018528 18446744073709551615 4339549 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=366624 CPUtime=0.68 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 737 0 0 0 68 0 0 0 25 0 8 0 807824510 375422976 5843 33554432000 4194304 4625164 140735776018528 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=366624 CPUtime=0.66 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 3611 0 0 0 66 0 0 0 25 0 8 0 807824510 375422976 5843 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=366624 CPUtime=0.68 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 687 0 0 0 68 0 0 0 25 0 8 0 807824510 375422976 5843 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=366624 CPUtime=0.68 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1027 0 0 0 68 0 0 0 25 0 8 0 807824510 375422976 5843 33554432000 4194304 4625164 140735776018528 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=366624 CPUtime=0.68 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 949 0 0 0 68 0 0 0 25 0 8 0 807824510 375422976 5844 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=366624 CPUtime=0.68 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 933 0 0 0 68 0 0 0 25 0 8 0 807824510 375422976 5844 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.47
Current children cumulated vsize (KiB) 366624

[startup+1.50066 s]
/proc/loadavg: 8.04 8.02 6.62 9/474 14971
/proc/meminfo: memFree=20590308/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=372008 CPUtime=11.85 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 19179 0 0 0 1183 2 0 0 25 0 8 0 807824509 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 93002 8997 353 106 0 88505 0
[pid=14963/tid=14964] ppid=14961 vsize=372008 CPUtime=1.48 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1693 0 0 0 148 0 0 0 25 0 8 0 807824510 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=372008 CPUtime=1.48 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1141 0 0 0 148 0 0 0 25 0 8 0 807824510 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=372008 CPUtime=1.43 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 7502 0 0 0 143 0 0 0 25 0 8 0 807824510 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4492112 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=372008 CPUtime=1.48 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1111 0 0 0 148 0 0 0 25 0 8 0 807824510 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352760 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=372008 CPUtime=1.48 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1568 0 0 0 148 0 0 0 25 0 8 0 807824510 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=372008 CPUtime=1.48 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1487 0 0 0 148 0 0 0 25 0 8 0 807824510 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=372008 CPUtime=1.48 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1473 0 0 0 148 0 0 0 25 0 8 0 807824510 380936192 8997 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352786 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.85
Current children cumulated vsize (KiB) 372008

[startup+3.10038 s]
/proc/loadavg: 8.04 8.02 6.62 9/474 14971
/proc/meminfo: memFree=20576360/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=381208 CPUtime=24.64 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 30856 0 0 0 2459 5 0 0 25 0 8 0 807824509 390356992 13541 33554432000 4194304 4625164 140735776018528 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 95302 13541 353 106 0 90805 0
[pid=14963/tid=14964] ppid=14961 vsize=381208 CPUtime=3.08 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 2532 0 0 0 308 0 0 0 25 0 8 0 807824510 390356992 13541 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=381208 CPUtime=3.08 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1918 0 0 0 308 0 0 0 25 0 8 0 807824510 390356992 13541 33554432000 4194304 4625164 140735776018528 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=381208 CPUtime=3.02 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 13974 0 0 0 300 2 0 0 25 0 8 0 807824510 390356992 13541 33554432000 4194304 4625164 140735776018528 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=381208 CPUtime=3.08 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1862 0 0 0 308 0 0 0 25 0 8 0 807824510 390356992 13541 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=381208 CPUtime=3.08 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 2534 0 0 0 308 0 0 0 25 0 8 0 807824510 390356992 13541 33554432000 4194304 4625164 140735776018528 18446744073709551615 4348817 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=381208 CPUtime=3.08 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 2396 0 0 0 308 0 0 0 25 0 8 0 807824510 390356992 13541 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=381208 CPUtime=3.08 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 1862 0 0 0 308 0 0 0 25 0 8 0 807824510 390356992 13542 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352603 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.64
Current children cumulated vsize (KiB) 381208

[startup+6.30082 s]
/proc/loadavg: 8.03 8.02 6.63 9/474 14971
/proc/meminfo: memFree=20545856/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=394056 CPUtime=50.19 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 58266 0 0 0 5010 9 0 0 25 0 8 0 807824509 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 4511982 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 98514 19760 353 106 0 94017 0
[pid=14963/tid=14964] ppid=14961 vsize=394056 CPUtime=6.28 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 4100 0 0 0 628 0 0 0 25 0 8 0 807824510 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=394056 CPUtime=6.28 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 3795 0 0 0 628 0 0 0 25 0 8 0 807824510 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=394056 CPUtime=6.18 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 33520 0 0 0 612 6 0 0 25 0 8 0 807824510 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 274473626472 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=394056 CPUtime=6.28 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 2830 0 0 0 628 0 0 0 25 0 8 0 807824510 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=394056 CPUtime=6.28 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 2807 0 0 0 628 0 0 0 25 0 8 0 807824510 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 4349768 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=394056 CPUtime=6.27 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 3637 0 0 0 627 0 0 0 25 0 8 0 807824510 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=394056 CPUtime=6.28 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 2704 0 0 0 628 0 0 0 25 0 8 0 807824510 403513344 19760 33554432000 4194304 4625164 140735776018528 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 6 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 4280856

[startup+4722.32 s]
/proc/loadavg: 8.11 8.07 8.00 9/474 15109
/proc/meminfo: memFree=17168692/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=4280856 CPUtime=37702.8 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 17196458 0 0 0 3767209 3071 0 0 25 0 8 0 807824509 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14963/statm: 1070214 861904 496 106 0 1065717 0
[pid=14963/tid=14964] ppid=14961 vsize=4280856 CPUtime=4722.34 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 97865 0 0 0 472191 43 0 0 25 0 8 0 807824510 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=4280856 CPUtime=4722.35 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 244794 0 0 0 472173 62 0 0 25 0 8 0 807824510 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=4280856 CPUtime=4648.27 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 15353209 0 0 0 462192 2635 0 0 25 0 8 0 807824510 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=4280856 CPUtime=4722.37 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 154590 0 0 0 472199 38 0 0 25 0 8 0 807824510 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=4280856 CPUtime=4721.75 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 66785 0 0 0 472135 40 0 0 25 0 8 0 807824510 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=4280856 CPUtime=4722.26 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 255533 0 0 0 472168 58 0 0 25 0 8 0 807824510 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=4280856 CPUtime=4721.15 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 90556 0 0 0 472088 27 0 0 25 0 8 0 807824510 4383596544 861904 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37702.8
Current children cumulated vsize (KiB) 4280856

[startup+4782.3 s]
/proc/loadavg: 8.11 8.07 8.00 9/474 15111
/proc/meminfo: memFree=17011180/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=4582388 CPUtime=38181.7 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 17526394 0 0 0 3815043 3123 0 0 25 0 8 0 807824509 4692365312 900082 33554432000 4194304 4625164 140735776018528 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14963/statm: 1145597 900082 421 106 0 1141100 0
[pid=14963/tid=14964] ppid=14961 vsize=4582388 CPUtime=4782.3 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 98406 0 0 0 478187 43 0 0 25 0 8 0 807824510 4692365312 900082 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=4582388 CPUtime=4782.33 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 245921 0 0 0 478170 63 0 0 25 0 8 0 807824510 4692365312 900082 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=4582388 CPUtime=4708.12 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 15528556 0 0 0 468146 2666 0 0 25 0 8 0 807824510 4692365312 900082 33554432000 4194304 4625164 140735776018528 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=4582388 CPUtime=4781.55 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 156145 0 0 0 478116 39 0 0 25 0 8 0 807824510 4692365312 900082 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=4582388 CPUtime=4781.73 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 67041 0 0 0 478133 40 0 0 25 0 8 0 807824510 4692365312 900082 33554432000 4194304 4625164 140735776018528 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=4582388 CPUtime=4782.24 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 256093 0 0 0 478166 58 0 0 25 0 8 0 807824510 4692365312 900083 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=4582388 CPUtime=4781.11 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 91658 0 0 0 478083 28 0 0 25 0 8 0 807824510 4692365312 900083 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38181.7
Current children cumulated vsize (KiB) 4582388

[startup+4842.3 s]
/proc/loadavg: 8.10 8.07 8.00 9/474 15112
/proc/meminfo: memFree=17001228/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=4582388 CPUtime=38660.7 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 17764160 0 0 0 3862911 3161 0 0 25 0 8 0 807824509 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14963/statm: 1145597 903164 418 106 0 1141100 0
[pid=14963/tid=14964] ppid=14961 vsize=4582388 CPUtime=4842.3 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 98857 0 0 0 484187 43 0 0 25 0 8 0 807824510 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=4582388 CPUtime=4842.33 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 246001 0 0 0 484170 63 0 0 25 0 8 0 807824510 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351790 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=4582388 CPUtime=4768.13 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 15764496 0 0 0 474110 2703 0 0 25 0 8 0 807824510 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=4582388 CPUtime=4840.61 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 156163 0 0 0 484022 39 0 0 25 0 8 0 807824510 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=4582388 CPUtime=4841.73 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 67166 0 0 0 484133 40 0 0 25 0 8 0 807824510 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4348817 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=4582388 CPUtime=4842.23 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 256284 0 0 0 484165 58 0 0 25 0 8 0 807824510 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=4582388 CPUtime=4841.09 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 92132 0 0 0 484081 28 0 0 25 0 8 0 807824510 4692365312 903164 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38660.7
Current children cumulated vsize (KiB) 4582388

[startup+4902.3 s]
/proc/loadavg: 8.16 8.08 8.01 9/474 15114
/proc/meminfo: memFree=16958292/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=4615160 CPUtime=39139.8 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 17987358 0 0 0 3910780 3198 0 0 25 0 8 0 807824509 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14963/statm: 1153790 914833 442 106 0 1149293 0
[pid=14963/tid=14964] ppid=14961 vsize=4615160 CPUtime=4902.29 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 98869 0 0 0 490186 43 0 0 25 0 8 0 807824510 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=4615160 CPUtime=4902.33 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 246048 0 0 0 490170 63 0 0 25 0 8 0 807824510 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=4615160 CPUtime=4828.12 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 15977566 0 0 0 480075 2737 0 0 25 0 8 0 807824510 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=4615160 CPUtime=4899.69 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 156352 0 0 0 489930 39 0 0 25 0 8 0 807824510 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=4615160 CPUtime=4901.73 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 67182 0 0 0 490133 40 0 0 25 0 8 0 807824510 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=4615160 CPUtime=4902.22 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 256284 0 0 0 490164 58 0 0 25 0 8 0 807824510 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=4615160 CPUtime=4901.08 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 92194 0 0 0 490080 28 0 0 25 0 8 0 807824510 4725923840 914833 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39139.8
Current children cumulated vsize (KiB) 4615160

[startup+4962.3 s]
/proc/loadavg: 8.11 8.08 8.01 9/474 15115
/proc/meminfo: memFree=16931716/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=4663976 CPUtime=39618.8 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 18252101 0 0 0 3958643 3239 0 0 25 0 8 0 807824509 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4360329 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14963/statm: 1165994 920839 417 106 0 1161497 0
[pid=14963/tid=14964] ppid=14961 vsize=4663976 CPUtime=4962.3 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 98876 0 0 0 496187 43 0 0 25 0 8 0 807824510 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=4663976 CPUtime=4962.34 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 246090 0 0 0 496171 63 0 0 25 0 8 0 807824510 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=4663976 CPUtime=4888.13 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 16212336 0 0 0 486038 2775 0 0 25 0 8 0 807824510 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=4663976 CPUtime=4958.75 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 156793 0 0 0 495836 39 0 0 25 0 8 0 807824510 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=4663976 CPUtime=4961.73 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 67265 0 0 0 496133 40 0 0 25 0 8 0 807824510 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4348832 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=4663976 CPUtime=4962.22 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 256284 0 0 0 496164 58 0 0 25 0 8 0 807824510 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=4663976 CPUtime=4961.07 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 117691 0 0 0 496076 31 0 0 25 0 8 0 807824510 4775911424 920839 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39618.8
Current children cumulated vsize (KiB) 4663976



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.1 s]
/proc/loadavg: 8.12 8.09 8.01 9/474 15117
/proc/meminfo: memFree=16916060/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=4663976 CPUtime=40000.6 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) R 14961 14963 14702 0 -1 4202496 18447509 0 0 0 3996784 3271 0 0 25 0 8 0 807824509 4775911424 924955 33554432000 4194304 4625164 140735776018528 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14963/statm: 1165994 924955 428 106 0 1161497 0
[pid=14963/tid=14964] ppid=14961 vsize=4663976 CPUtime=5010.11 cores=0-7
/proc/14963/task/14964/stat : 14964 (SArTagnan) R 14961 14963 14702 0 -1 4202560 98876 0 0 0 500968 43 0 0 25 0 8 0 807824510 4775911424 924957 33554432000 4194304 4625164 140735776018528 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14963/tid=14965] ppid=14961 vsize=4663976 CPUtime=5010.15 cores=0-7
/proc/14963/task/14965/stat : 14965 (SArTagnan) R 14961 14963 14702 0 -1 4202560 246093 0 0 0 500952 63 0 0 25 0 8 0 807824510 4775911424 924957 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=14963/tid=14966] ppid=14961 vsize=4663976 CPUtime=4935.95 cores=0-7
/proc/14963/task/14966/stat : 14966 (SArTagnan) R 14961 14963 14702 0 -1 4202560 16403239 0 0 0 490788 2807 0 0 25 0 8 0 807824510 4775911424 924957 33554432000 4194304 4625164 140735776018528 18446744073709551615 4334731 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=4663976 CPUtime=5005.82 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4202560 156904 0 0 0 500542 40 0 0 25 0 8 0 807824510 4775911424 924957 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14963/tid=14968] ppid=14961 vsize=4663976 CPUtime=5009.55 cores=0-7
/proc/14963/task/14968/stat : 14968 (SArTagnan) R 14961 14963 14702 0 -1 4202560 67266 0 0 0 500915 40 0 0 25 0 8 0 807824510 4775911424 924957 33554432000 4194304 4625164 140735776018528 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14963/tid=14969] ppid=14961 vsize=4663976 CPUtime=5010.04 cores=0-7
/proc/14963/task/14969/stat : 14969 (SArTagnan) R 14961 14963 14702 0 -1 4202560 256284 0 0 0 500946 58 0 0 25 0 8 0 807824510 4775911424 924957 33554432000 4194304 4625164 140735776018528 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14963/tid=14970] ppid=14961 vsize=4663976 CPUtime=5008.87 cores=0-7
/proc/14963/task/14970/stat : 14970 (SArTagnan) R 14961 14963 14702 0 -1 4202560 117693 0 0 0 500856 31 0 0 25 0 8 0 807824510 4775911424 924957 33554432000 4194304 4625164 140735776018528 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 4663976

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.22 s]
/proc/loadavg: 8.12 8.09 8.01 9/474 15117
/proc/meminfo: memFree=16916060/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=0 CPUtime=40000.7 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) Z 14961 14963 14702 0 -1 4203548 18447511 0 0 0 3996793 3281 0 0 25 0 2 0 807824509 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14963/statm: 0 0 0 0 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=0 CPUtime=5005.93 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4203588 156904 0 0 0 500543 50 0 0 25 0 2 0 807824510 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

[startup+5010.3 s]
/proc/loadavg: 8.12 8.09 8.01 9/474 15117
/proc/meminfo: memFree=16916060/32950928 swapFree=61858088/67111528
[pid=14963] ppid=14961 vsize=0 CPUtime=40000.8 cores=0-7
/proc/14963/stat : 14963 (SArTagnan) Z 14961 14963 14702 0 -1 4203548 18447511 0 0 0 3996793 3289 0 0 25 0 2 0 807824509 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14963/statm: 0 0 0 0 0 0 0
[pid=14963/tid=14967] ppid=14961 vsize=0 CPUtime=5006 cores=0-7
/proc/14963/task/14967/stat : 14967 (SArTagnan) R 14961 14963 14702 0 -1 4203588 156904 0 0 0 500543 57 0 0 25 0 2 0 807824510 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.32
CPU time (s): 40000.9
CPU user time (s): 39967.9
CPU system time (s): 32.914
CPU usage (%): 798.369
Max. virtual memory (cumulated for all children) (KiB): 5040116

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39967.9
system time used= 32.914
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18447511
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9477
involuntary context switches= 177833

runsolver used 21.3268 second user time and 57.2563 second system time

The end

Launcher Data 

Begin job on node125 at 2011-06-01 23:04:08
IDJOB=3439421
IDBENCH=84608
IDSOLVER=1936
FILE ID=node125/3439421-1306962248
RUNJOBID= node125-1306960628-14720
PBS_JOBID= 13497628
Free space on /tmp= 73724 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT04/handmade/connamacher/connm-d0.02/connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439421-1306962248/watcher-3439421-1306962248 -o /tmp/evaluation-result-3439421-1306962248/solver-3439421-1306962248 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439421-1306962248.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7bb85ebdeae46262f72a4c54d4e16683
RANDOM SEED=1889307661

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20619016 kB
Buffers:        302980 kB
Cached:        3322584 kB
SwapCached:       3584 kB
Active:        8658376 kB
Inactive:      3335824 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20619016 kB
SwapTotal:    67111528 kB
SwapFree:     61858088 kB
Dirty:            1928 kB
Writeback:           0 kB
AnonPages:     8366660 kB
Mapped:          33516 kB
Slab:           202172 kB
PageTables:      61628 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 129999688 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73724 MiB
End job on node125 at 2011-06-02 00:27:41