Trace number 3439356

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.7 5011.42

General information on the benchmark

NameSAT03/handmade/stanion/hwb/
hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf
MD5SUMbdf2c49c74bfdbd3bd4663dca402d24f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3326.88
Satisfiable
(Un)Satisfiability was proved
Number of variables194
Number of clauses954
Sum of the clauses size3252
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 210
Number of clauses of size 3544
Number of clauses of size 4400
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439356-1306960823/watcher-3439356-1306960823 -o /tmp/evaluation-result-3439356-1306960823/solver-3439356-1306960823 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439356-1306960823.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 6.10 2.93 1/510 26146
/proc/meminfo: memFree=20843188/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=221820 CPUtime=0.06 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 684 0 0 0 6 0 0 0 25 0 8 0 807678970 227143680 614 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500796910 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26146/statm: 55455 614 341 106 0 50958 0
[pid=26146/tid=26147] ppid=26144 vsize=221820 CPUtime=0.01 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 21 0 0 0 1 0 0 0 25 0 8 0 807678971 227143680 614 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500350214 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=221820 CPUtime=0 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 26 0 0 0 0 0 0 0 25 0 8 0 807678971 227143680 615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4375284 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=221820 CPUtime=0 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) S 26144 26146 26075 0 -1 4202560 12 0 0 0 0 0 0 0 18 0 8 0 807678971 227143680 625 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500796910 0 0 4096 2 18446604442743992576 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=221820 CPUtime=0.01 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 28 0 0 0 1 0 0 0 25 0 8 0 807678971 227143680 625 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500389072 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=221820 CPUtime=0 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 38 0 0 0 0 0 0 0 25 0 8 0 807678971 227143680 626 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500352709 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=221820 CPUtime=0 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 3 0 0 0 0 0 0 0 25 0 8 0 807678971 227143680 630 33554432000 4194304 4625164 140735048657024 18446744073709551615 4462351 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=221820 CPUtime=0 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) S 26144 26146 26075 0 -1 4202560 3 0 0 0 0 0 0 0 25 0 8 0 807678971 227143680 637 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500796910 0 0 4096 2 18446604442743992576 0 0 -1 0 0 0 0

[startup+0.125875 s]
/proc/loadavg: 8.04 6.10 2.93 1/510 26146
/proc/meminfo: memFree=20843188/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=359884 CPUtime=3.1 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 7257 0 0 0 309 1 0 0 18 0 8 0 807678970 368521216 4798 33554432000 4194304 4625164 140735048657024 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 89971 4798 352 106 0 85474 0
[pid=26146/tid=26147] ppid=26144 vsize=359884 CPUtime=0.4 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 836 0 0 0 40 0 0 0 25 0 8 0 807678971 368521216 4798 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339541 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=359884 CPUtime=0.38 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 835 0 0 0 38 0 0 0 18 0 8 0 807678971 368521216 4799 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352310 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=359884 CPUtime=0.38 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1536 0 0 0 38 0 0 0 18 0 8 0 807678971 368521216 4799 33554432000 4194304 4625164 140735048657024 18446744073709551615 254516675611 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=359884 CPUtime=0.39 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 667 0 0 0 39 0 0 0 25 0 8 0 807678971 368521216 4799 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=359884 CPUtime=0.38 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 863 0 0 0 38 0 0 0 25 0 8 0 807678971 368521216 4799 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500796959 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=359884 CPUtime=0.39 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 805 0 0 0 39 0 0 0 25 0 8 0 807678971 368521216 4799 33554432000 4194304 4625164 140735048657024 18446744073709551615 254516675611 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=359884 CPUtime=0.34 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 604 0 0 0 34 0 0 0 25 0 8 0 807678971 368521216 4799 33554432000 4194304 4625164 140735048657024 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 359884

[startup+0.479952 s]
/proc/loadavg: 8.04 6.10 2.93 1/510 26146
/proc/meminfo: memFree=20843188/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=361536 CPUtime=3.69 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 8537 0 0 0 368 1 0 0 18 0 8 0 807678970 370212864 5391 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512017 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 90384 5391 352 106 0 85887 0
[pid=26146/tid=26147] ppid=26144 vsize=361536 CPUtime=0.47 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 856 0 0 0 47 0 0 0 25 0 8 0 807678971 370212864 5391 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=361536 CPUtime=0.46 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 875 0 0 0 46 0 0 0 18 0 8 0 807678971 370212864 5391 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339559 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=361536 CPUtime=0.46 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1896 0 0 0 46 0 0 0 18 0 8 0 807678971 370212864 5391 33554432000 4194304 4625164 140735048657024 18446744073709551615 4579356 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=361536 CPUtime=0.47 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 880 0 0 0 47 0 0 0 25 0 8 0 807678971 370212864 5391 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352112 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=361536 CPUtime=0.45 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 886 0 0 0 45 0 0 0 25 0 8 0 807678971 370212864 5392 33554432000 4194304 4625164 140735048657024 18446744073709551615 4349072 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=361536 CPUtime=0.46 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1115 0 0 0 46 0 0 0 25 0 8 0 807678971 370212864 5392 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=361536 CPUtime=0.42 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 825 0 0 0 42 0 0 0 25 0 8 0 807678971 370212864 5392 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.69
Current children cumulated vsize (KiB) 361536

[startup+0.500945 s]
/proc/loadavg: 8.04 6.10 2.93 1/510 26146
/proc/meminfo: memFree=20843188/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=361536 CPUtime=3.86 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 8639 0 0 0 385 1 0 0 18 0 8 0 807678970 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512794 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 90384 5493 352 106 0 85887 0
[pid=26146/tid=26147] ppid=26144 vsize=361536 CPUtime=0.49 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 873 0 0 0 49 0 0 0 25 0 8 0 807678971 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4464800 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=361536 CPUtime=0.48 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 885 0 0 0 48 0 0 0 18 0 8 0 807678971 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4466122 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=361536 CPUtime=0.48 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1940 0 0 0 48 0 0 0 18 0 8 0 807678971 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=361536 CPUtime=0.49 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 887 0 0 0 49 0 0 0 25 0 8 0 807678971 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=361536 CPUtime=0.47 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 888 0 0 0 47 0 0 0 25 0 8 0 807678971 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=361536 CPUtime=0.48 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1123 0 0 0 48 0 0 0 25 0 8 0 807678971 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=361536 CPUtime=0.44 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 836 0 0 0 44 0 0 0 25 0 8 0 807678971 370212864 5493 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.86
Current children cumulated vsize (KiB) 361536

[startup+0.700908 s]
/proc/loadavg: 8.04 6.10 2.93 1/510 26146
/proc/meminfo: memFree=20843188/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=366072 CPUtime=5.45 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 11402 0 0 0 544 1 0 0 18 0 8 0 807678970 374857728 6869 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512758 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 91518 6870 352 106 0 87021 0
[pid=26146/tid=26147] ppid=26144 vsize=366072 CPUtime=0.69 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1227 0 0 0 69 0 0 0 25 0 8 0 807678971 374857728 6870 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=366072 CPUtime=0.68 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1257 0 0 0 68 0 0 0 18 0 8 0 807678971 374857728 6870 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=366072 CPUtime=0.68 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 2718 0 0 0 68 0 0 0 18 0 8 0 807678971 374857728 6871 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=366072 CPUtime=0.69 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1247 0 0 0 69 0 0 0 25 0 8 0 807678971 374857728 6871 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=366072 CPUtime=0.67 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1290 0 0 0 67 0 0 0 25 0 8 0 807678971 374857728 6871 33554432000 4194304 4625164 140735048657024 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=366072 CPUtime=0.68 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1188 0 0 0 68 0 0 0 25 0 8 0 807678971 374857728 6871 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=366072 CPUtime=0.64 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1200 0 0 0 64 0 0 0 25 0 8 0 807678971 374857728 6871 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352800 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.45
Current children cumulated vsize (KiB) 366072

[startup+1.50075 s]
/proc/loadavg: 8.04 6.10 2.93 9/518 26154
/proc/meminfo: memFree=20801964/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=374676 CPUtime=11.83 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 20726 0 0 0 1181 2 0 0 19 0 8 0 807678970 383668224 11466 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512736 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 93669 11466 352 106 0 89172 0
[pid=26146/tid=26147] ppid=26144 vsize=374676 CPUtime=1.49 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 2060 0 0 0 149 0 0 0 25 0 8 0 807678971 383668224 11467 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=374676 CPUtime=1.48 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 2067 0 0 0 148 0 0 0 20 0 8 0 807678971 383668224 11467 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=374676 CPUtime=1.47 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 6195 0 0 0 147 0 0 0 19 0 8 0 807678971 383668224 11467 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=374676 CPUtime=1.49 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 2083 0 0 0 149 0 0 0 25 0 8 0 807678971 383668224 11467 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=374676 CPUtime=1.45 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 2015 0 0 0 145 0 0 0 25 0 8 0 807678971 383668224 11467 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=374676 CPUtime=1.48 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 2743 0 0 0 148 0 0 0 25 0 8 0 807678971 383668224 11467 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352305 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=374676 CPUtime=1.44 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 1930 0 0 0 144 0 0 0 25 0 8 0 807678971 383668224 11467 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.83
Current children cumulated vsize (KiB) 374676

[startup+3.10043 s]
/proc/loadavg: 8.04 6.10 2.93 9/518 26154
/proc/meminfo: memFree=20778288/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=397148 CPUtime=24.61 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 35728 0 0 0 2457 4 0 0 25 0 8 0 807678970 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512057 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 99287 18495 352 106 0 94790 0
[pid=26146/tid=26147] ppid=26144 vsize=397148 CPUtime=3.08 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 4272 0 0 0 308 0 0 0 25 0 8 0 807678971 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=397148 CPUtime=3.08 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 3217 0 0 0 308 0 0 0 25 0 8 0 807678971 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339646 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=397148 CPUtime=3.07 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 12137 0 0 0 306 1 0 0 25 0 8 0 807678971 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=397148 CPUtime=3.09 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 3310 0 0 0 309 0 0 0 25 0 8 0 807678971 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 254500359130 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=397148 CPUtime=3.03 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 3095 0 0 0 303 0 0 0 25 0 8 0 807678971 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 4437929 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=397148 CPUtime=3.08 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 4407 0 0 0 308 0 0 0 25 0 8 0 807678971 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 4328185 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=397148 CPUtime=3.04 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 3102 0 0 0 304 0 0 0 25 0 8 0 807678971 406679552 18495 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.61
Current children cumulated vsize (KiB) 397148

[startup+6.30079 s]
/proc/loadavg: 8.04 6.13 2.95 9/518 26154
/proc/meminfo: memFree=20737132/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=425092 CPUtime=50.16 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 66490 0 0 0 5006 10 0 0 25 0 8 0 807678970 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 106273 29101 362 106 0 101776 0
[pid=26146/tid=26147] ppid=26144 vsize=425092 CPUtime=6.29 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 6271 0 0 0 628 1 0 0 25 0 8 0 807678971 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351632 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=425092 CPUtime=6.27 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 6305 0 0 0 627 0 0 0 25 0 8 0 807678971 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=425092 CPUtime=6.28 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 25898 0 0 0 624 4 0 0 25 0 8 0 807678971 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=425092 CPUtime=6.28 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 5262 0 0 0 628 0 0 0 25 0 8 0 807678971 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=425092 CPUtime=6.18 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 6570 0 0 0 617 1 0 0 25 0 8 0 807678971 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=425092 CPUtime=6.27 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 6616 0 0 0 627 0 0 0 25 0 8 0 807678971 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=425092 CPUtime=6.24 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 6538 0 0 0 623 1 0 0 25 0 8 0 807678971 435294208 29101 33554432000 4194304 4625164 140735048657024 18446744073709551615 4462461 0 0 4096 2 0 0 0 -1 3 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 5393292

[startup+4722.3 s]
/proc/loadavg: 8.11 8.08 8.01 9/518 26292
/proc/meminfo: memFree=16534224/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=5393292 CPUtime=37694.3 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 15448461 0 0 0 3766740 2693 0 0 25 0 8 0 807678970 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 1348323 1075615 534 106 0 1343826 0
[pid=26146/tid=26147] ppid=26144 vsize=5393292 CPUtime=4721.18 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 218601 0 0 0 472074 44 0 0 25 0 8 0 807678971 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=5393292 CPUtime=4721.86 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 309499 0 0 0 472121 65 0 0 25 0 8 0 807678971 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=5393292 CPUtime=4722.47 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 12714028 0 0 0 470111 2136 0 0 25 0 8 0 807678971 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=5393292 CPUtime=4722.51 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 256312 0 0 0 472201 50 0 0 25 0 8 0 807678971 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=5393292 CPUtime=4639 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 204329 0 0 0 463846 54 0 0 25 0 8 0 807678971 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348821 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=5393292 CPUtime=4722.47 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 382495 0 0 0 472165 82 0 0 25 0 8 0 807678971 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=5393292 CPUtime=4722.3 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 218723 0 0 0 472176 54 0 0 25 0 8 0 807678971 5522731008 1075615 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37694.3
Current children cumulated vsize (KiB) 5393292

[startup+4782.3 s]
/proc/loadavg: 8.10 8.08 8.01 9/518 26294
/proc/meminfo: memFree=16536300/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=5393292 CPUtime=38173.2 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 15601624 0 0 0 3814603 2722 0 0 25 0 8 0 807678970 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 1348323 1075415 361 106 0 1343826 0
[pid=26146/tid=26147] ppid=26144 vsize=5393292 CPUtime=4781.18 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 218696 0 0 0 478074 44 0 0 25 0 8 0 807678971 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=5393292 CPUtime=4781.86 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 309603 0 0 0 478121 65 0 0 25 0 8 0 807678971 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=5393292 CPUtime=4782.46 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 12865830 0 0 0 476082 2164 0 0 25 0 8 0 807678971 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=5393292 CPUtime=4782.51 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 256401 0 0 0 478201 50 0 0 25 0 8 0 807678971 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=5393292 CPUtime=4697.92 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 204433 0 0 0 469738 54 0 0 25 0 8 0 807678971 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=5393292 CPUtime=4782.47 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 382650 0 0 0 478165 82 0 0 25 0 8 0 807678971 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351811 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=5393292 CPUtime=4782.3 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 218958 0 0 0 478176 54 0 0 25 0 8 0 807678971 5522731008 1075415 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38173.2
Current children cumulated vsize (KiB) 5393292

[startup+4842.3 s]
/proc/loadavg: 8.10 8.08 8.01 9/518 26304
/proc/meminfo: memFree=16512100/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=5397436 CPUtime=38652.1 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 15833745 0 0 0 3862449 2765 0 0 25 0 8 0 807678970 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512032 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 1349359 1080298 381 106 0 1344862 0
[pid=26146/tid=26147] ppid=26144 vsize=5397436 CPUtime=4841.15 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 218805 0 0 0 484071 44 0 0 25 0 8 0 807678971 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=5397436 CPUtime=4841.87 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 309724 0 0 0 484121 66 0 0 25 0 8 0 807678971 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=5397436 CPUtime=4842.46 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 13094288 0 0 0 482041 2205 0 0 25 0 8 0 807678971 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=5397436 CPUtime=4842.5 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 256644 0 0 0 484200 50 0 0 25 0 8 0 807678971 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=5397436 CPUtime=4756.84 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 204563 0 0 0 475630 54 0 0 25 0 8 0 807678971 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=5397436 CPUtime=4842.45 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 383061 0 0 0 484162 83 0 0 25 0 8 0 807678971 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=5397436 CPUtime=4842.31 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 221171 0 0 0 484176 55 0 0 25 0 8 0 807678971 5526974464 1080298 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38652.1
Current children cumulated vsize (KiB) 5397436

[startup+4902.3 s]
/proc/loadavg: 8.14 8.09 8.01 9/518 26306
/proc/meminfo: memFree=16491312/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=5398444 CPUtime=39131.1 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 16007408 0 0 0 3910311 2796 0 0 25 0 8 0 807678970 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 1349611 1086053 530 106 0 1345114 0
[pid=26146/tid=26147] ppid=26144 vsize=5398444 CPUtime=4901.15 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 218888 0 0 0 490070 45 0 0 25 0 8 0 807678971 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=5398444 CPUtime=4901.87 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 309838 0 0 0 490121 66 0 0 25 0 8 0 807678971 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=5398444 CPUtime=4902.47 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 13257813 0 0 0 488013 2234 0 0 25 0 8 0 807678971 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=5398444 CPUtime=4902.51 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 256727 0 0 0 490200 51 0 0 25 0 8 0 807678971 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=5398444 CPUtime=4815.76 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 204684 0 0 0 481522 54 0 0 25 0 8 0 807678971 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348817 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=5398444 CPUtime=4902.46 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 383171 0 0 0 490163 83 0 0 25 0 8 0 807678971 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=5398444 CPUtime=4902.3 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 221484 0 0 0 490175 55 0 0 25 0 8 0 807678971 5528006656 1086053 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39131.1
Current children cumulated vsize (KiB) 5398444

[startup+4962.3 s]
/proc/loadavg: 8.10 8.09 8.01 9/518 26308
/proc/meminfo: memFree=16460164/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=5402020 CPUtime=39610.1 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 16222835 0 0 0 3958183 2831 0 0 25 0 8 0 807678970 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 1350505 1093846 437 106 0 1346008 0
[pid=26146/tid=26147] ppid=26144 vsize=5402020 CPUtime=4961.15 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 219945 0 0 0 496070 45 0 0 25 0 8 0 807678971 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=5402020 CPUtime=4961.89 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 309957 0 0 0 496123 66 0 0 25 0 8 0 807678971 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=5402020 CPUtime=4962.49 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 13414667 0 0 0 493990 2259 0 0 25 0 8 0 807678971 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=5402020 CPUtime=4962.53 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 256934 0 0 0 496202 51 0 0 25 0 8 0 807678971 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=5402020 CPUtime=4874.71 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 204957 0 0 0 487416 55 0 0 25 0 8 0 807678971 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=5402020 CPUtime=4962.47 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 385696 0 0 0 496164 83 0 0 25 0 8 0 807678971 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=5402020 CPUtime=4962.33 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 221681 0 0 0 496178 55 0 0 25 0 8 0 807678971 5531668480 1093846 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39610.1
Current children cumulated vsize (KiB) 5402020



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.2 s]
/proc/loadavg: 8.09 8.09 8.01 9/518 26309
/proc/meminfo: memFree=16438692/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=5402020 CPUtime=40000.5 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) R 26144 26146 26075 0 -1 4202496 16394680 0 0 0 3997185 2861 0 0 25 0 8 0 807678970 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 1350505 1099148 463 106 0 1346008 0
[pid=26146/tid=26147] ppid=26144 vsize=5402020 CPUtime=5010.04 cores=0-7
/proc/26146/task/26147/stat : 26147 (SArTagnan) R 26144 26146 26075 0 -1 4202560 220129 0 0 0 500959 45 0 0 25 0 8 0 807678971 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26146/tid=26148] ppid=26144 vsize=5402020 CPUtime=5010.8 cores=0-7
/proc/26146/task/26148/stat : 26148 (SArTagnan) R 26144 26146 26075 0 -1 4202560 310046 0 0 0 501014 66 0 0 25 0 8 0 807678971 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26146/tid=26149] ppid=26144 vsize=5402020 CPUtime=5011.4 cores=0-7
/proc/26146/task/26149/stat : 26149 (SArTagnan) R 26144 26146 26075 0 -1 4202560 13562730 0 0 0 498856 2284 0 0 25 0 8 0 807678971 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4552464 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26146/tid=26150] ppid=26144 vsize=5402020 CPUtime=5011.43 cores=0-7
/proc/26146/task/26150/stat : 26150 (SArTagnan) R 26144 26146 26075 0 -1 4202560 257075 0 0 0 501092 51 0 0 25 0 8 0 807678971 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=5402020 CPUtime=4922.72 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4202560 204981 0 0 0 492217 55 0 0 25 0 8 0 807678971 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26146/tid=26152] ppid=26144 vsize=5402020 CPUtime=5011.38 cores=0-7
/proc/26146/task/26152/stat : 26152 (SArTagnan) R 26144 26146 26075 0 -1 4202560 386053 0 0 0 501054 84 0 0 25 0 8 0 807678971 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26146/tid=26153] ppid=26144 vsize=5402020 CPUtime=5011.24 cores=0-7
/proc/26146/task/26153/stat : 26153 (SArTagnan) R 26144 26146 26075 0 -1 4202560 222487 0 0 0 501068 56 0 0 25 0 8 0 807678971 5531668480 1099148 33554432000 4194304 4625164 140735048657024 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 5402020

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.33 s]
/proc/loadavg: 8.09 8.09 8.01 9/518 26309
/proc/meminfo: memFree=16438692/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=0 CPUtime=40000.6 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) Z 26144 26146 26075 0 -1 4203548 16394697 0 0 0 3997190 2871 0 0 25 0 2 0 807678970 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 0 0 0 0 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=0 CPUtime=4922.83 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4203588 204981 0 0 0 492218 65 0 0 25 0 2 0 807678971 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 0

[startup+5011.4 s]
/proc/loadavg: 8.09 8.09 8.01 9/518 26309
/proc/meminfo: memFree=16438692/32950928 swapFree=34979748/67111528
[pid=26146] ppid=26144 vsize=0 CPUtime=40000.7 cores=0-7
/proc/26146/stat : 26146 (SArTagnan) Z 26144 26146 26075 0 -1 4203548 16394697 0 0 0 3997190 2879 0 0 25 0 2 0 807678970 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26146/statm: 0 0 0 0 0 0 0
[pid=26146/tid=26151] ppid=26144 vsize=0 CPUtime=4922.9 cores=0-7
/proc/26146/task/26151/stat : 26151 (SArTagnan) R 26144 26146 26075 0 -1 4203588 204981 0 0 0 492218 72 0 0 25 0 2 0 807678971 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.42
CPU time (s): 40000.7
CPU user time (s): 39971.9
CPU system time (s): 28.8076
CPU usage (%): 798.192
Max. virtual memory (cumulated for all children) (KiB): 5467556

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39971.9
system time used= 28.8076
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16394697
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 491
involuntary context switches= 165330

runsolver used 23.4954 second user time and 64.9771 second system time

The end

Launcher Data 

Begin job on node149 at 2011-06-01 22:40:23
IDJOB=3439356
IDBENCH=84028
IDSOLVER=1936
FILE ID=node149/3439356-1306960823
RUNJOBID= node149-1306960404-26089
PBS_JOBID= 13497602
Free space on /tmp= 73516 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/stanion/hwb/hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439356-1306960823/watcher-3439356-1306960823 -o /tmp/evaluation-result-3439356-1306960823/solver-3439356-1306960823 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439356-1306960823.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= bdf2c49c74bfdbd3bd4663dca402d24f
RANDOM SEED=657689543

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20843592 kB
Buffers:        298864 kB
Cached:        3323940 kB
SwapCached:      84504 kB
Active:        2047440 kB
Inactive:      9730428 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20843592 kB
SwapTotal:    67111528 kB
SwapFree:     34979748 kB
Dirty:             424 kB
Writeback:           0 kB
AnonPages:     8095560 kB
Mapped:          17516 kB
Slab:           139640 kB
PageTables:     117140 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 173082632 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73516 MiB
End job on node149 at 2011-06-02 00:03:56