Trace number 3438506

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.8 5007.36

General information on the benchmark

NameCRAFTED/rbsat/crafted/unforced/
rbsat-v1820c171155g5.cnf
MD5SUM70a781814cd432fb0f934a7edd92ccff
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1716.97
Satisfiable
(Un)Satisfiability was proved
Number of variables1820
Number of clauses171155
Sum of the clauses size344000
Maximum clause length28
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2171090
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 565

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438506-1306919539/watcher-3438506-1306919539 -o /tmp/evaluation-result-3438506-1306919539/solver-3438506-1306919539 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438506-1306919539.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 1/320 6705
/proc/meminfo: memFree=24333844/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=23268 CPUtime=0 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 649 0 0 0 0 0 0 0 22 0 1 0 882184506 23826432 525 33554432000 4194304 4625164 140735850470496 18446744073709551615 260020093136 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/6705/statm: 5817 481 296 106 0 1320 0

[startup+0.098468 s]
/proc/loadavg: 0.92 0.98 0.99 1/320 6705
/proc/meminfo: memFree=24333844/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=114716 CPUtime=0.29 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 6076 0 0 0 29 0 0 0 23 0 8 0 882184506 117469184 4842 33554432000 4194304 4625164 140735850470496 18446744073709551615 47679018690472 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6705/statm: 28679 4842 301 106 0 24182 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 114716

[startup+0.100468 s]
/proc/loadavg: 0.92 0.98 0.99 1/320 6705
/proc/meminfo: memFree=24333844/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=114716 CPUtime=0.31 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 6076 0 0 0 31 0 0 0 23 0 8 0 882184506 117469184 4842 33554432000 4194304 4625164 140735850470496 18446744073709551615 47679018690480 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6705/statm: 28679 4842 301 106 0 24182 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 114716

[startup+0.300437 s]
/proc/loadavg: 0.92 0.98 0.99 1/320 6705
/proc/meminfo: memFree=24333844/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=518336 CPUtime=1.5 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 17838 0 0 0 147 3 0 0 18 0 8 0 882184506 530776064 13676 33554432000 4194304 4625164 140735850470496 18446744073709551615 4518211 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 129584 13676 351 106 0 125087 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 518336

[startup+0.700366 s]
/proc/loadavg: 0.92 0.98 0.99 1/320 6705
/proc/meminfo: memFree=24333844/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=519952 CPUtime=4.29 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 22074 0 0 0 425 4 0 0 18 0 8 0 882184506 532430848 16237 33554432000 4194304 4625164 140735850470496 18446744073709551615 4512736 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 129988 16237 352 106 0 125491 0
Current children cumulated CPU time (s) 4.29
Current children cumulated vsize (KiB) 519952

[startup+1.50122 s]
/proc/loadavg: 0.92 0.98 0.99 9/328 6713
/proc/meminfo: memFree=24253180/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=528628 CPUtime=10.62 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 33131 0 0 0 1056 6 0 0 19 0 8 0 882184506 541315072 26477 33554432000 4194304 4625164 140735850470496 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 132157 26477 356 106 0 127660 0
[pid=6705/tid=6707] ppid=6703 vsize=528628 CPUtime=1.42 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2871 0 0 0 142 0 0 0 19 0 8 0 882184510 541315072 26477 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=528628 CPUtime=0.81 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2105 0 0 0 81 0 0 0 25 0 8 0 882184510 541315072 26477 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=528628 CPUtime=1.38 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 4541 0 0 0 138 0 0 0 19 0 8 0 882184510 541315072 26477 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=528628 CPUtime=1.32 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2439 0 0 0 132 0 0 0 25 0 8 0 882184510 541315072 26477 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=528628 CPUtime=1.42 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2522 0 0 0 142 0 0 0 19 0 8 0 882184511 541315072 26477 33554432000 4194304 4625164 140735850470496 18446744073709551615 260020054278 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=528628 CPUtime=1.43 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2443 0 0 0 143 0 0 0 19 0 8 0 882184511 541315072 26479 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352186 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=528628 CPUtime=1.36 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2227 0 0 0 136 0 0 0 19 0 8 0 882184511 541315072 26479 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351632 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.62
Current children cumulated vsize (KiB) 528628

[startup+3.10093 s]
/proc/loadavg: 0.92 0.98 0.99 9/328 6713
/proc/meminfo: memFree=24215360/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=532320 CPUtime=23.41 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 45831 0 0 0 2332 9 0 0 24 0 8 0 882184506 545095680 34745 33554432000 4194304 4625164 140735850470496 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 133080 34746 357 106 0 128583 0
[pid=6705/tid=6707] ppid=6703 vsize=532320 CPUtime=3.03 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 4176 0 0 0 302 1 0 0 25 0 8 0 882184510 545095680 34747 33554432000 4194304 4625164 140735850470496 18446744073709551615 4465120 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=532320 CPUtime=2.42 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 3662 0 0 0 241 1 0 0 25 0 8 0 882184510 545095680 34747 33554432000 4194304 4625164 140735850470496 18446744073709551615 260020057121 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=532320 CPUtime=2.98 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 7130 0 0 0 297 1 0 0 25 0 8 0 882184510 545095680 34747 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=532320 CPUtime=2.92 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 4038 0 0 0 292 0 0 0 25 0 8 0 882184510 545095680 34747 33554432000 4194304 4625164 140735850470496 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=532320 CPUtime=3.02 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2864 0 0 0 302 0 0 0 25 0 8 0 882184511 545095680 34747 33554432000 4194304 4625164 140735850470496 18446744073709551615 4319046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=532320 CPUtime=3.02 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 3832 0 0 0 302 0 0 0 24 0 8 0 882184511 545095680 34747 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=532320 CPUtime=2.95 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 2510 0 0 0 295 0 0 0 23 0 8 0 882184511 545095680 34747 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.41
Current children cumulated vsize (KiB) 532320

[startup+6.30034 s]
/proc/loadavg: 1.49 1.10 1.03 9/328 6714
/proc/meminfo: memFree=24137064/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=552812 CPUtime=48.97 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 80738 0 0 0 4881 16 0 0 25 0 8 0 882184506 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 138203 51645 388 106 0 133706 0
[pid=6705/tid=6707] ppid=6703 vsize=552812 CPUtime=6.22 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 6623 0 0 0 621 1 0 0 25 0 8 0 882184510 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351958 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=552812 CPUtime=5.61 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 5759 0 0 0 560 1 0 0 25 0 8 0 882184510 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=552812 CPUtime=6.18 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 21238 0 0 0 615 3 0 0 25 0 8 0 882184510 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4579408 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=552812 CPUtime=6.12 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 6750 0 0 0 611 1 0 0 25 0 8 0 882184510 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=552812 CPUtime=6.23 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 5462 0 0 0 622 1 0 0 25 0 8 0 882184511 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4440181 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=552812 CPUtime=6.23 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 6449 0 0 0 621 2 0 0 25 0 8 0 882184511 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351942 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=552812 CPUtime=6.11 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 3811 0 0 0 611 0 0 0 25 0 8 0 882184511 566079488 51645 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352855 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.97
Current children cumulated vsize (KiB) 552812

[startup+12.7012 s]
/proc/loadavg: 2.01 1.21 1.07 9/328 6714
/proc/meminfo: memFree=24071312/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=572720 CPUtime=100.1 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 122681 0 0 0 9986 24 0 0 25 0 8 0 882184506 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4511938 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 143180 67050 369 106 0 138683 0
[pid=6705/tid=6707] ppid=6703 vsize=572720 CPUtime=12.62 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 10512 0 0 0 1260 2 0 0 25 0 8 0 882184510 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=572720 CPUtime=12.01 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 7364 0 0 0 1199 2 0 0 25 0 8 0 882184510 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=572720 CPUtime=12.58 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 39828 0 0 0 1252 6 0 0 25 0 8 0 882184510 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=572720 CPUtime=12.52 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 10753 0 0 0 1251 1 0 0 25 0 8 0 882184510 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=572720 CPUtime=12.63 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 6421 0 0 0 1262 1 0 0 25 0 8 0 882184511 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4348826 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=572720 CPUtime=12.62 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 10453 0 0 0 1260 2 0 0 25 0 8 0 882184511 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=572720 CPUtime=12.44 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 5810 0 0 0 1243 1 0 0 25 0 8 0 882184511 586465280 67050 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.1
Current children cumulated vsize (KiB) 572720

[startup+25.5008 s]
/proc/loadavg: 3.33 1.55 1.18 9/328 6714
/proc/meminfo: memFree=23951564/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=727552 CPUtime=202.36 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 204851 0 0 0 20197 39 0 0 25 0 8 0 882184506 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4512138 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 181888 96445 545 106 0 177391 0
[pid=6705/tid=6707] ppid=6703 vsize=727552 CPUtime=25.43 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 15097 0 0 0 2540 3 0 0 25 0 8 0 882184510 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=727552 CPUtime=24.81 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 10679 0 0 0 2478 3 0 0 25 0 8 0 882184510 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=727552 CPUtime=25.38 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 82996 0 0 0 2524 14 0 0 25 0 8 0 882184510 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=727552 CPUtime=25.32 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 15153 0 0 0 2530 2 0 0 25 0 8 0 882184510 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=727552 CPUtime=25.42 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 8965 0 0 0 2541 1 0 0 25 0 8 0 882184511 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4349084 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=727552 CPUtime=25.43 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 19964 0 0 0 2538 5 0 0 25 0 8 0 882184511 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=727552 CPUtime=25.1 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 8653 0 0 0 2509 1 0 0 25 0 8 0 882184511 745013248 96445 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 202.36
Current children cumulated vsize (KiB) 727552

[startup+51.1011 s]
/proc/loadavg: 4.99 2.08 1.37 9/328 6715
/proc/meminfo: memFree=23816140/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=825780 CPUtime=406.89 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 319165 0 0 0 40629 60 0 0 25 0 8 0 882184506 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 206445 130482 384 106 0 201948 0
[pid=6705/tid=6707] ppid=6703 vsize=825780 CPUtime=51.03 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 23328 0 0 0 5098 5 0 0 25 0 8 0 882184510 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=825780 CPUtime=50.4 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 15135 0 0 0 5036 4 0 0 25 0 8 0 882184510 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=825780 CPUtime=50.97 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 154565 0 0 0 5072 25 0 0 25 0 8 0 882184510 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4547216 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=825780 CPUtime=50.93 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 23405 0 0 0 5089 4 0 0 25 0 8 0 882184510 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=825780 CPUtime=51.02 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 10193 0 0 0 5100 2 0 0 25 0 8 0 882184511 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=825780 CPUtime=51.03 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 22215 0 0 0 5097 6 0 0 25 0 8 0 882184511 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=825780 CPUtime=50.44 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 10409 0 0 0 5042 2 0 0 25 0 8 0 882184511 845598720 130482 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 406.89

################
# More data... #
################

Current children cumulated vsize (KiB) 5164840

[startup+4722.31 s]
/proc/loadavg: 8.08 8.07 7.98 9/328 6851
/proc/meminfo: memFree=19661436/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=5956352 CPUtime=37725.1 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 35493215 0 0 0 3766539 5975 0 0 25 0 8 0 882184506 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 1489088 1166076 352 106 0 1484591 0
[pid=6705/tid=6707] ppid=6703 vsize=5956352 CPUtime=4722.37 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 123267 0 0 0 472205 32 0 0 25 0 8 0 882184510 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=5956352 CPUtime=4721.65 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 192721 0 0 0 472008 157 0 0 25 0 8 0 882184510 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352157 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=5956352 CPUtime=4701.91 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 31538891 0 0 0 465134 5057 0 0 25 0 8 0 882184510 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=5956352 CPUtime=4721.48 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 134077 0 0 0 472121 27 0 0 25 0 8 0 882184510 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=5956352 CPUtime=4722.34 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 98066 0 0 0 472167 67 0 0 25 0 8 0 882184511 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4339680 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=5956352 CPUtime=4694.63 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 162019 0 0 0 469421 42 0 0 25 0 8 0 882184511 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=5956352 CPUtime=4718.5 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 90409 0 0 0 471787 63 0 0 25 0 8 0 882184511 6099304448 1166076 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37725.1
Current children cumulated vsize (KiB) 5956352

[startup+4782.3 s]
/proc/loadavg: 8.08 8.07 7.99 9/328 6853
/proc/meminfo: memFree=19639424/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=6022100 CPUtime=38204.4 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 35530320 0 0 0 3814455 5984 0 0 25 0 8 0 882184506 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 1505525 1171653 352 106 0 1501028 0
[pid=6705/tid=6707] ppid=6703 vsize=6022100 CPUtime=4782.36 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 123400 0 0 0 478204 32 0 0 25 0 8 0 882184510 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4330806 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=6022100 CPUtime=4781.63 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 194966 0 0 0 478004 159 0 0 25 0 8 0 882184510 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=6022100 CPUtime=4761.25 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 31538910 0 0 0 471068 5057 0 0 25 0 8 0 882184510 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4547441 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=6022100 CPUtime=4781.46 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 134230 0 0 0 478119 27 0 0 25 0 8 0 882184510 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=6022100 CPUtime=4782.33 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 98190 0 0 0 478166 67 0 0 25 0 8 0 882184511 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4349072 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=6022100 CPUtime=4754.61 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 162202 0 0 0 475419 42 0 0 25 0 8 0 882184511 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=6022100 CPUtime=4778.48 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 90471 0 0 0 477785 63 0 0 25 0 8 0 882184511 6166630400 1171653 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38204.4
Current children cumulated vsize (KiB) 6022100

[startup+4842.3 s]
/proc/loadavg: 8.07 8.07 7.99 9/328 6854
/proc/meminfo: memFree=19613440/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=6126336 CPUtime=38683.7 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 35590801 0 0 0 3862379 5995 0 0 25 0 8 0 882184506 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 1531584 1178215 352 106 0 1527087 0
[pid=6705/tid=6707] ppid=6703 vsize=6126336 CPUtime=4842.37 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 135800 0 0 0 484203 34 0 0 25 0 8 0 882184510 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=6126336 CPUtime=4841.64 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 195111 0 0 0 484005 159 0 0 25 0 8 0 882184510 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=6126336 CPUtime=4820.6 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 31541011 0 0 0 477003 5057 0 0 25 0 8 0 882184510 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=6126336 CPUtime=4841.47 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 134354 0 0 0 484120 27 0 0 25 0 8 0 882184510 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=6126336 CPUtime=4842.33 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 98221 0 0 0 484166 67 0 0 25 0 8 0 882184511 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 260020054144 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=6126336 CPUtime=4814.62 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 174448 0 0 0 481418 44 0 0 25 0 8 0 882184511 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=6126336 CPUtime=4838.48 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 91162 0 0 0 483784 64 0 0 25 0 8 0 882184511 6273368064 1178215 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38683.7
Current children cumulated vsize (KiB) 6126336

[startup+4902.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/328 6856
/proc/meminfo: memFree=19593424/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=6130616 CPUtime=39163.1 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 35669891 0 0 0 3910299 6010 0 0 25 0 8 0 882184506 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4510186 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 1532654 1183077 352 106 0 1528157 0
[pid=6705/tid=6707] ppid=6703 vsize=6130616 CPUtime=4902.37 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 135890 0 0 0 490202 35 0 0 25 0 8 0 882184510 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=6130616 CPUtime=4901.65 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 195133 0 0 0 490005 160 0 0 25 0 8 0 882184510 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=6130616 CPUtime=4879.95 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 31587332 0 0 0 482930 5065 0 0 25 0 8 0 882184510 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=6130616 CPUtime=4901.47 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 134454 0 0 0 490120 27 0 0 25 0 8 0 882184510 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331211 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=6130616 CPUtime=4902.33 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 98243 0 0 0 490166 67 0 0 25 0 8 0 882184511 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=6130616 CPUtime=4874.62 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 174782 0 0 0 487418 44 0 0 25 0 8 0 882184511 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=6130616 CPUtime=4898.47 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 91886 0 0 0 489782 65 0 0 25 0 8 0 882184511 6277750784 1183077 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39163.1
Current children cumulated vsize (KiB) 6130616

[startup+4962.3 s]
/proc/loadavg: 8.06 8.06 8.00 9/328 6858
/proc/meminfo: memFree=19569936/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=6160548 CPUtime=39642.4 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 35723539 0 0 0 3958222 6021 0 0 25 0 8 0 882184506 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4393097 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 1540137 1189244 352 106 0 1535640 0
[pid=6705/tid=6707] ppid=6703 vsize=6160548 CPUtime=4962.37 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 136226 0 0 0 496202 35 0 0 25 0 8 0 882184510 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=6160548 CPUtime=4961.64 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 196484 0 0 0 496003 161 0 0 25 0 8 0 882184510 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=6160548 CPUtime=4939.29 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 31587405 0 0 0 488864 5065 0 0 25 0 8 0 882184510 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=6160548 CPUtime=4961.47 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 134544 0 0 0 496120 27 0 0 25 0 8 0 882184510 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=6160548 CPUtime=4962.33 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 113609 0 0 0 496164 69 0 0 25 0 8 0 882184511 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4348817 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=6160548 CPUtime=4934.61 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 174909 0 0 0 493417 44 0 0 25 0 8 0 882184511 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=6160548 CPUtime=4958.46 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 93511 0 0 0 495780 66 0 0 25 0 8 0 882184511 6308401152 1189244 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39642.4
Current children cumulated vsize (KiB) 6160548



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5007.1 s]
/proc/loadavg: 8.03 8.05 8.00 10/328 6859
/proc/meminfo: memFree=19556868/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=6160548 CPUtime=40000.5 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) R 6703 6705 6679 0 -1 4202496 35757968 0 0 0 3994020 6029 0 0 25 0 8 0 882184506 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 1540137 1192149 352 106 0 1535640 0
[pid=6705/tid=6707] ppid=6703 vsize=6160548 CPUtime=5007.2 cores=0-7
/proc/6705/task/6707/stat : 6707 (SArTagnan) R 6703 6705 6679 0 -1 4202560 136292 0 0 0 500685 35 0 0 25 0 8 0 882184510 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6705/tid=6708] ppid=6703 vsize=6160548 CPUtime=5006.47 cores=0-7
/proc/6705/task/6708/stat : 6708 (SArTagnan) R 6703 6705 6679 0 -1 4202560 196556 0 0 0 500486 161 0 0 25 0 8 0 882184510 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=6160548 CPUtime=4983.61 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4202560 31587409 0 0 0 493296 5065 0 0 25 0 8 0 882184510 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6705/tid=6710] ppid=6703 vsize=6160548 CPUtime=5006.29 cores=0-7
/proc/6705/task/6710/stat : 6710 (SArTagnan) R 6703 6705 6679 0 -1 4202560 134667 0 0 0 500602 27 0 0 25 0 8 0 882184510 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6705/tid=6711] ppid=6703 vsize=6160548 CPUtime=5007.16 cores=0-7
/proc/6705/task/6711/stat : 6711 (SArTagnan) R 6703 6705 6679 0 -1 4202560 113619 0 0 0 500647 69 0 0 25 0 8 0 882184511 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6705/tid=6712] ppid=6703 vsize=6160548 CPUtime=4979.44 cores=0-7
/proc/6705/task/6712/stat : 6712 (SArTagnan) R 6703 6705 6679 0 -1 4202560 175134 0 0 0 497900 44 0 0 25 0 8 0 882184511 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6705/tid=6713] ppid=6703 vsize=6160548 CPUtime=5003.27 cores=0-7
/proc/6705/task/6713/stat : 6713 (SArTagnan) R 6703 6705 6679 0 -1 4202560 94612 0 0 0 500260 67 0 0 25 0 8 0 882184511 6308401152 1192149 33554432000 4194304 4625164 140735850470496 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 6160548

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.23 s]
/proc/loadavg: 8.03 8.05 8.00 10/328 6859
/proc/meminfo: memFree=19556868/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=0 CPUtime=40000.7 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) Z 6703 6705 6679 0 -1 4203548 35757968 0 0 0 3994028 6039 0 0 25 0 2 0 882184506 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 0 0 0 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=0 CPUtime=4983.72 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4203588 31587409 0 0 0 493297 5075 0 0 25 0 2 0 882184510 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

[startup+5007.3 s]
/proc/loadavg: 8.03 8.05 8.00 10/328 6859
/proc/meminfo: memFree=19556868/32951124 swapFree=67056304/67111528
[pid=6705] ppid=6703 vsize=0 CPUtime=40000.7 cores=0-7
/proc/6705/stat : 6705 (SArTagnan) Z 6703 6705 6679 0 -1 4203548 35757968 0 0 0 3994028 6046 0 0 25 0 2 0 882184506 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6705/statm: 0 0 0 0 0 0 0
[pid=6705/tid=6709] ppid=6703 vsize=0 CPUtime=4983.79 cores=0-7
/proc/6705/task/6709/stat : 6709 (SArTagnan) R 6703 6705 6679 0 -1 4203588 31587409 0 0 0 493297 5082 0 0 25 0 2 0 882184510 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5007.36
CPU time (s): 40000.8
CPU user time (s): 39940.3
CPU system time (s): 60.5268
CPU usage (%): 798.84
Max. virtual memory (cumulated for all children) (KiB): 7399296

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39940.3
system time used= 60.5268
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35757968
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11414
involuntary context switches= 171089

runsolver used 14.6958 second user time and 39.47 second system time

The end

Launcher Data 

Begin job on node110 at 2011-06-01 11:12:19
IDJOB=3438506
IDBENCH=71443
IDSOLVER=1936
FILE ID=node110/3438506-1306919539
RUNJOBID= node110-1306919539-6693
PBS_JOBID= 13488530
Free space on /tmp= 73872 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/unforced/rbsat-v1820c171155g5.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438506-1306919539/watcher-3438506-1306919539 -o /tmp/evaluation-result-3438506-1306919539/solver-3438506-1306919539 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438506-1306919539.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 70a781814cd432fb0f934a7edd92ccff
RANDOM SEED=859164064

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24334364 kB
Buffers:        238976 kB
Cached:        4451860 kB
SwapCached:       8652 kB
Active:        3765836 kB
Inactive:      4529236 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24334364 kB
SwapTotal:    67111528 kB
SwapFree:     67056304 kB
Dirty:            2756 kB
Writeback:           0 kB
AnonPages:     3603012 kB
Mapped:          26164 kB
Slab:           228328 kB
PageTables:      27016 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 75582720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73872 MiB
End job on node110 at 2011-06-01 12:35:48