Trace number 3438846

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.8 5012.73

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x39.cnf
MD5SUMe7679ca49bb432c9b90305d907365c4e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3276
Number of clauses628173
Sum of the clauses size2502864
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24914
Number of clauses of size 30
Number of clauses of size 4623259
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438846-1306924563/watcher-3438846-1306924563 -o /tmp/evaluation-result-3438846-1306924563/solver-3438846-1306924563 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438846-1306924563.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.03 8.02 7.97 1/528 5808
/proc/meminfo: memFree=29423812/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=34440 CPUtime=0 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 682 0 0 0 0 0 0 0 25 0 1 0 804054352 35266560 619 33554432000 4194304 4625164 140734812017264 18446744073709551615 228244046032 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/5808/statm: 8610 632 296 106 0 4113 0

[startup+0.115538 s]
/proc/loadavg: 8.03 8.02 7.97 1/528 5808
/proc/meminfo: memFree=29423812/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=50264 CPUtime=0.1 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 10161 0 0 0 10 0 0 0 25 0 1 0 804054352 51470336 5412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/5808/statm: 12566 5415 296 106 0 8069 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 50264

[startup+0.200536 s]
/proc/loadavg: 8.03 8.02 7.97 1/528 5808
/proc/meminfo: memFree=29423812/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=75108 CPUtime=0.19 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 19248 0 0 0 18 1 0 0 25 0 1 0 804054352 76910592 10205 33554432000 4194304 4625164 140734812017264 18446744073709551615 228244046293 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/5808/statm: 18777 10226 296 106 0 14280 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 75108

[startup+0.300504 s]
/proc/loadavg: 8.03 8.02 7.97 1/528 5808
/proc/meminfo: memFree=29423812/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=94928 CPUtime=0.28 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 27649 0 0 0 26 2 0 0 25 0 1 0 804054352 97206272 13998 33554432000 4194304 4625164 140734812017264 18446744073709551615 228244046293 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/5808/statm: 23732 14018 296 106 0 19235 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 94928

[startup+0.7004 s]
/proc/loadavg: 8.03 8.02 7.97 1/528 5808
/proc/meminfo: memFree=29423812/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=689872 CPUtime=2.2 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 100345 0 0 0 207 13 0 0 25 0 8 0 804054352 706428928 82586 33554432000 4194304 4625164 140734812017264 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 172468 82586 345 106 0 167971 0
Current children cumulated CPU time (s) 2.2
Current children cumulated vsize (KiB) 689872

[startup+1.50126 s]
/proc/loadavg: 8.03 8.02 7.97 9/536 5816
/proc/meminfo: memFree=29071852/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=763776 CPUtime=8.58 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 127826 0 0 0 841 17 0 0 25 0 8 0 804054352 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4512078 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 190944 93349 345 106 0 186447 0
[pid=5808/tid=5810] ppid=5806 vsize=763776 CPUtime=1.02 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 3253 0 0 0 102 0 0 0 19 0 8 0 804054399 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=763776 CPUtime=0.95 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 3409 0 0 0 95 0 0 0 25 0 8 0 804054399 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=763776 CPUtime=1 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 27433 0 0 0 96 4 0 0 19 0 8 0 804054399 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=763776 CPUtime=0.98 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 3284 0 0 0 98 0 0 0 25 0 8 0 804054399 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=763776 CPUtime=1.02 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 7918 0 0 0 101 1 0 0 19 0 8 0 804054399 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=763776 CPUtime=1.02 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 3300 0 0 0 102 0 0 0 19 0 8 0 804054399 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4334488 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=763776 CPUtime=1.02 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 3246 0 0 0 102 0 0 0 19 0 8 0 804054399 782106624 93349 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 8.58
Current children cumulated vsize (KiB) 763776

[startup+3.10098 s]
/proc/loadavg: 8.03 8.02 7.97 9/536 5816
/proc/meminfo: memFree=29030064/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=805760 CPUtime=21.35 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 195120 0 0 0 2108 27 0 0 25 0 8 0 804054352 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 201440 105154 345 106 0 196943 0
[pid=5808/tid=5810] ppid=5806 vsize=805760 CPUtime=2.63 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 8150 0 0 0 262 1 0 0 22 0 8 0 804054399 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=805760 CPUtime=2.53 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 8361 0 0 0 252 1 0 0 25 0 8 0 804054399 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=805760 CPUtime=2.59 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 68722 0 0 0 250 9 0 0 22 0 8 0 804054399 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4579607 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=805760 CPUtime=2.58 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 8214 0 0 0 257 1 0 0 25 0 8 0 804054399 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4464208 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=805760 CPUtime=2.62 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 8606 0 0 0 260 2 0 0 22 0 8 0 804054399 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4348817 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=805760 CPUtime=2.62 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 8487 0 0 0 261 1 0 0 22 0 8 0 804054399 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=805760 CPUtime=2.62 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 8097 0 0 0 261 1 0 0 23 0 8 0 804054399 825098240 105154 33554432000 4194304 4625164 140734812017264 18446744073709551615 4467219 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 21.35
Current children cumulated vsize (KiB) 805760

[startup+6.30042 s]
/proc/loadavg: 8.03 8.02 7.97 9/536 5816
/proc/meminfo: memFree=28940128/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=814128 CPUtime=46.88 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 279572 0 0 0 4649 39 0 0 25 0 8 0 804054352 833667072 126465 33554432000 4194304 4625164 140734812017264 18446744073709551615 4512128 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 203532 126465 345 106 0 199035 0
[pid=5808/tid=5810] ppid=5806 vsize=814128 CPUtime=5.82 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 9591 0 0 0 581 1 0 0 25 0 8 0 804054399 833667072 126465 33554432000 4194304 4625164 140734812017264 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=814128 CPUtime=5.68 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 9600 0 0 0 566 2 0 0 25 0 8 0 804054399 833667072 126465 33554432000 4194304 4625164 140734812017264 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=814128 CPUtime=5.79 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 140293 0 0 0 562 17 0 0 25 0 8 0 804054399 833667072 126465 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=814128 CPUtime=5.78 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 9285 0 0 0 577 1 0 0 25 0 8 0 804054399 833667072 126465 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=814128 CPUtime=5.82 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 10082 0 0 0 580 2 0 0 25 0 8 0 804054399 833667072 126465 33554432000 4194304 4625164 140734812017264 18446744073709551615 4348804 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=814128 CPUtime=5.82 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 10240 0 0 0 580 2 0 0 25 0 8 0 804054399 833667072 126465 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=814128 CPUtime=5.82 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 9036 0 0 0 581 1 0 0 25 0 8 0 804054399 833667072 126466 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 46.88
Current children cumulated vsize (KiB) 814128

[startup+12.7013 s]
/proc/loadavg: 8.02 8.02 7.97 9/536 5816
/proc/meminfo: memFree=28792412/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=877144 CPUtime=97.95 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 470000 0 0 0 9729 66 0 0 25 0 8 0 804054352 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4511948 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 219286 160409 345 106 0 214789 0
[pid=5808/tid=5810] ppid=5806 vsize=877144 CPUtime=12.23 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 17843 0 0 0 1220 3 0 0 25 0 8 0 804054399 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=877144 CPUtime=11.95 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 11390 0 0 0 1193 2 0 0 25 0 8 0 804054399 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=877144 CPUtime=12.19 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 286471 0 0 0 1183 36 0 0 25 0 8 0 804054399 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4327845 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=877144 CPUtime=12.18 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 17871 0 0 0 1215 3 0 0 25 0 8 0 804054399 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=877144 CPUtime=12.22 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 18435 0 0 0 1218 4 0 0 25 0 8 0 804054399 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4435037 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=877144 CPUtime=12.21 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 18638 0 0 0 1218 3 0 0 25 0 8 0 804054399 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=877144 CPUtime=12.22 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 17302 0 0 0 1219 3 0 0 25 0 8 0 804054399 898195456 160409 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 97.95
Current children cumulated vsize (KiB) 877144

[startup+25.5011 s]
/proc/loadavg: 8.02 8.02 7.97 9/536 5816
/proc/meminfo: memFree=28562236/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=1181792 CPUtime=200.09 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 773421 0 0 0 19899 110 0 0 25 0 8 0 804054352 1210155008 216285 33554432000 4194304 4625164 140734812017264 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 295448 216285 348 106 0 290951 0
[pid=5808/tid=5810] ppid=5806 vsize=1181792 CPUtime=25.02 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 20141 0 0 0 2499 3 0 0 25 0 8 0 804054399 1210155008 216285 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=1181792 CPUtime=24.71 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 20225 0 0 0 2467 4 0 0 25 0 8 0 804054399 1210155008 216285 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=1181792 CPUtime=24.8 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 568282 0 0 0 2404 76 0 0 25 0 8 0 804054399 1210155008 216285 33554432000 4194304 4625164 140734812017264 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=1181792 CPUtime=24.98 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 19938 0 0 0 2495 3 0 0 25 0 8 0 804054399 1210155008 216285 33554432000 4194304 4625164 140734812017264 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=1181792 CPUtime=25.02 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 21044 0 0 0 2498 4 0 0 25 0 8 0 804054399 1210155008 216285 33554432000 4194304 4625164 140734812017264 18446744073709551615 4349054 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=1181792 CPUtime=25.01 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 21466 0 0 0 2497 4 0 0 25 0 8 0 804054399 1210155008 216286 33554432000 4194304 4625164 140734812017264 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=1181792 CPUtime=25.01 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 19333 0 0 0 2498 3 0 0 25 0 8 0 804054399 1210155008 216286 33554432000 4194304 4625164 140734812017264 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 200.09
Current children cumulated vsize (KiB) 1181792

[startup+51.1006 s]
/proc/loadavg: 8.07 8.03 7.98 9/536 5817
/proc/meminfo: memFree=28168556/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=1619096 CPUtime=404.41 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 1440404 0 0 0 40236 205 0 0 25 0 8 0 804054352 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 404774 316352 348 106 0 400277 0
[pid=5808/tid=5810] ppid=5806 vsize=1619096 CPUtime=50.62 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 51398 0 0 0 5055 7 0 0 25 0 8 0 804054399 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=1619096 CPUtime=50.31 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 34379 0 0 0 5025 6 0 0 25 0 8 0 804054399 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=1619096 CPUtime=49.93 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 1122325 0 0 0 4842 151 0 0 25 0 8 0 804054399 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=1619096 CPUtime=50.58 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 34210 0 0 0 5052 6 0 0 25 0 8 0 804054399 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=1619096 CPUtime=50.61 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 35891 0 0 0 5055 6 0 0 25 0 8 0 804054399 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4348941 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=1619096 CPUtime=50.59 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 36865 0 0 0 5052 7 0 0 25 0 8 0 804054399 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4353224 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=1619096 CPUtime=50.61 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 33034 0 0 0 5056 5 0 0 25 0 8 0 804054399 1657954304 316352 33554432000 4194304 4625164 140734812017264 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 404.41

################
# More data... #
################

[pid=5808/tid=5812] ppid=5806 vsize=7597636 CPUtime=4574.97 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 35233526 0 0 0 451209 6288 0 0 25 0 8 0 804054399 7779979264 1666066 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=7597636 CPUtime=4661.85 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 345862 0 0 0 466100 85 0 0 25 0 8 0 804054399 7779979264 1666066 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=7597636 CPUtime=4661.25 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 97950 0 0 0 466102 23 0 0 25 0 8 0 804054399 7779979264 1666066 33554432000 4194304 4625164 140734812017264 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=7597636 CPUtime=4660.34 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 159413 0 0 0 465998 36 0 0 25 0 8 0 804054399 7779979264 1666066 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=7597636 CPUtime=4661.78 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 180240 0 0 0 466135 43 0 0 25 0 8 0 804054399 7779979264 1666066 33554432000 4194304 4625164 140734812017264 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37206.1
Current children cumulated vsize (KiB) 7597636

[startup+4722.3 s]
/proc/loadavg: 8.04 8.05 8.00 9/536 5954
/proc/meminfo: memFree=22717928/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=7663172 CPUtime=37685 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 40929914 0 0 0 3761042 7459 0 0 25 0 8 0 804054352 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 1915793 1673088 383 106 0 1911296 0
[pid=5808/tid=5810] ppid=5806 vsize=7663172 CPUtime=4721.93 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 176659 0 0 0 472151 42 0 0 25 0 8 0 804054399 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=7663172 CPUtime=4721.62 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 73977 0 0 0 472144 18 0 0 25 0 8 0 804054399 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=7663172 CPUtime=4633.86 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 35589560 0 0 0 457035 6351 0 0 25 0 8 0 804054399 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4352636 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=7663172 CPUtime=4721.87 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 345885 0 0 0 472102 85 0 0 25 0 8 0 804054399 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=7663172 CPUtime=4721.27 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 97993 0 0 0 472104 23 0 0 25 0 8 0 804054399 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=7663172 CPUtime=4720.34 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 159440 0 0 0 471998 36 0 0 25 0 8 0 804054399 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4330980 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=7663172 CPUtime=4721.8 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 180292 0 0 0 472137 43 0 0 25 0 8 0 804054399 7847088128 1673088 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37685
Current children cumulated vsize (KiB) 7663172

[startup+4782.3 s]
/proc/loadavg: 8.05 8.05 8.00 9/536 5955
/proc/meminfo: memFree=22696332/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=7663172 CPUtime=38163.8 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 41287003 0 0 0 3808861 7523 0 0 25 0 8 0 804054352 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 1915793 1675536 348 106 0 1911296 0
[pid=5808/tid=5810] ppid=5806 vsize=7663172 CPUtime=4781.91 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 176685 0 0 0 478149 42 0 0 25 0 8 0 804054399 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=7663172 CPUtime=4781.6 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 74007 0 0 0 478142 18 0 0 25 0 8 0 804054399 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4330839 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=7663172 CPUtime=4692.73 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 35946028 0 0 0 462859 6414 0 0 25 0 8 0 804054399 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=7663172 CPUtime=4781.85 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 345907 0 0 0 478100 85 0 0 25 0 8 0 804054399 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4488064 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=7663172 CPUtime=4781.25 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 98023 0 0 0 478102 23 0 0 25 0 8 0 804054399 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=7663172 CPUtime=4780.3 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 159466 0 0 0 477994 36 0 0 25 0 8 0 804054399 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=7663172 CPUtime=4781.78 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 180321 0 0 0 478135 43 0 0 25 0 8 0 804054399 7847088128 1675536 33554432000 4194304 4625164 140734812017264 18446744073709551615 4488027 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38163.8
Current children cumulated vsize (KiB) 7663172

[startup+4842.32 s]
/proc/loadavg: 8.10 8.06 8.01 9/536 5957
/proc/meminfo: memFree=22673484/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=7663172 CPUtime=38642.9 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 41634728 0 0 0 3856699 7587 0 0 25 0 8 0 804054352 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 1915793 1684412 372 106 0 1911296 0
[pid=5808/tid=5810] ppid=5806 vsize=7663172 CPUtime=4841.93 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 176713 0 0 0 484151 42 0 0 25 0 8 0 804054399 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=7663172 CPUtime=4841.62 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 74028 0 0 0 484144 18 0 0 25 0 8 0 804054399 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=7663172 CPUtime=4751.62 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 36293118 0 0 0 468684 6478 0 0 25 0 8 0 804054399 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=7663172 CPUtime=4841.88 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 345928 0 0 0 484103 85 0 0 25 0 8 0 804054399 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=7663172 CPUtime=4841.27 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 98066 0 0 0 484104 23 0 0 25 0 8 0 804054399 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=7663172 CPUtime=4840.31 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 159485 0 0 0 483995 36 0 0 25 0 8 0 804054399 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=7663172 CPUtime=4841.8 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 180364 0 0 0 484137 43 0 0 25 0 8 0 804054399 7847088128 1684412 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38642.9
Current children cumulated vsize (KiB) 7663172

[startup+4902.3 s]
/proc/loadavg: 8.11 8.06 8.00 9/536 5958
/proc/meminfo: memFree=22667012/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=7663172 CPUtime=39121.6 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 41932793 0 0 0 3904513 7642 0 0 25 0 8 0 804054352 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 1915793 1685889 348 106 0 1911296 0
[pid=5808/tid=5810] ppid=5806 vsize=7663172 CPUtime=4901.91 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 176740 0 0 0 490149 42 0 0 25 0 8 0 804054399 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=7663172 CPUtime=4901.6 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 74090 0 0 0 490142 18 0 0 25 0 8 0 804054399 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=7663172 CPUtime=4810.47 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 36589878 0 0 0 474516 6531 0 0 25 0 8 0 804054399 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4547483 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=7663172 CPUtime=4901.85 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 345955 0 0 0 490100 85 0 0 25 0 8 0 804054399 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=7663172 CPUtime=4901.25 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 98123 0 0 0 490102 23 0 0 25 0 8 0 804054399 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=7663172 CPUtime=4900.27 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 159508 0 0 0 489991 36 0 0 25 0 8 0 804054399 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=7663172 CPUtime=4901.79 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 180401 0 0 0 490135 44 0 0 25 0 8 0 804054399 7847088128 1685889 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39121.6
Current children cumulated vsize (KiB) 7663172

[startup+4962.3 s]
/proc/loadavg: 8.10 8.06 8.00 9/536 5960
/proc/meminfo: memFree=22632256/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=7728708 CPUtime=39600.4 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 42274628 0 0 0 3952338 7704 0 0 25 0 8 0 804054352 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 1932177 1694140 348 106 0 1927680 0
[pid=5808/tid=5810] ppid=5806 vsize=7728708 CPUtime=4961.91 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 176769 0 0 0 496149 42 0 0 25 0 8 0 804054399 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=7728708 CPUtime=4961.6 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 74106 0 0 0 496142 18 0 0 25 0 8 0 804054399 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=7728708 CPUtime=4869.34 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 36930735 0 0 0 480341 6593 0 0 25 0 8 0 804054399 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 228244046180 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=7728708 CPUtime=4961.85 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 345980 0 0 0 496100 85 0 0 25 0 8 0 804054399 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=7728708 CPUtime=4961.25 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 98164 0 0 0 496102 23 0 0 25 0 8 0 804054399 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=7728708 CPUtime=4960.25 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 159525 0 0 0 495989 36 0 0 25 0 8 0 804054399 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=7728708 CPUtime=4961.79 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 180441 0 0 0 496135 44 0 0 25 0 8 0 804054399 7914196992 1694140 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39600.4
Current children cumulated vsize (KiB) 7728708



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012.4 s]
/proc/loadavg: 8.19 8.09 8.01 9/536 5961
/proc/meminfo: memFree=22603720/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=7728708 CPUtime=40000.3 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) R 5806 5808 5567 0 -1 4202496 42593705 0 0 0 3992272 7761 0 0 25 0 8 0 804054352 7914196992 1701721 33554432000 4194304 4625164 140734812017264 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 1932177 1701721 380 106 0 1927680 0
[pid=5808/tid=5810] ppid=5806 vsize=7728708 CPUtime=5012.04 cores=0-7
/proc/5808/task/5810/stat : 5810 (SArTagnan) R 5806 5808 5567 0 -1 4202560 176791 0 0 0 501162 42 0 0 25 0 8 0 804054399 7914196992 1701722 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5808/tid=5811] ppid=5806 vsize=7728708 CPUtime=5011.72 cores=0-7
/proc/5808/task/5811/stat : 5811 (SArTagnan) R 5806 5808 5567 0 -1 4202560 74119 0 0 0 501154 18 0 0 25 0 8 0 804054399 7914196992 1701722 33554432000 4194304 4625164 140734812017264 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=7728708 CPUtime=4918.52 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4202560 37249511 0 0 0 485202 6650 0 0 25 0 8 0 804054399 7914196992 1701722 33554432000 4194304 4625164 140734812017264 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5808/tid=5813] ppid=5806 vsize=7728708 CPUtime=5011.97 cores=0-7
/proc/5808/task/5813/stat : 5813 (SArTagnan) R 5806 5808 5567 0 -1 4202560 346002 0 0 0 501112 85 0 0 25 0 8 0 804054399 7914196992 1701722 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5808/tid=5814] ppid=5806 vsize=7728708 CPUtime=5011.37 cores=0-7
/proc/5808/task/5814/stat : 5814 (SArTagnan) R 5806 5808 5567 0 -1 4202560 98201 0 0 0 501114 23 0 0 25 0 8 0 804054399 7914196992 1701722 33554432000 4194304 4625164 140734812017264 18446744073709551615 4460399 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5808/tid=5815] ppid=5806 vsize=7728708 CPUtime=5010.37 cores=0-7
/proc/5808/task/5815/stat : 5815 (SArTagnan) R 5806 5808 5567 0 -1 4202560 159536 0 0 0 501000 37 0 0 25 0 8 0 804054399 7914196992 1701722 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5808/tid=5816] ppid=5806 vsize=7728708 CPUtime=5011.91 cores=0-7
/proc/5808/task/5816/stat : 5816 (SArTagnan) R 5806 5808 5567 0 -1 4202560 180485 0 0 0 501147 44 0 0 25 0 8 0 804054399 7914196992 1701722 33554432000 4194304 4625164 140734812017264 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 7728708

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.7 s]
/proc/loadavg: 8.19 8.09 8.01 2/531 5962
/proc/meminfo: memFree=28744004/32951124 swapFree=58212616/67111528
[pid=5808] ppid=5806 vsize=0 CPUtime=40000.8 cores=0-7
/proc/5808/stat : 5808 (SArTagnan) Z 5806 5808 5567 0 -1 4203548 42593707 0 0 0 3992286 7789 0 0 25 0 2 0 804054352 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5808/statm: 0 0 0 0 0 0 0
[pid=5808/tid=5812] ppid=5806 vsize=0 CPUtime=4918.81 cores=0-7
/proc/5808/task/5812/stat : 5812 (SArTagnan) R 5806 5808 5567 0 -1 4203588 37249512 0 0 0 485202 6679 0 0 25 0 2 0 804054399 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.73
CPU time (s): 40000.8
CPU user time (s): 39922.9
CPU system time (s): 77.9222
CPU usage (%): 797.984
Max. virtual memory (cumulated for all children) (KiB): 7728708

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39922.9
system time used= 77.9222
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 42593707
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4313
involuntary context switches= 182218

runsolver used 24.5163 second user time and 69.2375 second system time

The end

Launcher Data 

Begin job on node136 at 2011-06-01 12:36:04
IDJOB=3438846
IDBENCH=83184
IDSOLVER=1936
FILE ID=node136/3438846-1306924563
RUNJOBID= node136-1306919549-5581
PBS_JOBID= 13488532
Free space on /tmp= 73688 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x39.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438846-1306924563/watcher-3438846-1306924563 -o /tmp/evaluation-result-3438846-1306924563/solver-3438846-1306924563 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438846-1306924563.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e7679ca49bb432c9b90305d907365c4e
RANDOM SEED=278038853

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29423844 kB
Buffers:        144832 kB
Cached:         284480 kB
SwapCached:       7704 kB
Active:        2975576 kB
Inactive:       272420 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29423844 kB
SwapTotal:    67111528 kB
SwapFree:     58212616 kB
Dirty:           15540 kB
Writeback:           0 kB
AnonPages:     2817736 kB
Mapped:          23836 kB
Slab:           136612 kB
PageTables:      68836 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 169212512 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73688 MiB
End job on node136 at 2011-06-01 13:59:38