Trace number 3438551

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.6 5012.12

General information on the benchmark

NameCRAFTED/rbsat/crafted/
forced/rbsat-v2400c266431gyes3.cnf
MD5SUMcef3d3066fec910e94448f2404c09548
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438551-1306919601/watcher-3438551-1306919601 -o /tmp/evaluation-result-3438551-1306919601/solver-3438551-1306919601 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438551-1306919601.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.96 1.01 0.99 1/520 22804
/proc/meminfo: memFree=20828756/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=26244 CPUtime=0.01 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 1198 0 0 0 1 0 0 0 25 0 1 0 882190813 26873856 635 33554432000 4194304 4625164 140733737657248 18446744073709551615 216735178496 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/22804/statm: 6561 635 296 106 0 2064 0

[startup+0.0996539 s]
/proc/loadavg: 0.96 1.01 0.99 1/520 22804
/proc/meminfo: memFree=20828756/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=127128 CPUtime=0.13 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 9207 0 0 0 13 0 0 0 25 0 8 0 882190813 130179072 7356 33554432000 4194304 4625164 140733737657248 18446744073709551615 47644232734632 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/22804/statm: 31782 7356 301 106 0 27285 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 127128

[startup+0.10065 s]
/proc/loadavg: 0.96 1.01 0.99 1/520 22804
/proc/meminfo: memFree=20828756/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=127128 CPUtime=0.14 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 9207 0 0 0 14 0 0 0 25 0 8 0 882190813 130179072 7356 33554432000 4194304 4625164 140733737657248 18446744073709551615 47644232734642 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/22804/statm: 31782 7356 301 106 0 27285 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 127128

[startup+0.300583 s]
/proc/loadavg: 0.96 1.01 0.99 1/520 22804
/proc/meminfo: memFree=20828756/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=526384 CPUtime=0.97 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 14890 0 0 0 94 3 0 0 18 0 8 0 882190813 539017216 12760 33554432000 4194304 4625164 140733737657248 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/22804/statm: 131596 12762 341 106 0 127099 0
Current children cumulated CPU time (s) 0.97
Current children cumulated vsize (KiB) 526384

[startup+0.700516 s]
/proc/loadavg: 0.96 1.01 0.99 1/520 22804
/proc/meminfo: memFree=20828756/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=545648 CPUtime=3.86 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 39072 0 0 0 379 7 0 0 18 0 8 0 882190813 558743552 28911 33554432000 4194304 4625164 140733737657248 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 136412 28911 375 106 0 131915 0
Current children cumulated CPU time (s) 3.86
Current children cumulated vsize (KiB) 545648

[startup+1.50038 s]
/proc/loadavg: 0.96 1.01 0.99 10/528 22812
/proc/meminfo: memFree=20702956/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=551244 CPUtime=10.25 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 44956 0 0 0 1016 9 0 0 19 0 8 0 882190813 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4519659 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 137811 34618 350 106 0 133314 0
[pid=22804/tid=22806] ppid=22802 vsize=551244 CPUtime=1.34 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 2765 0 0 0 134 0 0 0 19 0 8 0 882190820 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4353478 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=551244 CPUtime=1.27 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 2828 0 0 0 127 0 0 0 19 0 8 0 882190820 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4464187 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=551244 CPUtime=1.34 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 2889 0 0 0 134 0 0 0 19 0 8 0 882190820 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=551244 CPUtime=1.25 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 2765 0 0 0 125 0 0 0 19 0 8 0 882190820 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=551244 CPUtime=1.26 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 2590 0 0 0 126 0 0 0 18 0 8 0 882190820 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4319102 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=551244 CPUtime=1.26 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 2600 0 0 0 126 0 0 0 19 0 8 0 882190820 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=551244 CPUtime=1.23 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 2730 0 0 0 123 0 0 0 19 0 8 0 882190820 564473856 34618 33554432000 4194304 4625164 140733737657248 18446744073709551615 4467683 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10.25
Current children cumulated vsize (KiB) 551244

[startup+3.1011 s]
/proc/loadavg: 0.96 1.01 0.99 9/528 22812
/proc/meminfo: memFree=20671336/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=561880 CPUtime=23.03 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 56453 0 0 0 2292 11 0 0 22 0 8 0 882190813 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 140470 43026 352 106 0 135973 0
[pid=22804/tid=22806] ppid=22802 vsize=561880 CPUtime=2.93 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 3976 0 0 0 293 0 0 0 23 0 8 0 882190820 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=561880 CPUtime=2.85 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 4244 0 0 0 285 0 0 0 19 0 8 0 882190820 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4352859 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=561880 CPUtime=2.94 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 4985 0 0 0 294 0 0 0 19 0 8 0 882190820 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=561880 CPUtime=2.85 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 4145 0 0 0 284 1 0 0 19 0 8 0 882190820 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4467219 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=561880 CPUtime=2.87 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 4206 0 0 0 286 1 0 0 22 0 8 0 882190820 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4348854 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=561880 CPUtime=2.86 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 3992 0 0 0 286 0 0 0 23 0 8 0 882190820 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4469201 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=561880 CPUtime=2.83 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 3855 0 0 0 283 0 0 0 19 0 8 0 882190820 575365120 43026 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 23.03
Current children cumulated vsize (KiB) 561880

[startup+6.30053 s]
/proc/loadavg: 1.52 1.12 1.03 9/528 22812
/proc/meminfo: memFree=20604260/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=570156 CPUtime=48.56 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 84529 0 0 0 4841 15 0 0 25 0 8 0 882190813 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 142539 59996 370 106 0 138042 0
[pid=22804/tid=22806] ppid=22802 vsize=570156 CPUtime=6.14 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 6591 0 0 0 613 1 0 0 25 0 8 0 882190820 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=570156 CPUtime=5.99 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 6162 0 0 0 598 1 0 0 25 0 8 0 882190820 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=570156 CPUtime=6.14 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 14156 0 0 0 613 1 0 0 25 0 8 0 882190820 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4327764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=570156 CPUtime=6.05 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 6568 0 0 0 604 1 0 0 25 0 8 0 882190820 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=570156 CPUtime=6.07 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 6632 0 0 0 606 1 0 0 25 0 8 0 882190820 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4349320 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=570156 CPUtime=6.07 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 6097 0 0 0 606 1 0 0 25 0 8 0 882190820 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4334261 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=570156 CPUtime=6.02 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 4142 0 0 0 602 0 0 0 25 0 8 0 882190820 583839744 59996 33554432000 4194304 4625164 140733737657248 18446744073709551615 4276048 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.56
Current children cumulated vsize (KiB) 570156

[startup+12.7004 s]
/proc/loadavg: 2.04 1.23 1.07 9/528 22812
/proc/meminfo: memFree=20514788/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=608000 CPUtime=99.63 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 136086 0 0 0 9937 26 0 0 19 0 8 0 882190813 622592000 81526 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 152000 81526 394 106 0 147503 0
[pid=22804/tid=22806] ppid=22802 vsize=608000 CPUtime=12.53 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 10419 0 0 0 1252 1 0 0 25 0 8 0 882190820 622592000 81526 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=608000 CPUtime=12.27 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 9230 0 0 0 1226 1 0 0 25 0 8 0 882190820 622592000 81526 33554432000 4194304 4625164 140733737657248 18446744073709551615 4465766 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=608000 CPUtime=12.54 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 36186 0 0 0 1248 6 0 0 25 0 8 0 882190820 622592000 81526 33554432000 4194304 4625164 140733737657248 18446744073709551615 4339109 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=608000 CPUtime=12.43 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 10460 0 0 0 1242 1 0 0 25 0 8 0 882190820 622592000 81526 33554432000 4194304 4625164 140733737657248 18446744073709551615 4345240 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=608000 CPUtime=12.47 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 9900 0 0 0 1245 2 0 0 25 0 8 0 882190820 622592000 81526 33554432000 4194304 4625164 140733737657248 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=608000 CPUtime=12.46 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 10106 0 0 0 1244 2 0 0 25 0 8 0 882190820 622592000 81526 33554432000 4194304 4625164 140733737657248 18446744073709551615 4352098 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=608000 CPUtime=12.43 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 6558 0 0 0 1242 1 0 0 25 0 8 0 882190820 622592000 81528 33554432000 4194304 4625164 140733737657248 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.63
Current children cumulated vsize (KiB) 608000

[startup+25.5012 s]
/proc/loadavg: 3.36 1.57 1.18 9/528 22813
/proc/meminfo: memFree=20351404/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=669196 CPUtime=201.79 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 217062 0 0 0 20139 40 0 0 25 0 8 0 882190813 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 167299 120076 502 106 0 162802 0
[pid=22804/tid=22806] ppid=22802 vsize=669196 CPUtime=25.34 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 16095 0 0 0 2531 3 0 0 25 0 8 0 882190820 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=669196 CPUtime=24.84 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 10665 0 0 0 2482 2 0 0 25 0 8 0 882190820 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4317344 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=669196 CPUtime=25.34 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 81748 0 0 0 2521 13 0 0 25 0 8 0 882190820 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=669196 CPUtime=25.24 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 15508 0 0 0 2522 2 0 0 25 0 8 0 882190820 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=669196 CPUtime=25.27 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 14248 0 0 0 2524 3 0 0 25 0 8 0 882190820 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4349197 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=669196 CPUtime=25.26 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 19856 0 0 0 2523 3 0 0 25 0 8 0 882190820 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=669196 CPUtime=25.22 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 9591 0 0 0 2521 1 0 0 25 0 8 0 882190820 685256704 120076 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 201.79
Current children cumulated vsize (KiB) 669196

[startup+51.1007 s]
/proc/loadavg: 5.01 2.10 1.37 9/528 22813
/proc/meminfo: memFree=20176272/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=925852 CPUtime=406.14 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 362716 0 0 0 40547 67 0 0 25 0 8 0 882190813 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 231463 163449 646 106 0 226966 0
[pid=22804/tid=22806] ppid=22802 vsize=925852 CPUtime=50.94 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 23317 0 0 0 5090 4 0 0 25 0 8 0 882190820 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=925852 CPUtime=49.98 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 12706 0 0 0 4994 4 0 0 25 0 8 0 882190820 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=925852 CPUtime=50.94 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 176326 0 0 0 5067 27 0 0 25 0 8 0 882190820 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4352539 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=925852 CPUtime=50.83 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 22361 0 0 0 5080 3 0 0 25 0 8 0 882190820 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=925852 CPUtime=50.87 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 22557 0 0 0 5083 4 0 0 25 0 8 0 882190820 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4349125 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=925852 CPUtime=50.87 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 24630 0 0 0 5082 5 0 0 25 0 8 0 882190820 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=925852 CPUtime=50.82 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 11375 0 0 0 5080 2 0 0 25 0 8 0 882190820 948072448 163449 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 406.14

################
# More data... #
################

Current children cumulated vsize (KiB) 4640612

[startup+4722.32 s]
/proc/loadavg: 8.00 8.02 7.99 9/528 22950
/proc/meminfo: memFree=16924448/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=4640612 CPUtime=37688.9 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 34724611 0 0 0 3762675 6217 0 0 25 0 8 0 882190813 4751986688 974046 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 1160153 974046 349 106 0 1155656 0
[pid=22804/tid=22806] ppid=22802 vsize=4640612 CPUtime=4722.22 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 135822 0 0 0 472186 36 0 0 25 0 8 0 882190820 4751986688 974046 33554432000 4194304 4625164 140733737657248 18446744073709551615 4487250 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=4640612 CPUtime=4666.88 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 282540 0 0 0 466361 327 0 0 25 0 8 0 882190820 4751986688 974047 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=4640612 CPUtime=4691.51 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 33450735 0 0 0 463513 5638 0 0 25 0 8 0 882190820 4751986688 974047 33554432000 4194304 4625164 140733737657248 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=4640612 CPUtime=4719.92 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 138048 0 0 0 471961 31 0 0 25 0 8 0 882190820 4751986688 974047 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=4640612 CPUtime=4722.19 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 136333 0 0 0 472185 34 0 0 25 0 8 0 882190820 4751986688 974048 33554432000 4194304 4625164 140733737657248 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=4640612 CPUtime=4722.18 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 182925 0 0 0 472178 40 0 0 25 0 8 0 882190820 4751986688 974048 33554432000 4194304 4625164 140733737657248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=4640612 CPUtime=4721.96 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 83401 0 0 0 472150 46 0 0 25 0 8 0 882190820 4751986688 974048 33554432000 4194304 4625164 140733737657248 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37688.9
Current children cumulated vsize (KiB) 4640612

[startup+4782.3 s]
/proc/loadavg: 8.00 8.01 7.99 9/528 22951
/proc/meminfo: memFree=16905092/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=4706148 CPUtime=38167.6 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 35199141 0 0 0 3810464 6301 0 0 25 0 8 0 882190813 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 1176537 978944 349 106 0 1172040 0
[pid=22804/tid=22806] ppid=22802 vsize=4706148 CPUtime=4782.21 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 136030 0 0 0 478184 37 0 0 25 0 8 0 882190820 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4488051 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=4706148 CPUtime=4725.79 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 285938 0 0 0 472248 331 0 0 25 0 8 0 882190820 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=4706148 CPUtime=4751.49 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 33918387 0 0 0 469433 5716 0 0 25 0 8 0 882190820 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=4706148 CPUtime=4779.87 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 138255 0 0 0 477956 31 0 0 25 0 8 0 882190820 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=4706148 CPUtime=4782.17 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 136517 0 0 0 478183 34 0 0 25 0 8 0 882190820 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4329671 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=4706148 CPUtime=4782.16 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 183076 0 0 0 478176 40 0 0 25 0 8 0 882190820 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=4706148 CPUtime=4781.95 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 85890 0 0 0 478147 48 0 0 25 0 8 0 882190820 4819095552 978944 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38167.7
Current children cumulated vsize (KiB) 4706148

[startup+4842.3 s]
/proc/loadavg: 8.00 8.01 7.99 9/528 22953
/proc/meminfo: memFree=16879524/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=4771684 CPUtime=38646.6 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 35663899 0 0 0 3858274 6382 0 0 25 0 8 0 882190813 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 1192921 985703 349 106 0 1188424 0
[pid=22804/tid=22806] ppid=22802 vsize=4771684 CPUtime=4842.21 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 136166 0 0 0 484184 37 0 0 25 0 8 0 882190820 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=4771684 CPUtime=4784.69 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 286023 0 0 0 478138 331 0 0 25 0 8 0 882190820 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=4771684 CPUtime=4811.5 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 34381058 0 0 0 475354 5796 0 0 25 0 8 0 882190820 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=4771684 CPUtime=4839.86 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 138421 0 0 0 483955 31 0 0 25 0 8 0 882190820 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331194 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=4771684 CPUtime=4842.17 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 136749 0 0 0 484183 34 0 0 25 0 8 0 882190820 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=4771684 CPUtime=4842.15 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 183417 0 0 0 484175 40 0 0 25 0 8 0 882190820 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=4771684 CPUtime=4841.95 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 86388 0 0 0 484146 49 0 0 25 0 8 0 882190820 4886204416 985703 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38646.6
Current children cumulated vsize (KiB) 4771684

[startup+4902.3 s]
/proc/loadavg: 8.07 8.03 8.00 9/528 22955
/proc/meminfo: memFree=16860408/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=4771684 CPUtime=39125.5 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 36113417 0 0 0 3906091 6456 0 0 25 0 8 0 882190813 4886204416 989249 33554432000 4194304 4625164 140733737657248 18446744073709551615 4512887 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 1192921 989249 349 106 0 1188424 0
[pid=22804/tid=22806] ppid=22802 vsize=4771684 CPUtime=4902.21 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 136587 0 0 0 490184 37 0 0 25 0 8 0 882190820 4886204416 989249 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=4771684 CPUtime=4843.61 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 286045 0 0 0 484030 331 0 0 25 0 8 0 882190820 4886204416 989250 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=4771684 CPUtime=4871.49 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 34829001 0 0 0 481280 5869 0 0 25 0 8 0 882190820 4886204416 989250 33554432000 4194304 4625164 140733737657248 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=4771684 CPUtime=4899.85 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 138639 0 0 0 489954 31 0 0 25 0 8 0 882190820 4886204416 989250 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=4771684 CPUtime=4902.17 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 136975 0 0 0 490183 34 0 0 25 0 8 0 882190820 4886204416 989250 33554432000 4194304 4625164 140733737657248 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=4771684 CPUtime=4902.16 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 183666 0 0 0 490175 41 0 0 25 0 8 0 882190820 4886204416 989251 33554432000 4194304 4625164 140733737657248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=4771684 CPUtime=4901.95 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 86483 0 0 0 490146 49 0 0 25 0 8 0 882190820 4886204416 989251 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39125.5
Current children cumulated vsize (KiB) 4771684

[startup+4962.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/528 22956
/proc/meminfo: memFree=16822068/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=4774588 CPUtime=39604.4 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 36568216 0 0 0 3953904 6532 0 0 25 0 8 0 882190813 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 1193647 1000110 349 106 0 1189150 0
[pid=22804/tid=22806] ppid=22802 vsize=4774588 CPUtime=4962.21 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 137218 0 0 0 496184 37 0 0 25 0 8 0 882190820 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=4774588 CPUtime=4902.51 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 289936 0 0 0 489917 334 0 0 25 0 8 0 882190820 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=4774588 CPUtime=4931.5 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 35276743 0 0 0 487209 5941 0 0 25 0 8 0 882190820 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4552336 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=4774588 CPUtime=4959.82 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 138804 0 0 0 495951 31 0 0 25 0 8 0 882190820 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4330886 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=4774588 CPUtime=4962.17 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 137164 0 0 0 496183 34 0 0 25 0 8 0 882190820 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=4774588 CPUtime=4962.16 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 184126 0 0 0 496175 41 0 0 25 0 8 0 882190820 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=4774588 CPUtime=4961.95 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 87676 0 0 0 496145 50 0 0 25 0 8 0 882190820 4889178112 1000110 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39604.4
Current children cumulated vsize (KiB) 4774588



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.9 s]
/proc/loadavg: 8.02 8.03 8.00 9/528 22957
/proc/meminfo: memFree=16789184/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=4774588 CPUtime=40000.4 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) R 22802 22804 22778 0 -1 4202496 36939859 0 0 0 3993438 6599 0 0 25 0 8 0 882190813 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 1193647 1008205 349 106 0 1189150 0
[pid=22804/tid=22806] ppid=22802 vsize=4774588 CPUtime=5011.83 cores=0-7
/proc/22804/task/22806/stat : 22806 (SArTagnan) R 22802 22804 22778 0 -1 4202560 137372 0 0 0 501146 37 0 0 25 0 8 0 882190820 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=4774588 CPUtime=4951.21 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4202560 293978 0 0 0 494779 342 0 0 25 0 8 0 882190820 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22804/tid=22808] ppid=22802 vsize=4774588 CPUtime=4981.11 cores=0-7
/proc/22804/task/22808/stat : 22808 (SArTagnan) R 22802 22804 22778 0 -1 4202560 35643554 0 0 0 492113 5998 0 0 25 0 8 0 882190820 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22804/tid=22809] ppid=22802 vsize=4774588 CPUtime=5009.43 cores=0-7
/proc/22804/task/22809/stat : 22809 (SArTagnan) R 22802 22804 22778 0 -1 4202560 138936 0 0 0 500912 31 0 0 25 0 8 0 882190820 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4330791 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22804/tid=22810] ppid=22802 vsize=4774588 CPUtime=5011.79 cores=0-7
/proc/22804/task/22810/stat : 22810 (SArTagnan) R 22802 22804 22778 0 -1 4202560 137296 0 0 0 501145 34 0 0 25 0 8 0 882190820 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22804/tid=22811] ppid=22802 vsize=4774588 CPUtime=5011.78 cores=0-7
/proc/22804/task/22811/stat : 22811 (SArTagnan) R 22802 22804 22778 0 -1 4202560 184314 0 0 0 501137 41 0 0 25 0 8 0 882190820 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22804/tid=22812] ppid=22802 vsize=4774588 CPUtime=5011.58 cores=0-7
/proc/22804/task/22812/stat : 22812 (SArTagnan) R 22802 22804 22778 0 -1 4202560 87706 0 0 0 501108 50 0 0 25 0 8 0 882190820 4889178112 1008205 33554432000 4194304 4625164 140733737657248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 4774588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.03 s]
/proc/loadavg: 8.02 8.03 8.00 9/528 22957
/proc/meminfo: memFree=16789184/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=0 CPUtime=40000.5 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) Z 22802 22804 22778 0 -1 4203548 36939859 0 0 0 3993444 6609 0 0 25 0 2 0 882190813 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 0 0 0 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=0 CPUtime=4951.32 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4203588 293978 0 0 0 494780 352 0 0 25 0 2 0 882190820 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

[startup+5012.1 s]
/proc/loadavg: 8.02 8.03 8.00 9/528 22957
/proc/meminfo: memFree=16789184/32951124 swapFree=59042448/67111528
[pid=22804] ppid=22802 vsize=0 CPUtime=40000.6 cores=0-7
/proc/22804/stat : 22804 (SArTagnan) Z 22802 22804 22778 0 -1 4203548 36939859 0 0 0 3993444 6616 0 0 25 0 2 0 882190813 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22804/statm: 0 0 0 0 0 0 0
[pid=22804/tid=22807] ppid=22802 vsize=0 CPUtime=4951.4 cores=0-7
/proc/22804/task/22807/stat : 22807 (SArTagnan) R 22802 22804 22778 0 -1 4203588 293978 0 0 0 494780 360 0 0 25 0 2 0 882190820 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.12
CPU time (s): 40000.6
CPU user time (s): 39934.4
CPU system time (s): 66.1889
CPU usage (%): 798.078
Max. virtual memory (cumulated for all children) (KiB): 4774588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39934.4
system time used= 66.1889
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36939859
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11823
involuntary context switches= 169191

runsolver used 24.1453 second user time and 66.8508 second system time

The end

Launcher Data 

Begin job on node119 at 2011-06-01 11:13:22
IDJOB=3438551
IDBENCH=71549
IDSOLVER=1936
FILE ID=node119/3438551-1306919601
RUNJOBID= node119-1306919601-22792
PBS_JOBID= 13488539
Free space on /tmp= 73612 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v2400c266431gyes3.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438551-1306919601/watcher-3438551-1306919601 -o /tmp/evaluation-result-3438551-1306919601/solver-3438551-1306919601 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438551-1306919601.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= cef3d3066fec910e94448f2404c09548
RANDOM SEED=1337088254

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20828904 kB
Buffers:        294560 kB
Cached:        1863536 kB
SwapCached:       8708 kB
Active:        9078680 kB
Inactive:      2721324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20828904 kB
SwapTotal:    67111528 kB
SwapFree:     59042448 kB
Dirty:            3928 kB
Writeback:           0 kB
AnonPages:     9637048 kB
Mapped:          34096 kB
Slab:           172724 kB
PageTables:      78900 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 163853308 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73612 MiB
End job on node119 at 2011-06-01 12:36:56