Trace number 3438761

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.7 5012.77

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x14.cnf
MD5SUMf76302f2442dfc7cabc2315e61e55fea
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1176
Number of clauses78498
Sum of the clauses size310464
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21764
Number of clauses of size 30
Number of clauses of size 476734
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438761-1306922986/watcher-3438761-1306922986 -o /tmp/evaluation-result-3438761-1306922986/solver-3438761-1306922986 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438761-1306922986.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 8.07 7.79 1/554 15984
/proc/meminfo: memFree=30420572/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=22976 CPUtime=0.01 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 1766 0 0 0 1 0 0 0 23 0 1 0 803897261 23527424 1080 33554432000 4194304 4625164 140734053459920 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/15984/statm: 5744 1082 296 106 0 1247 0

[startup+0.0664491 s]
/proc/loadavg: 8.06 8.07 7.79 1/554 15984
/proc/meminfo: memFree=30420572/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=124112 CPUtime=0.1 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 9895 0 0 0 9 1 0 0 24 0 8 0 803897261 127090688 7813 33554432000 4194304 4625164 140734053459920 18446744073709551615 47323166726066 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 31028 7813 301 106 0 26531 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 124112

[startup+0.128198 s]
/proc/loadavg: 8.06 8.07 7.79 1/554 15984
/proc/meminfo: memFree=30420572/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=341492 CPUtime=0.52 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) D 15982 15984 15834 0 -1 4202496 14667 0 0 0 50 2 0 0 25 0 8 0 803897261 349687808 11299 33554432000 4194304 4625164 140734053459920 18446744073709551615 251814283447 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 84815 10899 343 106 0 80318 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 341492

[startup+0.370403 s]
/proc/loadavg: 8.06 8.07 7.79 1/554 15984
/proc/meminfo: memFree=30420572/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=411672 CPUtime=2.27 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 20439 0 0 0 224 3 0 0 25 0 8 0 803897261 421552128 14291 33554432000 4194304 4625164 140734053459920 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 102918 14292 345 106 0 98421 0
Current children cumulated CPU time (s) 2.27
Current children cumulated vsize (KiB) 411672

[startup+0.700347 s]
/proc/loadavg: 8.06 8.07 7.79 1/554 15984
/proc/meminfo: memFree=30420572/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=412792 CPUtime=4.92 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 26215 0 0 0 488 4 0 0 25 0 8 0 803897261 422699008 18300 33554432000 4194304 4625164 140734053459920 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 103198 18300 345 106 0 98701 0
Current children cumulated CPU time (s) 4.92
Current children cumulated vsize (KiB) 412792

[startup+1.50121 s]
/proc/loadavg: 8.06 8.07 7.79 9/562 15992
/proc/meminfo: memFree=30328756/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=427976 CPUtime=11.3 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 43966 0 0 0 1123 7 0 0 25 0 8 0 803897261 438247424 27586 33554432000 4194304 4625164 140734053459920 18446744073709551615 4396722 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 106994 27586 347 106 0 102497 0
[pid=15984/tid=15986] ppid=15982 vsize=427976 CPUtime=1.43 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 3068 0 0 0 143 0 0 0 20 0 8 0 803897266 438247424 27586 33554432000 4194304 4625164 140734053459920 18446744073709551615 251813900609 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=427976 CPUtime=1.43 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 3362 0 0 0 143 0 0 0 25 0 8 0 803897266 438247424 27586 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=427976 CPUtime=1.16 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 12835 0 0 0 115 1 0 0 25 0 8 0 803897266 438247424 27586 33554432000 4194304 4625164 140734053459920 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=427976 CPUtime=1.42 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 2908 0 0 0 142 0 0 0 20 0 8 0 803897266 438247424 27586 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=427976 CPUtime=1.43 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 3361 0 0 0 143 0 0 0 19 0 8 0 803897266 438247424 27586 33554432000 4194304 4625164 140734053459920 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=427976 CPUtime=1.43 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 2973 0 0 0 143 0 0 0 20 0 8 0 803897266 438247424 27587 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=427976 CPUtime=1.43 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 3099 0 0 0 143 0 0 0 19 0 8 0 803897266 438247424 27587 33554432000 4194304 4625164 140734053459920 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.3
Current children cumulated vsize (KiB) 427976

[startup+3.10095 s]
/proc/loadavg: 8.06 8.07 7.79 9/562 15992
/proc/meminfo: memFree=30277544/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=449700 CPUtime=24.06 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 79842 0 0 0 2392 14 0 0 25 0 8 0 803897261 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 112425 45160 348 106 0 107928 0
[pid=15984/tid=15986] ppid=15982 vsize=449700 CPUtime=3.03 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 5382 0 0 0 302 1 0 0 25 0 8 0 803897266 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=449700 CPUtime=3.03 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 6169 0 0 0 302 1 0 0 25 0 8 0 803897266 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=449700 CPUtime=2.74 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 31338 0 0 0 270 4 0 0 25 0 8 0 803897266 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=449700 CPUtime=3.02 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 5958 0 0 0 302 0 0 0 25 0 8 0 803897266 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352549 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=449700 CPUtime=3.03 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 6556 0 0 0 302 1 0 0 24 0 8 0 803897266 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4348867 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=449700 CPUtime=3.02 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 5262 0 0 0 302 0 0 0 25 0 8 0 803897266 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=449700 CPUtime=3.02 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 5270 0 0 0 301 1 0 0 25 0 8 0 803897266 460492800 45160 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.06
Current children cumulated vsize (KiB) 449700

[startup+6.30041 s]
/proc/loadavg: 8.06 8.07 7.79 9/562 15992
/proc/meminfo: memFree=30150580/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=489792 CPUtime=49.59 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 132760 0 0 0 4936 23 0 0 25 0 8 0 803897261 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 122448 71992 358 106 0 117951 0
[pid=15984/tid=15986] ppid=15982 vsize=489792 CPUtime=6.23 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 9237 0 0 0 621 2 0 0 25 0 8 0 803897266 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=489792 CPUtime=6.23 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 10865 0 0 0 621 2 0 0 25 0 8 0 803897266 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4485691 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=489792 CPUtime=5.88 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 58078 0 0 0 580 8 0 0 25 0 8 0 803897266 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=489792 CPUtime=6.22 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 8946 0 0 0 621 1 0 0 25 0 8 0 803897266 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=489792 CPUtime=6.23 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 10067 0 0 0 621 2 0 0 25 0 8 0 803897266 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4348870 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=489792 CPUtime=6.23 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 9639 0 0 0 621 2 0 0 25 0 8 0 803897266 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=489792 CPUtime=6.21 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 8998 0 0 0 620 1 0 0 25 0 8 0 803897266 501547008 71992 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.59
Current children cumulated vsize (KiB) 489792

[startup+12.7003 s]
/proc/loadavg: 8.05 8.07 7.79 9/562 15992
/proc/meminfo: memFree=29982620/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=806228 CPUtime=100.67 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 211929 0 0 0 10032 35 0 0 25 0 8 0 803897261 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 201557 114143 411 106 0 197060 0
[pid=15984/tid=15986] ppid=15982 vsize=806228 CPUtime=12.63 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 13886 0 0 0 1261 2 0 0 25 0 8 0 803897266 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=806228 CPUtime=12.63 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 17297 0 0 0 1260 3 0 0 25 0 8 0 803897266 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=806228 CPUtime=12.15 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 104575 0 0 0 1202 13 0 0 25 0 8 0 803897266 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4334603 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=806228 CPUtime=12.62 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 10571 0 0 0 1261 1 0 0 25 0 8 0 803897266 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=806228 CPUtime=12.62 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 16168 0 0 0 1259 3 0 0 25 0 8 0 803897266 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4349320 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=806228 CPUtime=12.62 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 15058 0 0 0 1260 2 0 0 25 0 8 0 803897266 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=806228 CPUtime=12.61 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 13996 0 0 0 1258 3 0 0 25 0 8 0 803897266 825577472 114143 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.67
Current children cumulated vsize (KiB) 806228

[startup+25.5012 s]
/proc/loadavg: 8.11 8.08 7.80 9/562 15993
/proc/meminfo: memFree=29695832/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=974052 CPUtime=202.83 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 331362 0 0 0 20220 63 0 0 25 0 8 0 803897261 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 243513 182348 451 106 0 239016 0
[pid=15984/tid=15986] ppid=15982 vsize=974052 CPUtime=25.44 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 22479 0 0 0 2539 5 0 0 25 0 8 0 803897266 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=974052 CPUtime=25.43 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 28316 0 0 0 2537 6 0 0 25 0 8 0 803897266 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=974052 CPUtime=24.71 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 162333 0 0 0 2447 24 0 0 25 0 8 0 803897266 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=974052 CPUtime=25.43 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 17164 0 0 0 2540 3 0 0 25 0 8 0 803897266 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=974052 CPUtime=25.43 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 25940 0 0 0 2536 7 0 0 25 0 8 0 803897266 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=974052 CPUtime=25.43 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 24273 0 0 0 2538 5 0 0 25 0 8 0 803897266 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=974052 CPUtime=25.42 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 22705 0 0 0 2537 5 0 0 25 0 8 0 803897266 997429248 182348 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 202.83
Current children cumulated vsize (KiB) 974052

[startup+51.1009 s]
/proc/loadavg: 8.07 8.07 7.81 9/562 15994
/proc/meminfo: memFree=29278136/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=1466780 CPUtime=407.13 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 534221 0 0 0 40610 103 0 0 25 0 8 0 803897261 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 366695 286626 348 106 0 362198 0
[pid=15984/tid=15986] ppid=15982 vsize=1466780 CPUtime=51.03 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 33833 0 0 0 5096 7 0 0 25 0 8 0 803897266 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=1466780 CPUtime=51.03 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 43545 0 0 0 5093 10 0 0 25 0 8 0 803897266 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=1466780 CPUtime=49.84 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 267221 0 0 0 4940 44 0 0 25 0 8 0 803897266 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=1466780 CPUtime=51.02 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 32733 0 0 0 5097 5 0 0 25 0 8 0 803897266 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=1466780 CPUtime=51.02 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 40191 0 0 0 5092 10 0 0 25 0 8 0 803897266 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=1466780 CPUtime=51.03 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 36874 0 0 0 5094 9 0 0 25 0 8 0 803897266 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=1466780 CPUtime=51.01 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 34591 0 0 0 5093 8 0 0 25 0 8 0 803897266 1501982720 286626 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.13

################
# More data... #
################

[pid=15984/tid=15988] ppid=15982 vsize=6243168 CPUtime=4571.93 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 7551192 0 0 0 455692 1501 0 0 25 0 8 0 803897266 6393004032 1363403 33554432000 4194304 4625164 140734053459920 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=6243168 CPUtime=4662.28 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 198376 0 0 0 466170 58 0 0 25 0 8 0 803897266 6393004032 1363403 33554432000 4194304 4625164 140734053459920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=6243168 CPUtime=4662.14 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 101187 0 0 0 466184 30 0 0 25 0 8 0 803897266 6393004032 1363403 33554432000 4194304 4625164 140734053459920 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=6243168 CPUtime=4662.29 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 178264 0 0 0 466180 49 0 0 25 0 8 0 803897266 6393004032 1363403 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=6243168 CPUtime=4660.79 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 191058 0 0 0 466034 45 0 0 25 0 8 0 803897266 6393004032 1363403 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37205.6
Current children cumulated vsize (KiB) 6243168

[startup+4722.3 s]
/proc/loadavg: 8.07 8.08 8.02 9/562 16130
/proc/meminfo: memFree=24941796/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=6308704 CPUtime=37684.6 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 10242439 0 0 0 3766312 2143 0 0 25 0 8 0 803897261 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 1577176 1366886 356 106 0 1572679 0
[pid=15984/tid=15986] ppid=15982 vsize=6308704 CPUtime=4722.3 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 391199 0 0 0 472136 94 0 0 25 0 8 0 803897266 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=6308704 CPUtime=4721.49 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 99564 0 0 0 472124 25 0 0 25 0 8 0 803897266 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=6308704 CPUtime=4630.77 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 7648765 0 0 0 461556 1521 0 0 25 0 8 0 803897266 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=6308704 CPUtime=4722.3 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 198383 0 0 0 472172 58 0 0 25 0 8 0 803897266 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=6308704 CPUtime=4722.16 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 101195 0 0 0 472186 30 0 0 25 0 8 0 803897266 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=6308704 CPUtime=4722.31 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 178270 0 0 0 472182 49 0 0 25 0 8 0 803897266 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=6308704 CPUtime=4720.8 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 191068 0 0 0 472035 45 0 0 25 0 8 0 803897266 6460112896 1366886 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37684.6
Current children cumulated vsize (KiB) 6308704

[startup+4782.3 s]
/proc/loadavg: 8.02 8.06 8.02 9/562 16132
/proc/meminfo: memFree=24924280/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=6308704 CPUtime=38163.2 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 10338605 0 0 0 3814157 2164 0 0 25 0 8 0 803897261 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 1577176 1369903 368 106 0 1572679 0
[pid=15984/tid=15986] ppid=15982 vsize=6308704 CPUtime=4782.28 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 391205 0 0 0 478134 94 0 0 25 0 8 0 803897266 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=6308704 CPUtime=4781.47 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 99571 0 0 0 478122 25 0 0 25 0 8 0 803897266 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=6308704 CPUtime=4689.59 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 7744600 0 0 0 467417 1542 0 0 25 0 8 0 803897266 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4327875 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=6308704 CPUtime=4782.28 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 198390 0 0 0 478170 58 0 0 25 0 8 0 803897266 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=6308704 CPUtime=4782.13 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 101202 0 0 0 478183 30 0 0 25 0 8 0 803897266 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=6308704 CPUtime=4782.29 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 178277 0 0 0 478180 49 0 0 25 0 8 0 803897266 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=6308704 CPUtime=4780.75 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 191075 0 0 0 478030 45 0 0 25 0 8 0 803897266 6460112896 1369903 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38163.2
Current children cumulated vsize (KiB) 6308704

[startup+4842.32 s]
/proc/loadavg: 8.07 8.06 8.02 9/562 16133
/proc/meminfo: memFree=24920656/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=6308704 CPUtime=38642.2 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 10428974 0 0 0 3862036 2184 0 0 25 0 8 0 803897261 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 1577176 1371980 350 106 0 1572679 0
[pid=15984/tid=15986] ppid=15982 vsize=6308704 CPUtime=4842.3 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 391212 0 0 0 484136 94 0 0 25 0 8 0 803897266 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=6308704 CPUtime=4841.49 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 99577 0 0 0 484124 25 0 0 25 0 8 0 803897266 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=6308704 CPUtime=4748.44 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 7834341 0 0 0 473283 1561 0 0 25 0 8 0 803897266 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4334441 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=6308704 CPUtime=4842.3 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 198396 0 0 0 484172 58 0 0 25 0 8 0 803897266 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=6308704 CPUtime=4842.15 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 101210 0 0 0 484185 30 0 0 25 0 8 0 803897266 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=6308704 CPUtime=4842.32 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 178283 0 0 0 484183 49 0 0 25 0 8 0 803897266 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=6308704 CPUtime=4840.75 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 191082 0 0 0 484030 45 0 0 25 0 8 0 803897266 6460112896 1371980 33554432000 4194304 4625164 140734053459920 18446744073709551615 4330822 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38642.2
Current children cumulated vsize (KiB) 6308704

[startup+4902.3 s]
/proc/loadavg: 8.02 8.05 8.01 9/562 16135
/proc/meminfo: memFree=24906364/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=6308704 CPUtime=39120.9 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 10519204 0 0 0 3909884 2203 0 0 25 0 8 0 803897261 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 1577176 1375795 351 106 0 1572679 0
[pid=15984/tid=15986] ppid=15982 vsize=6308704 CPUtime=4902.28 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 391218 0 0 0 490134 94 0 0 25 0 8 0 803897266 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=6308704 CPUtime=4901.47 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 99584 0 0 0 490122 25 0 0 25 0 8 0 803897266 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=6308704 CPUtime=4807.26 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 7924196 0 0 0 479146 1580 0 0 25 0 8 0 803897266 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4548692 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=6308704 CPUtime=4902.28 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 198402 0 0 0 490170 58 0 0 25 0 8 0 803897266 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=6308704 CPUtime=4902.13 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 101216 0 0 0 490183 30 0 0 25 0 8 0 803897266 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=6308704 CPUtime=4902.3 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 178288 0 0 0 490181 49 0 0 25 0 8 0 803897266 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=6308704 CPUtime=4900.73 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 191089 0 0 0 490027 46 0 0 25 0 8 0 803897266 6460112896 1375795 33554432000 4194304 4625164 140734053459920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39120.9
Current children cumulated vsize (KiB) 6308704

[startup+4962.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/562 16136
/proc/meminfo: memFree=24896048/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=6308704 CPUtime=39599.7 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 10604900 0 0 0 3957745 2222 0 0 25 0 8 0 803897261 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 1577176 1378362 349 106 0 1572679 0
[pid=15984/tid=15986] ppid=15982 vsize=6308704 CPUtime=4962.28 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 391225 0 0 0 496134 94 0 0 25 0 8 0 803897266 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=6308704 CPUtime=4961.47 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 99590 0 0 0 496122 25 0 0 25 0 8 0 803897266 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=6308704 CPUtime=4866.09 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 8009781 0 0 0 485010 1599 0 0 25 0 8 0 803897266 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=6308704 CPUtime=4962.28 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 198409 0 0 0 496170 58 0 0 25 0 8 0 803897266 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=6308704 CPUtime=4962.13 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 101224 0 0 0 496183 30 0 0 25 0 8 0 803897266 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=6308704 CPUtime=4962.3 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 178294 0 0 0 496181 49 0 0 25 0 8 0 803897266 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=6308704 CPUtime=4960.7 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 191096 0 0 0 496024 46 0 0 25 0 8 0 803897266 6460112896 1378362 33554432000 4194304 4625164 140734053459920 18446744073709551615 4488056 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39599.7
Current children cumulated vsize (KiB) 6308704



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012.5 s]
/proc/loadavg: 8.06 8.05 8.00 9/562 16138
/proc/meminfo: memFree=24879164/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=6380664 CPUtime=40000.4 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) R 15982 15984 15834 0 -1 4202496 10662694 0 0 0 3997809 2233 0 0 25 0 8 0 803897261 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 1595166 1382487 366 106 0 1590669 0
[pid=15984/tid=15986] ppid=15982 vsize=6380664 CPUtime=5012.51 cores=0-7
/proc/15984/task/15986/stat : 15986 (SArTagnan) R 15982 15984 15834 0 -1 4202560 391231 0 0 0 501157 94 0 0 25 0 8 0 803897266 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=15984/tid=15987] ppid=15982 vsize=6380664 CPUtime=5011.69 cores=0-7
/proc/15984/task/15987/stat : 15987 (SArTagnan) R 15982 15984 15834 0 -1 4202560 99623 0 0 0 501144 25 0 0 25 0 8 0 803897266 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=6380664 CPUtime=4915.33 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4202560 8067494 0 0 0 489923 1610 0 0 25 0 8 0 803897266 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=15984/tid=15989] ppid=15982 vsize=6380664 CPUtime=5012.5 cores=0-7
/proc/15984/task/15989/stat : 15989 (SArTagnan) R 15982 15984 15834 0 -1 4202560 198414 0 0 0 501192 58 0 0 25 0 8 0 803897266 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=15984/tid=15990] ppid=15982 vsize=6380664 CPUtime=5012.35 cores=0-7
/proc/15984/task/15990/stat : 15990 (SArTagnan) R 15982 15984 15834 0 -1 4202560 101230 0 0 0 501205 30 0 0 25 0 8 0 803897266 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=15984/tid=15991] ppid=15982 vsize=6380664 CPUtime=5012.52 cores=0-7
/proc/15984/task/15991/stat : 15991 (SArTagnan) R 15982 15984 15834 0 -1 4202560 178300 0 0 0 501203 49 0 0 25 0 8 0 803897266 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=15984/tid=15992] ppid=15982 vsize=6380664 CPUtime=5010.91 cores=0-7
/proc/15984/task/15992/stat : 15992 (SArTagnan) R 15982 15984 15834 0 -1 4202560 191106 0 0 0 501045 46 0 0 25 0 8 0 803897266 6533799936 1382487 33554432000 4194304 4625164 140734053459920 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 6380664

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.7 s]
/proc/loadavg: 8.06 8.05 8.00 2/557 16139
/proc/meminfo: memFree=28589532/32950928 swapFree=41528364/67111528
[pid=15984] ppid=15982 vsize=0 CPUtime=40000.7 cores=0-7
/proc/15984/stat : 15984 (SArTagnan) Z 15982 15984 15834 0 -1 4203548 10662694 0 0 0 3997816 2252 0 0 25 0 2 0 803897261 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/15984/statm: 0 0 0 0 0 0 0
[pid=15984/tid=15988] ppid=15982 vsize=0 CPUtime=4915.52 cores=0-7
/proc/15984/task/15988/stat : 15988 (SArTagnan) R 15982 15984 15834 0 -1 4203588 8067494 0 0 0 489923 1629 0 0 25 0 2 0 803897266 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.77
CPU time (s): 40000.7
CPU user time (s): 39978.2
CPU system time (s): 22.5816
CPU usage (%): 797.976
Max. virtual memory (cumulated for all children) (KiB): 6380664

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39978.2
system time used= 22.5816
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10662694
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2889
involuntary context switches= 184035

runsolver used 25.1862 second user time and 71.7921 second system time

The end

Launcher Data 

Begin job on node126 at 2011-06-01 12:09:46
IDJOB=3438761
IDBENCH=83167
IDSOLVER=1936
FILE ID=node126/3438761-1306922986
RUNJOBID= node126-1306920035-15848
PBS_JOBID= 13488542
Free space on /tmp= 73668 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x14.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438761-1306922986/watcher-3438761-1306922986 -o /tmp/evaluation-result-3438761-1306922986/solver-3438761-1306922986 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438761-1306922986.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f76302f2442dfc7cabc2315e61e55fea
RANDOM SEED=1838590673

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30420852 kB
Buffers:        180372 kB
Cached:         276156 kB
SwapCached:      15328 kB
Active:        1912060 kB
Inactive:       299096 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30420852 kB
SwapTotal:    67111528 kB
SwapFree:     41528364 kB
Dirty:            1976 kB
Writeback:           0 kB
AnonPages:     1752916 kB
Mapped:          23280 kB
Slab:           145216 kB
PageTables:     100156 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 176376080 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73668 MiB
End job on node126 at 2011-06-01 13:33:20