Trace number 3438711

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.9 5012.92

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x34.cnf
MD5SUM1633295f58c28a5b4150be8640bdf9df
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables816
Number of clauses35088
Sum of the clauses size137904
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21224
Number of clauses of size 30
Number of clauses of size 433864
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438711-1306922151/watcher-3438711-1306922151 -o /tmp/evaluation-result-3438711-1306922151/solver-3438711-1306922151 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438711-1306922151.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 8.06 8.00 2/551 19760
/proc/meminfo: memFree=28997284/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=21932 CPUtime=0.01 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 1776 0 0 0 1 0 0 0 25 0 1 0 882445760 22458368 1041 33554432000 4194304 4625164 140736020914816 18446744073709551615 224284925696 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/19760/statm: 5483 1041 296 106 0 986 0

[startup+0.117131 s]
/proc/loadavg: 8.04 8.06 8.00 2/551 19760
/proc/meminfo: memFree=28997284/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=445776 CPUtime=1.78 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 12395 0 0 0 176 2 0 0 18 0 8 0 882445760 456474624 8397 33554432000 4194304 4625164 140736020914816 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 112576 9732 345 106 0 108079 0
Current children cumulated CPU time (s) 1.78
Current children cumulated vsize (KiB) 445776

[startup+0.727836 s]
/proc/loadavg: 8.04 8.06 8.00 2/551 19760
/proc/meminfo: memFree=28997284/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=460020 CPUtime=6.21 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 28055 0 0 0 616 5 0 0 18 0 8 0 882445760 471060480 17485 33554432000 4194304 4625164 140736020914816 18446744073709551615 4337104 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 115005 17485 349 106 0 110508 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 460020

[startup+0.924827 s]
/proc/loadavg: 8.04 8.06 8.00 2/551 19760
/proc/meminfo: memFree=28997284/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=459004 CPUtime=7.32 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 31521 0 0 0 726 6 0 0 19 0 8 0 882445760 470020096 19518 33554432000 4194304 4625164 140736020914816 18446744073709551615 4356616 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 114751 19542 348 106 0 110254 0
Current children cumulated CPU time (s) 7.32
Current children cumulated vsize (KiB) 459004

[startup+1.05026 s]
/proc/loadavg: 8.04 8.06 8.00 2/551 19760
/proc/meminfo: memFree=28997284/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=458040 CPUtime=8.12 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 33685 0 0 0 806 6 0 0 19 0 8 0 882445760 469032960 20749 33554432000 4194304 4625164 140736020914816 18446744073709551615 4424873 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 114510 20749 348 106 0 110013 0
Current children cumulated CPU time (s) 8.12
Current children cumulated vsize (KiB) 458040

[startup+1.90985 s]
/proc/loadavg: 8.04 8.06 8.00 2/551 19760
/proc/meminfo: memFree=28997284/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=469872 CPUtime=15.33 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 54679 0 0 0 1523 10 0 0 21 0 8 0 882445760 481148928 32429 33554432000 4194304 4625164 140736020914816 18446744073709551615 4338016 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 117468 32429 348 106 0 112971 0
Current children cumulated CPU time (s) 15.33
Current children cumulated vsize (KiB) 469872

[startup+3.10093 s]
/proc/loadavg: 8.12 8.07 8.01 9/559 19768
/proc/meminfo: memFree=28851528/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=483980 CPUtime=24.51 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 78000 0 0 0 2435 16 0 0 25 0 8 0 882445760 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 120995 47066 348 106 0 116498 0
[pid=19760/tid=19762] ppid=19758 vsize=483980 CPUtime=3.06 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 6509 0 0 0 306 0 0 0 25 0 8 0 882445763 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=483980 CPUtime=3 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 6463 0 0 0 299 1 0 0 25 0 8 0 882445763 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=483980 CPUtime=3.02 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 31222 0 0 0 297 5 0 0 21 0 8 0 882445763 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=483980 CPUtime=3.06 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 4686 0 0 0 305 1 0 0 25 0 8 0 882445763 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=483980 CPUtime=3.06 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 6131 0 0 0 305 1 0 0 25 0 8 0 882445763 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4441303 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=483980 CPUtime=3.07 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 7327 0 0 0 305 2 0 0 19 0 8 0 882445763 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=483980 CPUtime=3.06 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 6576 0 0 0 306 0 0 0 25 0 8 0 882445763 495595520 47066 33554432000 4194304 4625164 140736020914816 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.51
Current children cumulated vsize (KiB) 483980

[startup+6.3004 s]
/proc/loadavg: 8.12 8.07 8.01 9/559 19768
/proc/meminfo: memFree=28717360/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=526328 CPUtime=50.03 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 129160 0 0 0 4979 24 0 0 25 0 8 0 882445760 538959872 75928 33554432000 4194304 4625164 140736020914816 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 131582 75928 348 106 0 127085 0
[pid=19760/tid=19762] ppid=19758 vsize=526328 CPUtime=6.26 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 10299 0 0 0 625 1 0 0 25 0 8 0 882445763 538959872 75929 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=526328 CPUtime=6.21 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 10432 0 0 0 618 3 0 0 25 0 8 0 882445763 538959872 75929 33554432000 4194304 4625164 140736020914816 18446744073709551615 224284587041 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=526328 CPUtime=6.16 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 55580 0 0 0 608 8 0 0 25 0 8 0 882445763 538959872 75929 33554432000 4194304 4625164 140736020914816 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=526328 CPUtime=6.26 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 10146 0 0 0 624 2 0 0 25 0 8 0 882445763 538959872 75929 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=526328 CPUtime=6.26 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 10048 0 0 0 624 2 0 0 25 0 8 0 882445763 538959872 75929 33554432000 4194304 4625164 140736020914816 18446744073709551615 4349015 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=526328 CPUtime=6.27 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 11875 0 0 0 624 3 0 0 25 0 8 0 882445763 538959872 75929 33554432000 4194304 4625164 140736020914816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=526328 CPUtime=6.27 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 10357 0 0 0 626 1 0 0 25 0 8 0 882445763 538959872 75929 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.03
Current children cumulated vsize (KiB) 526328

[startup+12.7013 s]
/proc/loadavg: 8.10 8.07 8.00 9/559 19768
/proc/meminfo: memFree=28514876/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=862068 CPUtime=101.11 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 216027 0 0 0 10072 39 0 0 25 0 8 0 882445760 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 215517 124965 397 106 0 211020 0
[pid=19760/tid=19762] ppid=19758 vsize=862068 CPUtime=12.66 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 15978 0 0 0 1264 2 0 0 25 0 8 0 882445763 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=862068 CPUtime=12.6 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 19249 0 0 0 1256 4 0 0 25 0 8 0 882445763 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=862068 CPUtime=12.44 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 97816 0 0 0 1230 14 0 0 25 0 8 0 882445763 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=862068 CPUtime=12.66 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 15630 0 0 0 1264 2 0 0 25 0 8 0 882445763 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352596 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=862068 CPUtime=12.66 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 15889 0 0 0 1262 4 0 0 25 0 8 0 882445763 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4349779 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=862068 CPUtime=12.66 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 19110 0 0 0 1262 4 0 0 25 0 8 0 882445763 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=862068 CPUtime=12.66 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 15797 0 0 0 1264 2 0 0 25 0 8 0 882445763 882757632 124965 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.11
Current children cumulated vsize (KiB) 862068

[startup+25.5222 s]
/proc/loadavg: 8.16 8.08 8.01 9/559 19768
/proc/meminfo: memFree=28218960/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=1075272 CPUtime=203.4 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 359255 0 0 0 20274 66 0 0 25 0 8 0 882445760 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4511948 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 268818 194902 348 106 0 264321 0
[pid=19760/tid=19762] ppid=19758 vsize=1075272 CPUtime=25.49 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 25016 0 0 0 2545 4 0 0 25 0 8 0 882445763 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=1075272 CPUtime=25.41 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 29665 0 0 0 2535 6 0 0 25 0 8 0 882445763 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4462569 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=1075272 CPUtime=25 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 172853 0 0 0 2474 26 0 0 25 0 8 0 882445763 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=1075272 CPUtime=25.48 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 23790 0 0 0 2544 4 0 0 18 0 8 0 882445763 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=1075272 CPUtime=25.48 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 29345 0 0 0 2541 7 0 0 25 0 8 0 882445763 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4348841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=1075272 CPUtime=25.48 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 29232 0 0 0 2541 7 0 0 25 0 8 0 882445763 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=1075272 CPUtime=25.49 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 25078 0 0 0 2545 4 0 0 25 0 8 0 882445763 1101078528 194902 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.4
Current children cumulated vsize (KiB) 1075272

[startup+51.1009 s]
/proc/loadavg: 8.10 8.07 8.01 9/559 19768
/proc/meminfo: memFree=27808236/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=1539864 CPUtime=407.55 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 583888 0 0 0 40644 111 0 0 25 0 8 0 882445760 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 384966 298291 348 106 0 380469 0
[pid=19760/tid=19762] ppid=19758 vsize=1539864 CPUtime=51.07 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 37022 0 0 0 5100 7 0 0 25 0 8 0 882445763 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=1539864 CPUtime=50.99 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 43667 0 0 0 5089 10 0 0 25 0 8 0 882445763 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=1539864 CPUtime=50.09 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 299365 0 0 0 4963 46 0 0 23 0 8 0 882445763 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=1539864 CPUtime=51.06 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 36128 0 0 0 5100 6 0 0 25 0 8 0 882445763 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=1539864 CPUtime=51.06 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 47386 0 0 0 5094 12 0 0 25 0 8 0 882445763 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4348867 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=1539864 CPUtime=51.06 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 46489 0 0 0 5093 13 0 0 25 0 8 0 882445763 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4339546 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=1539864 CPUtime=51.06 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 37055 0 0 0 5100 6 0 0 25 0 8 0 882445763 1576820736 298291 33554432000 4194304 4625164 140736020914816 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.55
Current children cumulated vsize (KiB) 1539864

[startup+102.3 s]
/proc/loadavg: 8.10 8.08 8.01 9/559 19770
/proc/meminfo: memFree=27168776/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=2258048 CPUtime=816.15 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 970139 0 0 0 81433 182 0 0 25 0 8 0 882445760 2312241152 460941 33554432000 4194304 4625164 140736020914816 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 564512 460941 348 106 0 560015 0
[pid=19760/tid=19762] ppid=19758 vsize=2258048 CPUtime=102.27 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 58031 0 0 0 10217 10 0 0 25 0 8 0 882445763 2312241152 460941 33554432000 4194304 4625164 140736020914816 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=2258048 CPUtime=102.17 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 71913 0 0 0 10200 17 0 0 25 0 8 0 882445763 2312241152 460941 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=2258048 CPUtime=100.32 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 513201 0 0 0 9953 79 0 0 25 0 8 0 882445763 2312241152 460941 33554432000 4194304 4625164 140736020914816 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 7 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 7034744

[startup+4722.3 s]
/proc/loadavg: 8.04 8.05 8.01 9/559 19915
/proc/meminfo: memFree=22804272/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=7034744 CPUtime=37683.8 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 15384708 0 0 0 3765273 3105 0 0 25 0 8 0 882445760 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4512138 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 1758686 1545271 369 106 0 1754189 0
[pid=19760/tid=19762] ppid=19758 vsize=7034744 CPUtime=4722.31 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 407982 0 0 0 472126 105 0 0 25 0 8 0 882445763 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=7034744 CPUtime=4720.83 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 114898 0 0 0 472049 34 0 0 25 0 8 0 882445763 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=7034744 CPUtime=4629.25 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 11066853 0 0 0 460829 2096 0 0 25 0 8 0 882445763 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=7034744 CPUtime=4722.3 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408254 0 0 0 472125 105 0 0 25 0 8 0 882445763 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=7034744 CPUtime=4722.13 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 113389 0 0 0 472175 38 0 0 25 0 8 0 882445763 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=7034744 CPUtime=4722.29 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 166575 0 0 0 472178 51 0 0 25 0 8 0 882445763 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=7034744 CPUtime=4722.32 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 305534 0 0 0 472139 93 0 0 25 0 8 0 882445763 7203577856 1545271 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37683.8
Current children cumulated vsize (KiB) 7034744

[startup+4782.3 s]
/proc/loadavg: 8.08 8.06 8.01 9/559 19915
/proc/meminfo: memFree=22789232/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=7034744 CPUtime=38162.6 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 15643741 0 0 0 3813096 3163 0 0 25 0 8 0 882445760 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 1758686 1549675 365 106 0 1754189 0
[pid=19760/tid=19762] ppid=19758 vsize=7034744 CPUtime=4782.31 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 407995 0 0 0 478126 105 0 0 25 0 8 0 882445763 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=7034744 CPUtime=4780.82 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 114911 0 0 0 478048 34 0 0 25 0 8 0 882445763 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=7034744 CPUtime=4688.06 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 11251111 0 0 0 466669 2137 0 0 25 0 8 0 882445763 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=7034744 CPUtime=4782.3 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408270 0 0 0 478125 105 0 0 25 0 8 0 882445763 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=7034744 CPUtime=4782.13 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 113427 0 0 0 478175 38 0 0 25 0 8 0 882445763 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=7034744 CPUtime=4782.29 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 166587 0 0 0 478178 51 0 0 25 0 8 0 882445763 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=7034744 CPUtime=4782.32 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 305551 0 0 0 478139 93 0 0 25 0 8 0 882445763 7203577856 1549675 33554432000 4194304 4625164 140736020914816 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38162.6
Current children cumulated vsize (KiB) 7034744

[startup+4842.3 s]
/proc/loadavg: 8.09 8.06 8.01 9/559 19917
/proc/meminfo: memFree=22771252/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=7034744 CPUtime=38641.5 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 15889463 0 0 0 3860942 3209 0 0 25 0 8 0 882445760 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4393127 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 1758686 1553586 371 106 0 1754189 0
[pid=19760/tid=19762] ppid=19758 vsize=7034744 CPUtime=4842.33 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408013 0 0 0 484128 105 0 0 25 0 8 0 882445763 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4330793 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=7034744 CPUtime=4840.81 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 114936 0 0 0 484047 34 0 0 25 0 8 0 882445763 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=7034744 CPUtime=4746.9 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 11420886 0 0 0 472521 2169 0 0 25 0 8 0 882445763 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=7034744 CPUtime=4842.32 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408283 0 0 0 484127 105 0 0 25 0 8 0 882445763 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=7034744 CPUtime=4842.15 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 113464 0 0 0 484177 38 0 0 25 0 8 0 882445763 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=7034744 CPUtime=4842.31 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 166600 0 0 0 484180 51 0 0 25 0 8 0 882445763 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=7034744 CPUtime=4842.35 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 305581 0 0 0 484142 93 0 0 25 0 8 0 882445763 7203577856 1553586 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38641.5
Current children cumulated vsize (KiB) 7034744

[startup+4902.3 s]
/proc/loadavg: 8.15 8.08 8.01 9/559 19919
/proc/meminfo: memFree=22762668/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=7100280 CPUtime=39120.2 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 16128292 0 0 0 3908760 3260 0 0 25 0 8 0 882445760 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4393068 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 1775070 1555834 348 106 0 1770573 0
[pid=19760/tid=19762] ppid=19758 vsize=7100280 CPUtime=4902.31 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408024 0 0 0 490126 105 0 0 25 0 8 0 882445763 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=7100280 CPUtime=4900.77 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 114973 0 0 0 490043 34 0 0 25 0 8 0 882445763 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=7100280 CPUtime=4805.71 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 11578178 0 0 0 478370 2201 0 0 25 0 8 0 882445763 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=7100280 CPUtime=4902.3 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408294 0 0 0 490125 105 0 0 25 0 8 0 882445763 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=7100280 CPUtime=4902.12 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 113514 0 0 0 490174 38 0 0 25 0 8 0 882445763 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=7100280 CPUtime=4902.29 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 166611 0 0 0 490178 51 0 0 25 0 8 0 882445763 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=7100280 CPUtime=4902.33 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 305610 0 0 0 490140 93 0 0 25 0 8 0 882445763 7270686720 1555834 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39120.2
Current children cumulated vsize (KiB) 7100280

[startup+4962.32 s]
/proc/loadavg: 8.17 8.09 8.02 9/559 19921
/proc/meminfo: memFree=22739080/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=7100280 CPUtime=39599.2 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 16341590 0 0 0 3956617 3301 0 0 25 0 8 0 882445760 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 1775070 1559157 348 106 0 1770573 0
[pid=19760/tid=19762] ppid=19758 vsize=7100280 CPUtime=4962.33 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408041 0 0 0 496128 105 0 0 25 0 8 0 882445763 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=7100280 CPUtime=4960.78 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 115020 0 0 0 496044 34 0 0 25 0 8 0 882445763 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=7100280 CPUtime=4864.55 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 11707981 0 0 0 484229 2226 0 0 25 0 8 0 882445763 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4579317 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=7100280 CPUtime=4962.32 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408306 0 0 0 496127 105 0 0 25 0 8 0 882445763 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=7100280 CPUtime=4962.15 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 113561 0 0 0 496176 39 0 0 25 0 8 0 882445763 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4460393 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=7100280 CPUtime=4962.31 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 166623 0 0 0 496180 51 0 0 25 0 8 0 882445763 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=7100280 CPUtime=4962.35 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 305646 0 0 0 496142 93 0 0 25 0 8 0 882445763 7270686720 1559157 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39599.2
Current children cumulated vsize (KiB) 7100280



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012.6 s]
/proc/loadavg: 8.07 8.08 8.01 9/559 19921
/proc/meminfo: memFree=22727764/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=7100280 CPUtime=40000.5 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) R 19758 19760 19543 0 -1 4202496 16545378 0 0 0 3996712 3341 0 0 25 0 8 0 882445760 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4512092 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 1775070 1564421 381 106 0 1770573 0
[pid=19760/tid=19762] ppid=19758 vsize=7100280 CPUtime=5012.63 cores=0-7
/proc/19760/task/19762/stat : 19762 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408063 0 0 0 501158 105 0 0 25 0 8 0 882445763 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19760/tid=19763] ppid=19758 vsize=7100280 CPUtime=5011.07 cores=0-7
/proc/19760/task/19763/stat : 19763 (SArTagnan) R 19758 19760 19543 0 -1 4202560 115052 0 0 0 501073 34 0 0 25 0 8 0 882445763 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=7100280 CPUtime=4913.87 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4202560 11846637 0 0 0 489133 2254 0 0 25 0 8 0 882445763 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19760/tid=19765] ppid=19758 vsize=7100280 CPUtime=5012.62 cores=0-7
/proc/19760/task/19765/stat : 19765 (SArTagnan) R 19758 19760 19543 0 -1 4202560 408315 0 0 0 501157 105 0 0 25 0 8 0 882445763 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19760/tid=19766] ppid=19758 vsize=7100280 CPUtime=5012.45 cores=0-7
/proc/19760/task/19766/stat : 19766 (SArTagnan) R 19758 19760 19543 0 -1 4202560 113595 0 0 0 501206 39 0 0 25 0 8 0 882445763 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=19760/tid=19767] ppid=19758 vsize=7100280 CPUtime=5012.61 cores=0-7
/proc/19760/task/19767/stat : 19767 (SArTagnan) R 19758 19760 19543 0 -1 4202560 166632 0 0 0 501210 51 0 0 25 0 8 0 882445763 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19760/tid=19768] ppid=19758 vsize=7100280 CPUtime=5012.65 cores=0-7
/proc/19760/task/19768/stat : 19768 (SArTagnan) R 19758 19760 19543 0 -1 4202560 305682 0 0 0 501172 93 0 0 25 0 8 0 882445763 7270686720 1564421 33554432000 4194304 4625164 140736020914816 18446744073709551615 4330590 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 7100280

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.73 s]
/proc/loadavg: 8.07 8.08 8.01 9/559 19921
/proc/meminfo: memFree=22727764/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=0 CPUtime=40000.7 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) Z 19758 19760 19543 0 -1 4203548 16545378 0 0 0 3996721 3351 0 0 25 0 2 0 882445760 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 0 0 0 0 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=0 CPUtime=4913.97 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4203588 11846637 0 0 0 489133 2264 0 0 25 0 2 0 882445763 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

[startup+5012.8 s]
/proc/loadavg: 8.07 8.08 8.01 2/554 19924
/proc/meminfo: memFree=26282364/32951124 swapFree=34426104/67111528
[pid=19760] ppid=19758 vsize=0 CPUtime=40000.8 cores=0-7
/proc/19760/stat : 19760 (SArTagnan) Z 19758 19760 19543 0 -1 4203548 16545378 0 0 0 3996721 3360 0 0 25 0 2 0 882445760 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/19760/statm: 0 0 0 0 0 0 0
[pid=19760/tid=19764] ppid=19758 vsize=0 CPUtime=4914.06 cores=0-7
/proc/19760/task/19764/stat : 19764 (SArTagnan) R 19758 19760 19543 0 -1 4203588 11846637 0 0 0 489133 2273 0 0 25 0 2 0 882445763 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.92
CPU time (s): 40000.9
CPU user time (s): 39967.2
CPU system time (s): 33.7079
CPU usage (%): 797.957
Max. virtual memory (cumulated for all children) (KiB): 7100280

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39967.2
system time used= 33.7079
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16545378
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3640
involuntary context switches= 182413

runsolver used 25.6711 second user time and 72.191 second system time

The end

Launcher Data 

Begin job on node118 at 2011-06-01 11:55:51
IDJOB=3438711
IDBENCH=83157
IDSOLVER=1936
FILE ID=node118/3438711-1306922151
RUNJOBID= node118-1306917136-19557
PBS_JOBID= 13488520
Free space on /tmp= 73656 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x34.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438711-1306922151/watcher-3438711-1306922151 -o /tmp/evaluation-result-3438711-1306922151/solver-3438711-1306922151 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438711-1306922151.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1633295f58c28a5b4150be8640bdf9df
RANDOM SEED=1822535114

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28997688 kB
Buffers:        281972 kB
Cached:        1772828 kB
SwapCached:      56136 kB
Active:         625360 kB
Inactive:      2989456 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28997688 kB
SwapTotal:    67111528 kB
SwapFree:     34426104 kB
Dirty:            1172 kB
Writeback:           0 kB
AnonPages:     1517372 kB
Mapped:          14356 kB
Slab:           150240 kB
PageTables:     115028 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 183773808 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73656 MiB
End job on node118 at 2011-06-01 13:19:26