Trace number 3439126

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.8 5010.06

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_508.cnf
MD5SUMb891f70c80006fb02dca40f266c0cec1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark29393.6
Satisfiable
(Un)Satisfiability was proved
Number of variables254
Number of clauses34661
Sum of the clauses size157137
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 285
Number of clauses of size 331908
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52668

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439126-1306960404/watcher-3439126-1306960404 -o /tmp/evaluation-result-3439126-1306960404/solver-3439126-1306960404 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439126-1306960404.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/448 6134
/proc/meminfo: memFree=24884964/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=20048 CPUtime=0 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 702 0 0 0 0 0 0 0 24 0 1 0 788456371 20529152 603 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/6134/statm: 5012 603 296 106 0 515 0

[startup+0.106347 s]
/proc/loadavg: 0.00 0.00 0.00 2/448 6134
/proc/meminfo: memFree=24884964/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=312552 CPUtime=0.58 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 9410 0 0 0 57 1 0 0 25 0 8 0 788456371 320053248 5589 33554432000 4194304 4625164 140733402195248 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 78138 5589 345 106 0 73641 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 312552

[startup+0.20033 s]
/proc/loadavg: 0.00 0.00 0.00 2/448 6134
/proc/meminfo: memFree=24884964/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=312552 CPUtime=1.33 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 10166 0 0 0 132 1 0 0 25 0 8 0 788456371 320053248 6029 33554432000 4194304 4625164 140733402195248 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 78138 6029 345 106 0 73641 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 312552

[startup+0.300313 s]
/proc/loadavg: 0.00 0.00 0.00 2/448 6134
/proc/meminfo: memFree=24884964/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=312552 CPUtime=2.13 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 11143 0 0 0 212 1 0 0 25 0 8 0 788456371 320053248 6562 33554432000 4194304 4625164 140733402195248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 78138 6562 345 106 0 73641 0
Current children cumulated CPU time (s) 2.13
Current children cumulated vsize (KiB) 312552

[startup+0.700238 s]
/proc/loadavg: 0.00 0.00 0.00 2/448 6134
/proc/meminfo: memFree=24884964/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=316392 CPUtime=5.33 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 17699 0 0 0 530 3 0 0 25 0 8 0 788456371 323985408 8651 33554432000 4194304 4625164 140733402195248 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 79098 8651 345 106 0 74601 0
Current children cumulated CPU time (s) 5.33
Current children cumulated vsize (KiB) 316392

[startup+1.50109 s]
/proc/loadavg: 0.00 0.00 0.00 9/456 6143
/proc/meminfo: memFree=24841636/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=326076 CPUtime=11.72 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 28039 0 0 0 1167 5 0 0 25 0 8 0 788456371 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4511936 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 81519 12512 345 106 0 77022 0
[pid=6134/tid=6136] ppid=6132 vsize=326076 CPUtime=1.46 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 2014 0 0 0 146 0 0 0 20 0 8 0 788456374 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=326076 CPUtime=1.46 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 1975 0 0 0 146 0 0 0 25 0 8 0 788456374 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=326076 CPUtime=1.46 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 10958 0 0 0 144 2 0 0 20 0 8 0 788456374 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4559740 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=326076 CPUtime=1.46 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 2041 0 0 0 146 0 0 0 19 0 8 0 788456374 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339660 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=326076 CPUtime=1.41 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 1330 0 0 0 141 0 0 0 25 0 8 0 788456374 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4349320 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=326076 CPUtime=1.46 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 2049 0 0 0 146 0 0 0 20 0 8 0 788456374 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=326076 CPUtime=1.46 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 2019 0 0 0 146 0 0 0 20 0 8 0 788456374 333901824 12512 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352299 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.72
Current children cumulated vsize (KiB) 326076

[startup+3.1008 s]
/proc/loadavg: 0.00 0.00 0.00 9/456 6143
/proc/meminfo: memFree=24822044/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=400064 CPUtime=24.5 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 47926 0 0 0 2442 8 0 0 25 0 8 0 788456371 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 100016 18785 348 106 0 95519 0
[pid=6134/tid=6136] ppid=6132 vsize=400064 CPUtime=3.06 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 2655 0 0 0 306 0 0 0 25 0 8 0 788456374 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=400064 CPUtime=3.06 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 2555 0 0 0 306 0 0 0 25 0 8 0 788456374 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=400064 CPUtime=3.05 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 23256 0 0 0 302 3 0 0 25 0 8 0 788456374 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4562168 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=400064 CPUtime=3.06 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 3690 0 0 0 306 0 0 0 25 0 8 0 788456374 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=400064 CPUtime=2.99 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 2480 0 0 0 299 0 0 0 25 0 8 0 788456374 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4348893 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=400064 CPUtime=3.06 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 3717 0 0 0 305 1 0 0 25 0 8 0 788456374 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=400064 CPUtime=3.06 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 3653 0 0 0 306 0 0 0 25 0 8 0 788456374 409665536 18785 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.5
Current children cumulated vsize (KiB) 400064

[startup+6.30121 s]
/proc/loadavg: 0.64 0.13 0.04 9/456 6143
/proc/meminfo: memFree=24775312/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=421004 CPUtime=50.05 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 80906 0 0 0 4992 13 0 0 25 0 8 0 788456371 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 105251 29490 348 106 0 100754 0
[pid=6134/tid=6136] ppid=6132 vsize=421004 CPUtime=6.27 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 5867 0 0 0 626 1 0 0 25 0 8 0 788456374 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=421004 CPUtime=6.26 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 4011 0 0 0 626 0 0 0 25 0 8 0 788456374 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 4486764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=421004 CPUtime=6.25 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 42229 0 0 0 619 6 0 0 25 0 8 0 788456374 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 4551646 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=421004 CPUtime=6.26 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 6042 0 0 0 625 1 0 0 25 0 8 0 788456374 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=421004 CPUtime=6.14 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 4010 0 0 0 614 0 0 0 25 0 8 0 788456374 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=421004 CPUtime=6.26 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 6041 0 0 0 625 1 0 0 25 0 8 0 788456374 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=421004 CPUtime=6.26 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 5771 0 0 0 626 0 0 0 25 0 8 0 788456374 431108096 29490 33554432000 4194304 4625164 140733402195248 18446744073709551615 220815892487 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.05
Current children cumulated vsize (KiB) 421004

[startup+12.701 s]
/proc/loadavg: 1.23 0.26 0.09 9/456 6143
/proc/meminfo: memFree=24700008/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=440376 CPUtime=101.15 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 129051 0 0 0 10096 19 0 0 25 0 8 0 788456371 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 110094 47137 348 106 0 105597 0
[pid=6134/tid=6136] ppid=6132 vsize=440376 CPUtime=12.66 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 9728 0 0 0 1265 1 0 0 25 0 8 0 788456374 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4467266 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=440376 CPUtime=12.66 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 6719 0 0 0 1265 1 0 0 25 0 8 0 788456374 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=440376 CPUtime=12.66 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 68649 0 0 0 1256 10 0 0 25 0 8 0 788456374 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=440376 CPUtime=12.66 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 9665 0 0 0 1265 1 0 0 25 0 8 0 788456374 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=440376 CPUtime=12.45 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 6801 0 0 0 1244 1 0 0 25 0 8 0 788456374 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=440376 CPUtime=12.66 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 10120 0 0 0 1265 1 0 0 25 0 8 0 788456374 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351890 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=440376 CPUtime=12.66 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 9494 0 0 0 1266 0 0 0 25 0 8 0 788456374 450945024 47137 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.15
Current children cumulated vsize (KiB) 440376

[startup+25.5007 s]
/proc/loadavg: 2.73 0.64 0.21 9/456 6143
/proc/meminfo: memFree=24605680/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=496100 CPUtime=203.36 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 199147 0 0 0 20304 32 0 0 25 0 8 0 788456371 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4392976 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 124025 70529 378 106 0 119528 0
[pid=6134/tid=6136] ppid=6132 vsize=496100 CPUtime=25.46 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 14399 0 0 0 2544 2 0 0 25 0 8 0 788456374 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=496100 CPUtime=25.46 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 10089 0 0 0 2545 1 0 0 25 0 8 0 788456374 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=496100 CPUtime=25.45 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 110642 0 0 0 2528 17 0 0 25 0 8 0 788456374 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=496100 CPUtime=25.45 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 14712 0 0 0 2544 1 0 0 25 0 8 0 788456374 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=496100 CPUtime=25.05 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 10306 0 0 0 2504 1 0 0 25 0 8 0 788456374 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=496100 CPUtime=25.46 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 15310 0 0 0 2543 3 0 0 25 0 8 0 788456374 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=496100 CPUtime=25.46 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 14587 0 0 0 2545 1 0 0 25 0 8 0 788456374 508006400 70529 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.36
Current children cumulated vsize (KiB) 496100

[startup+51.1009 s]
/proc/loadavg: 4.61 1.25 0.42 9/456 6144
/proc/meminfo: memFree=24457612/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=682860 CPUtime=407.78 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 322871 0 0 0 40724 54 0 0 25 0 8 0 788456371 699248640 107646 33554432000 4194304 4625164 140733402195248 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 170715 107646 375 106 0 166218 0
[pid=6134/tid=6136] ppid=6132 vsize=682860 CPUtime=51.06 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 23067 0 0 0 5103 3 0 0 25 0 8 0 788456374 699248640 107647 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=682860 CPUtime=51.06 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 16036 0 0 0 5104 2 0 0 25 0 8 0 788456374 699248640 107647 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=682860 CPUtime=51.06 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 186721 0 0 0 5075 31 0 0 25 0 8 0 788456374 699248640 107647 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=682860 CPUtime=51.06 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 22717 0 0 0 5103 3 0 0 25 0 8 0 788456374 699248640 107647 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=682860 CPUtime=50.28 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 14872 0 0 0 5026 2 0 0 25 0 8 0 788456374 699248640 107647 33554432000 4194304 4625164 140733402195248 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=682860 CPUtime=51.06 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 24336 0 0 0 5102 4 0 0 25 0 8 0 788456374 699248640 107647 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=682860 CPUtime=51.06 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 22866 0 0 0 5103 3 0 0 25 0 8 0 788456374 699248640 107647 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.78

################
# More data... #
################

Current children cumulated vsize (KiB) 5953124

[startup+4722.3 s]
/proc/loadavg: 8.06 8.08 7.98 9/456 6280
/proc/meminfo: memFree=19963076/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=5953124 CPUtime=37704.9 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 24143049 0 0 0 3766556 3938 0 0 25 0 8 0 788456371 6095998976 1227787 33554432000 4194304 4625164 140733402195248 18446744073709551615 4329208 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 1488281 1227787 423 106 0 1483784 0
[pid=6134/tid=6136] ppid=6132 vsize=5953124 CPUtime=4722.4 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 276173 0 0 0 472180 60 0 0 25 0 8 0 788456374 6095998976 1227793 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=5953124 CPUtime=4722.41 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 309539 0 0 0 472167 74 0 0 25 0 8 0 788456374 6095998976 1227793 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=5953124 CPUtime=4722.36 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 19935685 0 0 0 469153 3083 0 0 25 0 8 0 788456374 6095998976 1227793 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=5953124 CPUtime=4722.41 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 264712 0 0 0 472194 47 0 0 25 0 8 0 788456374 6095998976 1227793 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=5953124 CPUtime=4649.43 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 202558 0 0 0 464876 67 0 0 25 0 8 0 788456374 6095998976 1227793 33554432000 4194304 4625164 140733402195248 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=5953124 CPUtime=4722.42 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 403907 0 0 0 472140 102 0 0 25 0 8 0 788456374 6095998976 1227793 33554432000 4194304 4625164 140733402195248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=5953124 CPUtime=4722.28 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 207471 0 0 0 472181 47 0 0 25 0 8 0 788456374 6095998976 1227793 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37704.9
Current children cumulated vsize (KiB) 5953124

[startup+4782.3 s]
/proc/loadavg: 8.07 8.08 7.98 9/456 6282
/proc/meminfo: memFree=19938116/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=6001532 CPUtime=38184 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 24436341 0 0 0 3814411 3986 0 0 25 0 8 0 788456371 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 1500383 1233329 348 106 0 1495886 0
[pid=6134/tid=6136] ppid=6132 vsize=6001532 CPUtime=4782.38 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 276187 0 0 0 478178 60 0 0 25 0 8 0 788456374 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=6001532 CPUtime=4782.39 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 309685 0 0 0 478165 74 0 0 25 0 8 0 788456374 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=6001532 CPUtime=4782.34 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 20221632 0 0 0 475105 3129 0 0 25 0 8 0 788456374 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=6001532 CPUtime=4782.39 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 264736 0 0 0 478192 47 0 0 25 0 8 0 788456374 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=6001532 CPUtime=4708.5 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 202574 0 0 0 470783 67 0 0 25 0 8 0 788456374 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4348870 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=6001532 CPUtime=4782.4 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 403922 0 0 0 478138 102 0 0 25 0 8 0 788456374 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=6001532 CPUtime=4782.26 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 207493 0 0 0 478179 47 0 0 25 0 8 0 788456374 6145568768 1233329 33554432000 4194304 4625164 140733402195248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38184
Current children cumulated vsize (KiB) 6001532

[startup+4842.32 s]
/proc/loadavg: 8.02 8.06 7.98 9/456 6284
/proc/meminfo: memFree=19929036/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=6001828 CPUtime=38663.1 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 24765889 0 0 0 3862279 4036 0 0 25 0 8 0 788456371 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 1500457 1236284 426 106 0 1495960 0
[pid=6134/tid=6136] ppid=6132 vsize=6001828 CPUtime=4842.4 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 276201 0 0 0 484180 60 0 0 25 0 8 0 788456374 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=6001828 CPUtime=4842.4 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 309854 0 0 0 484166 74 0 0 25 0 8 0 788456374 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=6001828 CPUtime=4842.36 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 20550464 0 0 0 481057 3179 0 0 25 0 8 0 788456374 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=6001828 CPUtime=4842.41 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 264756 0 0 0 484194 47 0 0 25 0 8 0 788456374 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=6001828 CPUtime=4767.58 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 202595 0 0 0 476691 67 0 0 25 0 8 0 788456374 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4349768 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=6001828 CPUtime=4842.42 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 403941 0 0 0 484140 102 0 0 25 0 8 0 788456374 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331104 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=6001828 CPUtime=4842.28 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 207515 0 0 0 484181 47 0 0 25 0 8 0 788456374 6145871872 1236284 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38663.1
Current children cumulated vsize (KiB) 6001828

[startup+4902.3 s]
/proc/loadavg: 8.05 8.06 7.99 9/456 6285
/proc/meminfo: memFree=19923788/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=6005656 CPUtime=39142.1 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 25015344 0 0 0 3910132 4078 0 0 25 0 8 0 788456371 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 1501414 1237433 413 106 0 1496917 0
[pid=6134/tid=6136] ppid=6132 vsize=6005656 CPUtime=4902.39 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 276217 0 0 0 490179 60 0 0 25 0 8 0 788456374 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=6005656 CPUtime=4902.39 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 309975 0 0 0 490165 74 0 0 25 0 8 0 788456374 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=6005656 CPUtime=4902.35 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 20786542 0 0 0 487016 3219 0 0 25 0 8 0 788456374 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=6005656 CPUtime=4902.4 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 264781 0 0 0 490193 47 0 0 25 0 8 0 788456374 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=6005656 CPUtime=4826.65 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 203643 0 0 0 482597 68 0 0 25 0 8 0 788456374 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4348884 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=6005656 CPUtime=4902.42 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 403962 0 0 0 490139 103 0 0 25 0 8 0 788456374 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=6005656 CPUtime=4902.26 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 207534 0 0 0 490179 47 0 0 25 0 8 0 788456374 6149791744 1237433 33554432000 4194304 4625164 140733402195248 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39142.1
Current children cumulated vsize (KiB) 6005656

[startup+4962.3 s]
/proc/loadavg: 8.02 8.05 7.99 9/456 6287
/proc/meminfo: memFree=19918416/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=6006976 CPUtime=39621.2 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 25382832 0 0 0 3957977 4140 0 0 25 0 8 0 788456371 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 1501744 1238963 353 106 0 1497247 0
[pid=6134/tid=6136] ppid=6132 vsize=6006976 CPUtime=4962.39 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 276396 0 0 0 496179 60 0 0 25 0 8 0 788456374 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=6006976 CPUtime=4962.4 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 310134 0 0 0 496165 75 0 0 25 0 8 0 788456374 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=6006976 CPUtime=4962.35 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 21150450 0 0 0 492956 3279 0 0 25 0 8 0 788456374 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=6006976 CPUtime=4962.4 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 264802 0 0 0 496193 47 0 0 25 0 8 0 788456374 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=6006976 CPUtime=4885.71 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 203976 0 0 0 488503 68 0 0 25 0 8 0 788456374 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=6006976 CPUtime=4962.42 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 403987 0 0 0 496139 103 0 0 25 0 8 0 788456374 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=6006976 CPUtime=4962.26 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 207560 0 0 0 496179 47 0 0 25 0 8 0 788456374 6151143424 1238963 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39621.2
Current children cumulated vsize (KiB) 6006976



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.8 s]
/proc/loadavg: 8.06 8.05 8.00 9/456 6288
/proc/meminfo: memFree=19884280/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=6027896 CPUtime=40000.5 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) R 6132 6134 6108 0 -1 4202496 25559244 0 0 0 3995876 4171 0 0 25 0 8 0 788456371 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 1506974 1247420 418 106 0 1502477 0
[pid=6134/tid=6136] ppid=6132 vsize=6027896 CPUtime=5009.9 cores=0-7
/proc/6134/task/6136/stat : 6136 (SArTagnan) R 6132 6134 6108 0 -1 4202560 276455 0 0 0 500930 60 0 0 25 0 8 0 788456374 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6134/tid=6137] ppid=6132 vsize=6027896 CPUtime=5009.91 cores=0-7
/proc/6134/task/6137/stat : 6137 (SArTagnan) R 6132 6134 6108 0 -1 4202560 310362 0 0 0 500916 75 0 0 25 0 8 0 788456374 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6134/tid=6138] ppid=6132 vsize=6027896 CPUtime=5009.86 cores=0-7
/proc/6134/task/6138/stat : 6138 (SArTagnan) R 6132 6134 6108 0 -1 4202560 21324317 0 0 0 497678 3308 0 0 25 0 8 0 788456374 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6134/tid=6139] ppid=6132 vsize=6027896 CPUtime=5009.92 cores=0-7
/proc/6134/task/6139/stat : 6139 (SArTagnan) R 6132 6134 6108 0 -1 4202560 264830 0 0 0 500945 47 0 0 25 0 8 0 788456374 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=6027896 CPUtime=4932.48 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4202560 204751 0 0 0 493178 70 0 0 25 0 8 0 788456374 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4348838 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6134/tid=6141] ppid=6132 vsize=6027896 CPUtime=5009.94 cores=0-7
/proc/6134/task/6141/stat : 6141 (SArTagnan) R 6132 6134 6108 0 -1 4202560 404057 0 0 0 500891 103 0 0 25 0 8 0 788456374 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6134/tid=6142] ppid=6132 vsize=6027896 CPUtime=5009.78 cores=0-7
/proc/6134/task/6142/stat : 6142 (SArTagnan) R 6132 6134 6108 0 -1 4202560 207599 0 0 0 500931 47 0 0 25 0 8 0 788456374 6172565504 1247420 33554432000 4194304 4625164 140733402195248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 6027896

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.92 s]
/proc/loadavg: 8.06 8.05 8.00 9/456 6288
/proc/meminfo: memFree=19884280/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=0 CPUtime=40000.7 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) Z 6132 6134 6108 0 -1 4203548 25559244 0 0 0 3995888 4181 0 0 25 0 2 0 788456371 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 0 0 0 0 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=0 CPUtime=4932.59 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4203588 204751 0 0 0 493179 80 0 0 25 0 2 0 788456374 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

[startup+5010 s]
/proc/loadavg: 8.06 8.05 8.00 9/456 6288
/proc/meminfo: memFree=19884280/32951124 swapFree=60476376/67111528
[pid=6134] ppid=6132 vsize=0 CPUtime=40000.8 cores=0-7
/proc/6134/stat : 6134 (SArTagnan) Z 6132 6134 6108 0 -1 4203548 25559244 0 0 0 3995888 4189 0 0 25 0 2 0 788456371 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6134/statm: 0 0 0 0 0 0 0
[pid=6134/tid=6140] ppid=6132 vsize=0 CPUtime=4932.66 cores=0-7
/proc/6134/task/6140/stat : 6140 (SArTagnan) R 6132 6134 6108 0 -1 4203588 204751 0 0 0 493179 87 0 0 25 0 2 0 788456374 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.06
CPU time (s): 40000.8
CPU user time (s): 39958.9
CPU system time (s): 41.9536
CPU usage (%): 798.41
Max. virtual memory (cumulated for all children) (KiB): 6027896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39958.9
system time used= 41.9536
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25559244
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5322
involuntary context switches= 119891

runsolver used 20.7019 second user time and 55.7885 second system time

The end

Launcher Data 

Begin job on node147 at 2011-06-01 22:33:25
IDJOB=3439126
IDBENCH=83275
IDSOLVER=1936
FILE ID=node147/3439126-1306960404
RUNJOBID= node147-1306960404-6122
PBS_JOBID= 13497604
Free space on /tmp= 73684 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-23_508.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439126-1306960404/watcher-3439126-1306960404 -o /tmp/evaluation-result-3439126-1306960404/solver-3439126-1306960404 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439126-1306960404.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b891f70c80006fb02dca40f266c0cec1
RANDOM SEED=1261788837

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24885368 kB
Buffers:        211604 kB
Cached:        1281840 kB
SwapCached:      11164 kB
Active:        6510908 kB
Inactive:      1301784 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24885368 kB
SwapTotal:    67111528 kB
SwapFree:     60476376 kB
Dirty:            1196 kB
Writeback:           0 kB
AnonPages:     6316460 kB
Mapped:          22008 kB
Slab:           126460 kB
PageTables:      58004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 120752196 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73684 MiB
End job on node147 at 2011-06-01 23:56:57