Trace number 3370922

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.35 1203.12

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-15_218.cnf
MD5SUMafc70649cebcc24cd0a7b28def593295
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables218
Number of clauses13362
Sum of the clauses size59166
Maximum clause length15
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 311772
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51590

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370922-1305428597/watcher-3370922-1305428597 -o /tmp/evaluation-result-3370922-1305428597/solver-3370922-1305428597 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370922-1305428597.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.06 8.16 7/320 26755
/proc/meminfo: memFree=15524148/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=9988 CPUtime=0 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) R 26753 26755 26655 0 -1 4202496 614 1253 0 0 0 0 0 0 25 0 1 0 733090380 10227712 522 33554432000 4194304 4417452 140736726846960 18446744073709551615 231895490304 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/26755/statm: 2497 522 149 55 0 383 0

[startup+0.131324 s]
/proc/loadavg: 8.13 8.06 8.16 7/320 26755
/proc/meminfo: memFree=15524148/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=56188 CPUtime=0.45 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 2010 1253 0 0 45 0 0 0 25 0 5 0 733090380 57536512 1833 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 14047 1833 178 55 0 11933 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 56188

[startup+0.200312 s]
/proc/loadavg: 8.13 8.06 8.16 7/320 26755
/proc/meminfo: memFree=15524148/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=55732 CPUtime=0.73 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 2173 1253 0 0 73 0 0 0 25 0 5 0 733090380 57069568 1720 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 13933 1720 179 55 0 11819 0
Current children cumulated CPU time (s) 0.73
Current children cumulated vsize (KiB) 55732

[startup+0.300294 s]
/proc/loadavg: 8.13 8.06 8.16 7/320 26755
/proc/meminfo: memFree=15524148/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=121852 CPUtime=1.13 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 2331 1253 0 0 113 0 0 0 25 0 5 0 733090380 124776448 1878 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 30463 1878 179 55 0 28349 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 121852

[startup+0.70022 s]
/proc/loadavg: 8.13 8.06 8.16 7/320 26755
/proc/meminfo: memFree=15524148/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=124332 CPUtime=2.72 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 2965 1253 0 0 272 0 0 0 25 0 5 0 733090380 127315968 2512 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 31083 2512 179 55 0 28969 0
Current children cumulated CPU time (s) 2.72
Current children cumulated vsize (KiB) 124332

[startup+1.50107 s]
/proc/loadavg: 8.13 8.06 8.16 10/325 26765
/proc/meminfo: memFree=15515800/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=127172 CPUtime=5.91 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 4432 1253 0 0 591 0 0 0 25 0 5 0 733090380 130224128 3254 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 31793 3254 179 55 0 29679 0
[pid=26755/tid=26762] ppid=26753 vsize=127172 CPUtime=1.48 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 418 1253 0 0 148 0 0 0 25 0 5 0 733090382 130224128 3254 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364861 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=127172 CPUtime=1.47 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 524 1253 0 0 147 0 0 0 25 0 5 0 733090382 130224128 3254 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366005 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=127172 CPUtime=1.46 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 442 1253 0 0 146 0 0 0 25 0 5 0 733090382 130224128 3254 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=127172 CPUtime=1.47 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 1540 1253 0 0 147 0 0 0 25 0 5 0 733090382 130224128 3254 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 127172

[startup+3.10077 s]
/proc/loadavg: 8.13 8.06 8.16 10/325 26765
/proc/meminfo: memFree=15508112/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=133072 CPUtime=12.3 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 7588 1253 0 0 1230 0 0 0 25 0 5 0 733090380 136265728 4711 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 33268 4711 179 55 0 31154 0
[pid=26755/tid=26762] ppid=26753 vsize=133072 CPUtime=3.08 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 907 1253 0 0 308 0 0 0 25 0 5 0 733090382 136265728 4711 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=133072 CPUtime=3.07 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 1598 1253 0 0 307 0 0 0 25 0 5 0 733090382 136265728 4711 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=133072 CPUtime=3.05 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 442 1253 0 0 305 0 0 0 25 0 5 0 733090382 136265728 4711 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=133072 CPUtime=3.07 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 3133 1253 0 0 307 0 0 0 25 0 5 0 733090382 136265728 4711 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 133072

[startup+6.30117 s]
/proc/loadavg: 8.12 8.06 8.16 10/325 26765
/proc/meminfo: memFree=15521752/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=138176 CPUtime=25.07 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 15911 1253 0 0 2505 2 0 0 25 0 5 0 733090380 141492224 6002 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 34544 6002 179 55 0 32430 0
[pid=26755/tid=26762] ppid=26753 vsize=138176 CPUtime=6.27 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 1788 1253 0 0 627 0 0 0 25 0 5 0 733090382 141492224 6002 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=138176 CPUtime=6.26 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 3854 1253 0 0 626 0 0 0 25 0 5 0 733090382 141492224 6002 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=138176 CPUtime=6.22 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 2747 1253 0 0 622 0 0 0 25 0 5 0 733090382 141492224 6002 33554432000 4194304 4417452 140736726846960 18446744073709551615 4357003 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=138176 CPUtime=6.28 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 6014 1253 0 0 627 1 0 0 25 0 5 0 733090382 141492224 6002 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.07
Current children cumulated vsize (KiB) 138176

[startup+12.701 s]
/proc/loadavg: 8.11 8.06 8.16 10/325 26765
/proc/meminfo: memFree=15512220/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=142564 CPUtime=50.61 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 33916 1253 0 0 5056 5 0 0 25 0 5 0 733090380 145985536 7117 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 35641 7117 179 55 0 33527 0
[pid=26755/tid=26762] ppid=26753 vsize=142564 CPUtime=12.67 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 4900 1253 0 0 1267 0 0 0 25 0 5 0 733090382 145985536 7117 33554432000 4194304 4417452 140736726846960 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=142564 CPUtime=12.67 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 7685 1253 0 0 1266 1 0 0 25 0 5 0 733090382 145985536 7117 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=142564 CPUtime=12.55 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 7964 1253 0 0 1254 1 0 0 25 0 5 0 733090382 145985536 7117 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=142564 CPUtime=12.67 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 11859 1253 0 0 1266 1 0 0 25 0 5 0 733090382 145985536 7117 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.61
Current children cumulated vsize (KiB) 142564

[startup+25.5006 s]
/proc/loadavg: 8.09 8.05 8.15 10/325 26765
/proc/meminfo: memFree=15491996/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=147000 CPUtime=101.66 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 72099 1253 0 0 10154 12 0 0 25 0 5 0 733090380 150528000 8227 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 36750 8227 179 55 0 34636 0
[pid=26755/tid=26762] ppid=26753 vsize=147000 CPUtime=25.46 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 14061 1253 0 0 2544 2 0 0 25 0 5 0 733090382 150528000 8227 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=147000 CPUtime=25.46 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 15054 1253 0 0 2544 2 0 0 25 0 5 0 733090382 150528000 8227 33554432000 4194304 4417452 140736726846960 18446744073709551615 4357007 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=147000 CPUtime=25.22 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 17481 1253 0 0 2519 3 0 0 25 0 5 0 733090382 150528000 8227 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=147000 CPUtime=25.47 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 23995 1253 0 0 2544 3 0 0 25 0 5 0 733090382 150528000 8227 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366486 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.66
Current children cumulated vsize (KiB) 147000

[startup+51.1008 s]
/proc/loadavg: 8.06 8.05 8.15 10/325 26766
/proc/meminfo: memFree=15474488/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=164852 CPUtime=203.82 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 144334 1253 0 0 20357 25 0 0 25 0 5 0 733090380 168808448 12687 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 41213 12687 179 55 0 39099 0
[pid=26755/tid=26762] ppid=26753 vsize=164852 CPUtime=51.07 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 34597 1253 0 0 5101 6 0 0 25 0 5 0 733090382 168808448 12687 33554432000 4194304 4417452 140736726846960 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=164852 CPUtime=51.07 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 33866 1253 0 0 5101 6 0 0 25 0 5 0 733090382 168808448 12687 33554432000 4194304 4417452 140736726846960 18446744073709551615 4359065 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=164852 CPUtime=50.57 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 35221 1253 0 0 5051 6 0 0 25 0 5 0 733090382 168808448 12687 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=164852 CPUtime=51.07 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 39142 1253 0 0 5101 6 0 0 25 0 5 0 733090382 168808448 12687 33554432000 4194304 4417452 140736726846960 18446744073709551615 4365952 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.82
Current children cumulated vsize (KiB) 164852

[startup+102.301 s]
/proc/loadavg: 8.07 8.05 8.14 10/325 26768
/proc/meminfo: memFree=15459332/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=175760 CPUtime=408.13 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 267887 1253 0 0 40766 47 0 0 25 0 5 0 733090380 179978240 15413 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 43940 15413 179 55 0 41826 0
[pid=26755/tid=26762] ppid=26753 vsize=175760 CPUtime=102.27 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 64401 1253 0 0 10216 11 0 0 25 0 5 0 733090382 179978240 15413 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=175760 CPUtime=102.28 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 66790 1253 0 0 10216 12 0 0 25 0 5 0 733090382 179978240 15413 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=175760 CPUtime=101.26 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 63518 1253 0 0 10115 11 0 0 25 0 5 0 733090382 179978240 15413 33554432000 4194304 4417452 140736726846960 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=175760 CPUtime=102.28 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 71670 1253 0 0 10217 11 0 0 25 0 5 0 733090382 179978240 15413 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364675 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.13
Current children cumulated vsize (KiB) 175760

[startup+162.301 s]
/proc/loadavg: 8.06 8.06 8.14 10/325 26769
/proc/meminfo: memFree=15453224/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=192724 CPUtime=647.5 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 398629 1253 0 0 64683 67 0 0 25 0 5 0 733090380 197349376 19741 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 48181 19741 179 55 0 46067 0
[pid=26755/tid=26762] ppid=26753 vsize=192724 CPUtime=162.24 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 93414 1253 0 0 16208 16 0 0 25 0 5 0 733090382 197349376 19741 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=192724 CPUtime=162.27 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 99873 1253 0 0 16210 17 0 0 25 0 5 0 733090382 197349376 19741 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=192724 CPUtime=160.66 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 92309 1253 0 0 16051 15 0 0 25 0 5 0 733090382 197349376 19741 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=192724 CPUtime=162.27 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 111525 1253 0 0 16210 17 0 0 25 0 5 0 733090382 197349376 19741 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 647.5
Current children cumulated vsize (KiB) 192724


################
# More data... #
################

[pid=26755/tid=26763] ppid=26753 vsize=253804 CPUtime=702.29 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 342242 1253 0 0 70176 53 0 0 25 0 5 0 733090382 259895296 34970 33554432000 4194304 4417452 140736726846960 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=253804 CPUtime=695.28 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 290530 1253 0 0 69483 45 0 0 25 0 5 0 733090382 259895296 34970 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366407 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=253804 CPUtime=702.3 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 348759 1253 0 0 70177 53 0 0 25 0 5 0 733090382 259895296 34970 33554432000 4194304 4417452 140736726846960 18446744073709551615 4358093 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2802.09
Current children cumulated vsize (KiB) 253804

[startup+762.301 s]
/proc/loadavg: 8.08 8.08 8.09 10/325 26785
/proc/meminfo: memFree=15344316/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=263432 CPUtime=3041.52 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1357245 1253 0 0 303939 213 0 0 25 0 5 0 733090380 269754368 37355 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 65858 37355 179 55 0 63744 0
[pid=26755/tid=26762] ppid=26753 vsize=263432 CPUtime=762.19 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 312870 1253 0 0 76167 52 0 0 25 0 5 0 733090382 269754368 37355 33554432000 4194304 4417452 140736726846960 18446744073709551615 4263224 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=263432 CPUtime=762.3 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 365115 1253 0 0 76174 56 0 0 25 0 5 0 733090382 269754368 37355 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=263432 CPUtime=754.68 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 305535 1253 0 0 75421 47 0 0 25 0 5 0 733090382 269754368 37355 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=263432 CPUtime=762.31 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 372217 1253 0 0 76175 56 0 0 25 0 5 0 733090382 269754368 37355 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3041.52
Current children cumulated vsize (KiB) 263432

[startup+822.3 s]
/proc/loadavg: 8.08 8.08 8.09 10/325 26787
/proc/meminfo: memFree=15375020/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=242412 CPUtime=3280.89 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1458030 1253 0 0 327861 228 0 0 25 0 5 0 733090380 248229888 32090 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 60603 32090 179 55 0 58489 0
[pid=26755/tid=26762] ppid=26753 vsize=242412 CPUtime=822.17 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 340336 1253 0 0 82161 56 0 0 25 0 5 0 733090382 248229888 32090 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364791 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=242412 CPUtime=822.3 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 389082 1253 0 0 82170 60 0 0 25 0 5 0 733090382 248229888 32090 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=242412 CPUtime=814.08 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 327613 1253 0 0 81357 51 0 0 25 0 5 0 733090382 248229888 32090 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=242412 CPUtime=822.3 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 399491 1253 0 0 82170 60 0 0 25 0 5 0 733090382 248229888 32090 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3280.89
Current children cumulated vsize (KiB) 242412

[startup+882.312 s]
/proc/loadavg: 8.12 8.09 8.09 10/325 26788
/proc/meminfo: memFree=15325760/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=257248 CPUtime=3520.32 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1556132 1253 0 0 351789 243 0 0 25 0 5 0 733090380 263421952 35780 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 64312 35780 179 55 0 62198 0
[pid=26755/tid=26762] ppid=26753 vsize=257248 CPUtime=882.17 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 364023 1253 0 0 88158 59 0 0 25 0 5 0 733090382 263421952 35780 33554432000 4194304 4417452 140736726846960 18446744073709551615 4263092 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=257248 CPUtime=882.31 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 407365 1253 0 0 88168 63 0 0 25 0 5 0 733090382 263421952 35780 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=257248 CPUtime=873.49 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 356261 1253 0 0 87293 56 0 0 25 0 5 0 733090382 263421952 35780 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=257248 CPUtime=882.31 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 426975 1253 0 0 88167 64 0 0 25 0 5 0 733090382 263421952 35780 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3520.32
Current children cumulated vsize (KiB) 257248

[startup+942.301 s]
/proc/loadavg: 8.14 8.10 8.09 9/325 26827
/proc/meminfo: memFree=15440536/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=248848 CPUtime=3759.69 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1621524 1253 0 0 375716 253 0 0 25 0 5 0 733090380 254820352 33730 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 62212 33730 179 55 0 60098 0
[pid=26755/tid=26762] ppid=26753 vsize=248848 CPUtime=942.15 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 374193 1253 0 0 94155 60 0 0 25 0 5 0 733090382 254820352 33730 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=248848 CPUtime=942.3 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 420793 1253 0 0 94165 65 0 0 25 0 5 0 733090382 254820352 33730 33554432000 4194304 4417452 140736726846960 18446744073709551615 4270279 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=248848 CPUtime=932.89 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 367672 1253 0 0 93231 58 0 0 25 0 5 0 733090382 254820352 33730 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=248848 CPUtime=942.3 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 457358 1253 0 0 94162 68 0 0 25 0 5 0 733090382 254820352 33730 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3759.69
Current children cumulated vsize (KiB) 248848

[startup+1002.3 s]
/proc/loadavg: 8.05 8.08 8.09 9/325 26829
/proc/meminfo: memFree=15302872/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=274044 CPUtime=3999.08 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1695270 1253 0 0 399643 265 0 0 25 0 5 0 733090380 280621056 40042 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 68511 40042 179 55 0 66397 0
[pid=26755/tid=26762] ppid=26753 vsize=274044 CPUtime=1002.15 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 388856 1253 0 0 100152 63 0 0 25 0 5 0 733090382 280621056 40042 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=274044 CPUtime=1002.29 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 441847 1253 0 0 100161 68 0 0 25 0 5 0 733090382 280621056 40042 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=274044 CPUtime=992.29 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 382363 1253 0 0 99168 61 0 0 25 0 5 0 733090382 280621056 40042 33554432000 4194304 4417452 140736726846960 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=274044 CPUtime=1002.31 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 480696 1253 0 0 100159 72 0 0 25 0 5 0 733090382 280621056 40042 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3999.08
Current children cumulated vsize (KiB) 274044

[startup+1062.3 s]
/proc/loadavg: 8.02 8.06 8.08 9/325 26830
/proc/meminfo: memFree=15313376/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=261316 CPUtime=4238.48 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1757203 1253 0 0 423574 274 0 0 25 0 5 0 733090380 267587584 36820 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 65329 36820 179 55 0 63215 0
[pid=26755/tid=26762] ppid=26753 vsize=261316 CPUtime=1062.14 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 400903 1253 0 0 106150 64 0 0 25 0 5 0 733090382 267587584 36820 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=261316 CPUtime=1062.3 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 456349 1253 0 0 106159 71 0 0 25 0 5 0 733090382 267587584 36820 33554432000 4194304 4417452 140736726846960 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=261316 CPUtime=1051.69 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 397189 1253 0 0 105106 63 0 0 25 0 5 0 733090382 267587584 36820 33554432000 4194304 4417452 140736726846960 18446744073709551615 4344176 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=261316 CPUtime=1062.31 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 501254 1253 0 0 106156 75 0 0 25 0 5 0 733090382 267587584 36820 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4238.48
Current children cumulated vsize (KiB) 261316

[startup+1122.3 s]
/proc/loadavg: 8.00 8.05 8.07 9/325 26832
/proc/meminfo: memFree=15248248/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=292256 CPUtime=4477.88 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1830948 1253 0 0 447503 285 0 0 25 0 5 0 733090380 299270144 44559 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 73064 44559 179 55 0 70950 0
[pid=26755/tid=26762] ppid=26753 vsize=292256 CPUtime=1122.13 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 416145 1253 0 0 112147 66 0 0 25 0 5 0 733090382 299270144 44559 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366804 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=292256 CPUtime=1122.3 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 475689 1253 0 0 112156 74 0 0 25 0 5 0 733090382 299270144 44559 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=292256 CPUtime=1111.09 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 413265 1253 0 0 111043 66 0 0 25 0 5 0 733090382 299270144 44559 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=292256 CPUtime=1122.31 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 524341 1253 0 0 112153 78 0 0 25 0 5 0 733090382 299270144 44559 33554432000 4194304 4417452 140736726846960 18446744073709551615 4250517 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4477.88
Current children cumulated vsize (KiB) 292256

[startup+1182.3 s]
/proc/loadavg: 8.09 8.07 8.08 9/325 26833
/proc/meminfo: memFree=15221680/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=308968 CPUtime=4717.28 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1905214 1253 0 0 471433 295 0 0 25 0 5 0 733090380 316383232 48742 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 77242 48742 179 55 0 75128 0
[pid=26755/tid=26762] ppid=26753 vsize=308968 CPUtime=1182.13 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 432781 1253 0 0 118145 68 0 0 25 0 5 0 733090382 316383232 48742 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364675 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=308968 CPUtime=1182.3 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 495546 1253 0 0 118153 77 0 0 25 0 5 0 733090382 316383232 48742 33554432000 4194304 4417452 140736726846960 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=308968 CPUtime=1170.5 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 432796 1253 0 0 116981 69 0 0 25 0 5 0 733090382 316383232 48742 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=308968 CPUtime=1182.31 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 542583 1253 0 0 118151 80 0 0 25 0 5 0 733090382 316383232 48742 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4717.28
Current children cumulated vsize (KiB) 308968



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.1 s]
/proc/loadavg: 8.06 8.06 8.08 10/325 26834
/proc/meminfo: memFree=15231712/32950928 swapFree=67085488/67111528
[pid=26755] ppid=26753 vsize=259980 CPUtime=4800.29 cores=0,2,4,6
/proc/26755/stat : 26755 (plingeling) S 26753 26755 26655 0 -1 4202496 1924434 1253 0 0 479730 299 0 0 25 0 5 0 733090380 266219520 36478 33554432000 4194304 4417452 140736726846960 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26755/statm: 64995 36478 179 55 0 62881 0
[pid=26755/tid=26762] ppid=26753 vsize=259980 CPUtime=1202.92 cores=0,2,4,6
/proc/26755/task/26762/stat : 26762 (plingeling) R 26753 26755 26655 0 -1 4202560 437577 1253 0 0 120224 68 0 0 25 0 5 0 733090382 266219520 36478 33554432000 4194304 4417452 140736726846960 18446744073709551615 4263096 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26755/tid=26763] ppid=26753 vsize=259980 CPUtime=1203.12 cores=0,2,4,6
/proc/26755/task/26763/stat : 26763 (plingeling) R 26753 26755 26655 0 -1 4202560 498416 1253 0 0 120234 78 0 0 25 0 5 0 733090382 266219520 36478 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=26755/tid=26764] ppid=26753 vsize=259980 CPUtime=1191.09 cores=0,2,4,6
/proc/26755/task/26764/stat : 26764 (plingeling) R 26753 26755 26655 0 -1 4202560 436184 1253 0 0 119039 70 0 0 25 0 5 0 733090382 266219520 36478 33554432000 4194304 4417452 140736726846960 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26755/tid=26765] ppid=26753 vsize=259980 CPUtime=1203.12 cores=0,2,4,6
/proc/26755/task/26765/stat : 26765 (plingeling) R 26753 26755 26655 0 -1 4202560 550749 1253 0 0 120231 81 0 0 25 0 5 0 733090382 266219520 36478 33554432000 4194304 4417452 140736726846960 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 259980

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.12
CPU time (s): 4800.35
CPU user time (s): 4797.34
CPU system time (s): 3.00354
CPU usage (%): 398.99
Max. virtual memory (cumulated for all children) (KiB): 317480

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.34
system time used= 3.00354
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1925687
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 121
involuntary context switches= 22251

runsolver used 3.40348 second user time and 8.64069 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-15 05:03:17
IDJOB=3370922
IDBENCH=83353
IDSOLVER=1848
FILE ID=node114/3370922-1305428597
RUNJOBID= node114-1305428289-26673
PBS_JOBID= 13324611
Free space on /tmp= 73000 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-15_218.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370922-1305428597/watcher-3370922-1305428597 -o /tmp/evaluation-result-3370922-1305428597/solver-3370922-1305428597 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370922-1305428597.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= afc70649cebcc24cd0a7b28def593295
RANDOM SEED=624157586

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15524304 kB
Buffers:        286700 kB
Cached:        6259744 kB
SwapCached:         96 kB
Active:       12011004 kB
Inactive:      5010524 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15524304 kB
SwapTotal:    67111528 kB
SwapFree:     67085488 kB
Dirty:             412 kB
Writeback:           0 kB
AnonPages:    10475052 kB
Mapped:          26892 kB
Slab:           305384 kB
PageTables:      37168 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 52613932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73000 MiB
End job on node114 at 2011-05-15 05:23:22