Trace number 3372239

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40001 5007.34

General information on the benchmark

NameAPPLICATIONS/bitverif/countbitswegner/
countbitswegner128.cnf
MD5SUM4b75ef7fb46928f50793af1d74c176e2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3303.24
Satisfiable
(Un)Satisfiability was proved
Number of variables98048
Number of clauses293759
Sum of the clauses size685435
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2195838
Number of clauses of size 397919
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372239-1305436849/watcher-3372239-1305436849 -o /tmp/evaluation-result-3372239-1305436849/solver-3372239-1305436849 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372239-1305436849.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 6.88 5.94 2/309 17607
/proc/meminfo: memFree=27033912/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=10752 CPUtime=0 cores=0-7
/proc/17607/stat : 17607 (plingeling) R 17605 17607 17445 0 -1 4202496 765 1258 0 0 0 0 0 0 21 0 1 0 387876214 11010048 695 33554432000 4194304 4417452 140736819481376 18446744073709551615 268660356057 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/17607/statm: 2688 699 148 55 0 574 0

[startup+0.029829 s]
/proc/loadavg: 7.43 6.88 5.94 2/309 17607
/proc/meminfo: memFree=27033912/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=16812 CPUtime=0.02 cores=0-7
/proc/17607/stat : 17607 (plingeling) R 17605 17607 17445 0 -1 4202496 2297 1258 0 0 2 0 0 0 21 0 1 0 387876214 17215488 2227 33554432000 4194304 4417452 140736819481376 18446744073709551615 4227893 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/17607/statm: 4203 2227 149 55 0 2089 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 16812

[startup+0.100817 s]
/proc/loadavg: 7.43 6.88 5.94 2/309 17607
/proc/meminfo: memFree=27033912/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=27712 CPUtime=0.09 cores=0-7
/proc/17607/stat : 17607 (plingeling) R 17605 17607 17445 0 -1 4202496 5056 1258 0 0 9 0 0 0 21 0 1 0 387876214 28377088 4952 33554432000 4194304 4417452 140736819481376 18446744073709551615 4209666 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/17607/statm: 6928 4952 149 55 0 4814 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27712

[startup+0.30078 s]
/proc/loadavg: 7.43 6.88 5.94 2/309 17607
/proc/meminfo: memFree=27033912/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=80716 CPUtime=0.29 cores=0-7
/proc/17607/stat : 17607 (plingeling) R 17605 17607 17445 0 -1 4202496 18319 1258 0 0 27 2 0 0 22 0 1 0 387876214 82653184 18203 33554432000 4194304 4417452 140736819481376 18446744073709551615 4231477 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/17607/statm: 20179 18203 149 55 0 18065 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 80716

[startup+0.700678 s]
/proc/loadavg: 7.43 6.88 5.94 2/309 17607
/proc/meminfo: memFree=27033912/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=220416 CPUtime=0.77 cores=0-7
/proc/17607/stat : 17607 (plingeling) R 17605 17607 17445 0 -1 4202496 36019 1258 0 0 73 4 0 0 25 0 9 0 387876214 225705984 32665 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 55104 32665 158 55 0 52990 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 220416

[startup+1.50054 s]
/proc/loadavg: 7.43 6.88 5.94 9/318 17621
/proc/meminfo: memFree=26854404/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=389168 CPUtime=7.15 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 68127 1258 0 0 704 11 0 0 25 0 9 0 387876214 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 97292 44432 173 55 0 95178 0
[pid=17607/tid=17614] ppid=17605 vsize=389168 CPUtime=0.81 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 4592 1258 0 0 80 1 0 0 19 0 9 0 387876282 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4301955 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=389168 CPUtime=0.8 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 3925 1258 0 0 80 0 0 0 25 0 9 0 387876282 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4282511 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=389168 CPUtime=0.81 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 2654 1258 0 0 81 0 0 0 25 0 9 0 387876282 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=389168 CPUtime=0.8 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 2369 1258 0 0 80 0 0 0 25 0 9 0 387876282 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4232580 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=389168 CPUtime=0.79 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 4019 1258 0 0 79 0 0 0 18 0 9 0 387876282 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4301957 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=389168 CPUtime=0.8 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 5294 1258 0 0 80 0 0 0 18 0 9 0 387876282 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4302275 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=389168 CPUtime=0.8 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 3265 1258 0 0 80 0 0 0 25 0 9 0 387876283 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4282605 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=389168 CPUtime=0.78 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 6005 1258 0 0 78 0 0 0 25 0 9 0 387876283 398508032 44432 33554432000 4194304 4417452 140736819481376 18446744073709551615 4302131 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.15
Current children cumulated vsize (KiB) 389168

[startup+3.10126 s]
/proc/loadavg: 7.43 6.88 5.94 9/318 17621
/proc/meminfo: memFree=26857636/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=443868 CPUtime=19.94 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 93776 1258 0 0 1979 15 0 0 25 0 9 0 387876214 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 110967 58623 175 55 0 108853 0
[pid=17607/tid=17614] ppid=17605 vsize=443868 CPUtime=2.41 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 8180 1258 0 0 240 1 0 0 22 0 9 0 387876282 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4277628 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=443868 CPUtime=2.41 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 5973 1258 0 0 240 1 0 0 25 0 9 0 387876282 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4275786 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=443868 CPUtime=2.41 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 8615 1258 0 0 240 1 0 0 25 0 9 0 387876282 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4346437 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=443868 CPUtime=2.4 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 2369 1258 0 0 240 0 0 0 25 0 9 0 387876282 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=443868 CPUtime=2.38 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 7830 1258 0 0 237 1 0 0 22 0 9 0 387876282 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4325981 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=443868 CPUtime=2.4 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 7342 1258 0 0 239 1 0 0 22 0 9 0 387876282 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4275936 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=443868 CPUtime=2.4 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 9410 1258 0 0 239 1 0 0 25 0 9 0 387876283 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=443868 CPUtime=2.38 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 8053 1258 0 0 238 0 0 0 25 0 9 0 387876283 454520832 58623 33554432000 4194304 4417452 140736819481376 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19.94
Current children cumulated vsize (KiB) 443868

[startup+6.30069 s]
/proc/loadavg: 7.47 6.90 5.95 9/318 17621
/proc/meminfo: memFree=26771836/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=451892 CPUtime=45.5 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 118053 1258 0 0 4533 17 0 0 25 0 9 0 387876214 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 112973 66012 179 55 0 110859 0
[pid=17607/tid=17614] ppid=17605 vsize=451892 CPUtime=5.61 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 19265 1258 0 0 559 2 0 0 25 0 9 0 387876282 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4248897 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=451892 CPUtime=5.61 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 5980 1258 0 0 560 1 0 0 25 0 9 0 387876282 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4252389 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=451892 CPUtime=5.61 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 9016 1258 0 0 560 1 0 0 25 0 9 0 387876282 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=451892 CPUtime=5.6 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 2370 1258 0 0 560 0 0 0 25 0 9 0 387876282 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4265360 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=451892 CPUtime=5.54 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 7836 1258 0 0 553 1 0 0 25 0 9 0 387876282 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4253179 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=451892 CPUtime=5.6 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 12722 1258 0 0 559 1 0 0 25 0 9 0 387876282 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4273094 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=451892 CPUtime=5.6 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 9411 1258 0 0 559 1 0 0 25 0 9 0 387876283 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=451892 CPUtime=5.58 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 15449 1258 0 0 557 1 0 0 25 0 9 0 387876283 462737408 66012 33554432000 4194304 4417452 140736819481376 18446744073709551615 4252475 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 45.5
Current children cumulated vsize (KiB) 451892

[startup+12.7006 s]
/proc/loadavg: 7.52 6.91 5.97 9/318 17621
/proc/meminfo: memFree=26806704/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=409744 CPUtime=96.63 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 118053 1258 0 0 9645 18 0 0 25 0 9 0 387876214 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 102436 55475 179 55 0 100322 0
[pid=17607/tid=17614] ppid=17605 vsize=409744 CPUtime=12 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 19265 1258 0 0 1198 2 0 0 25 0 9 0 387876282 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357714 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=409744 CPUtime=12.01 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 5980 1258 0 0 1200 1 0 0 25 0 9 0 387876282 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=409744 CPUtime=12 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 9016 1258 0 0 1199 1 0 0 25 0 9 0 387876282 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4281949 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=409744 CPUtime=12 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 2370 1258 0 0 1200 0 0 0 25 0 9 0 387876282 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=409744 CPUtime=11.88 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 7836 1258 0 0 1187 1 0 0 25 0 9 0 387876282 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=409744 CPUtime=12 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 12722 1258 0 0 1199 1 0 0 25 0 9 0 387876282 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4235512 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=409744 CPUtime=12 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 9411 1258 0 0 1199 1 0 0 25 0 9 0 387876283 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=409744 CPUtime=11.98 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 15449 1258 0 0 1197 1 0 0 25 0 9 0 387876283 419577856 55475 33554432000 4194304 4417452 140736819481376 18446744073709551615 4236722 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 96.63
Current children cumulated vsize (KiB) 409744

[startup+25.5013 s]
/proc/loadavg: 7.62 6.97 6.00 9/318 17621
/proc/meminfo: memFree=26822456/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=398316 CPUtime=198.91 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 121604 1258 0 0 19873 18 0 0 25 0 9 0 387876214 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 99579 52425 180 55 0 97465 0
[pid=17607/tid=17614] ppid=17605 vsize=398316 CPUtime=24.81 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 19291 1258 0 0 2479 2 0 0 25 0 9 0 387876282 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4236326 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=398316 CPUtime=24.81 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 6000 1258 0 0 2480 1 0 0 25 0 9 0 387876282 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=398316 CPUtime=24.81 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 9055 1258 0 0 2480 1 0 0 25 0 9 0 387876282 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4291631 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=398316 CPUtime=24.8 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 2717 1258 0 0 2480 0 0 0 25 0 9 0 387876282 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=398316 CPUtime=24.54 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 9623 1258 0 0 2453 1 0 0 25 0 9 0 387876282 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4356971 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=398316 CPUtime=24.8 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 12741 1258 0 0 2479 1 0 0 25 0 9 0 387876282 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4358025 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=398316 CPUtime=24.8 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 9457 1258 0 0 2479 1 0 0 25 0 9 0 387876283 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4309928 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=398316 CPUtime=24.78 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 16716 1258 0 0 2477 1 0 0 25 0 9 0 387876283 407875584 52425 33554432000 4194304 4417452 140736819481376 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 198.91
Current children cumulated vsize (KiB) 398316

[startup+51.1008 s]
/proc/loadavg: 7.75 7.05 6.05 9/318 17622
/proc/meminfo: memFree=26748968/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=480364 CPUtime=403.43 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 180656 1258 0 0 40316 27 0 0 25 0 9 0 387876214 491892736 73169 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 120091 73169 180 55 0 117977 0
[pid=17607/tid=17614] ppid=17605 vsize=480364 CPUtime=50.3 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 22963 1258 0 0 5027 3 0 0 25 0 9 0 387876282 491892736 73169 33554432000 4194304 4417452 140736819481376 18446744073709551615 4356980 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=480364 CPUtime=50.41 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 9255 1258 0 0 5039 2 0 0 25 0 9 0 387876282 491892736 73169 33554432000 4194304 4417452 140736819481376 18446744073709551615 4277540 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=480364 CPUtime=50.4 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.07 8.04 8.00 9/318 17759
/proc/meminfo: memFree=24919912/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=2164380 CPUtime=37724.4 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 27742761 1258 0 0 3767619 4823 0 0 25 0 9 0 387876214 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 541095 502540 180 55 0 538981 0
[pid=17607/tid=17614] ppid=17605 vsize=2164380 CPUtime=4706.25 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 2569171 1258 0 0 470187 438 0 0 25 0 9 0 387876282 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=2164380 CPUtime=4690.06 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 2909723 1258 0 0 468514 492 0 0 25 0 9 0 387876282 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4259618 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=2164380 CPUtime=4720.51 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 3810591 1258 0 0 471338 713 0 0 25 0 9 0 387876282 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=2164380 CPUtime=4721.6 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 4053438 1258 0 0 471438 722 0 0 25 0 9 0 387876282 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=2164380 CPUtime=4721.18 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 2495936 1258 0 0 471702 416 0 0 25 0 9 0 387876282 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=2164380 CPUtime=4720.93 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 3800111 1258 0 0 471411 682 0 0 25 0 9 0 387876282 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=2164380 CPUtime=4721.57 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 3675341 1258 0 0 471499 658 0 0 25 0 9 0 387876283 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=2164380 CPUtime=4721.59 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 4392446 1258 0 0 471465 694 0 0 25 0 9 0 387876283 2216325120 502540 33554432000 4194304 4417452 140736819481376 18446744073709551615 4356960 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37724.4
Current children cumulated vsize (KiB) 2164380

[startup+4782.3 s]
/proc/loadavg: 8.08 8.04 8.00 9/318 17760
/proc/meminfo: memFree=25285200/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=1884508 CPUtime=38203.7 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 28096702 1258 0 0 3815492 4882 0 0 25 0 9 0 387876214 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 471127 432898 180 55 0 469013 0
[pid=17607/tid=17614] ppid=17605 vsize=1884508 CPUtime=4766.23 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 2599110 1258 0 0 476180 443 0 0 25 0 9 0 387876282 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=1884508 CPUtime=4749.45 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 2941589 1258 0 0 474450 495 0 0 25 0 9 0 387876282 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=1884508 CPUtime=4780.5 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 3882155 1258 0 0 477323 727 0 0 25 0 9 0 387876282 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=1884508 CPUtime=4781.59 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 4159444 1258 0 0 477415 744 0 0 25 0 9 0 387876282 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=1884508 CPUtime=4781.17 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 2521563 1258 0 0 477697 420 0 0 25 0 9 0 387876282 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=1884508 CPUtime=4780.93 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 3835729 1258 0 0 477406 687 0 0 25 0 9 0 387876282 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=1884508 CPUtime=4781.55 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 3700242 1258 0 0 477493 662 0 0 25 0 9 0 387876283 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4346482 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=1884508 CPUtime=4781.58 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 4420866 1258 0 0 477461 697 0 0 25 0 9 0 387876283 1929736192 432898 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38203.7
Current children cumulated vsize (KiB) 1884508

[startup+4842.3 s]
/proc/loadavg: 8.03 8.03 8.00 9/318 17762
/proc/meminfo: memFree=25171480/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=2011020 CPUtime=38683.1 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 28414737 1258 0 0 3863378 4936 0 0 25 0 9 0 387876214 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 502755 464722 180 55 0 500641 0
[pid=17607/tid=17614] ppid=17605 vsize=2011020 CPUtime=4826.24 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 2631231 1258 0 0 482176 448 0 0 25 0 9 0 387876282 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=2011020 CPUtime=4808.85 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 2964418 1258 0 0 480385 500 0 0 25 0 9 0 387876282 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4309862 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=2011020 CPUtime=4840.48 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 3909534 1258 0 0 483315 733 0 0 25 0 9 0 387876282 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=2011020 CPUtime=4841.59 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 4221869 1258 0 0 483407 752 0 0 25 0 9 0 387876282 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=2011020 CPUtime=4841.17 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 2572145 1258 0 0 483687 430 0 0 25 0 9 0 387876282 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4346458 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=2011020 CPUtime=4840.93 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 3864869 1258 0 0 483402 691 0 0 25 0 9 0 387876282 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=2011020 CPUtime=4841.56 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 3725470 1258 0 0 483490 666 0 0 25 0 9 0 387876283 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=2011020 CPUtime=4841.58 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 4489197 1258 0 0 483450 708 0 0 25 0 9 0 387876283 2059284480 464722 33554432000 4194304 4417452 140736819481376 18446744073709551615 4366614 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38683.1
Current children cumulated vsize (KiB) 2011020

[startup+4902.3 s]
/proc/loadavg: 8.01 8.02 8.00 9/318 17763
/proc/meminfo: memFree=24769828/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=2415676 CPUtime=39162.5 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 29040376 1258 0 0 3911194 5059 0 0 25 0 9 0 387876214 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 603919 565886 180 55 0 601805 0
[pid=17607/tid=17614] ppid=17605 vsize=2415676 CPUtime=4886.24 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 2679779 1258 0 0 488169 455 0 0 25 0 9 0 387876282 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=2415676 CPUtime=4868.25 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 3013814 1258 0 0 486314 511 0 0 25 0 9 0 387876282 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=2415676 CPUtime=4900.47 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 3993061 1258 0 0 489293 754 0 0 25 0 9 0 387876282 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=2415676 CPUtime=4901.59 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 4411241 1258 0 0 489376 783 0 0 25 0 9 0 387876282 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357410 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=2415676 CPUtime=4901.17 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 2681488 1258 0 0 489665 452 0 0 25 0 9 0 387876282 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=2415676 CPUtime=4900.93 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 3914924 1258 0 0 489393 700 0 0 25 0 9 0 387876282 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=2415676 CPUtime=4901.56 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 3763639 1258 0 0 489483 673 0 0 25 0 9 0 387876283 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=2415676 CPUtime=4901.57 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 4546426 1258 0 0 489436 721 0 0 25 0 9 0 387876283 2473652224 565886 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39162.5
Current children cumulated vsize (KiB) 2415676

[startup+4962.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/318 17765
/proc/meminfo: memFree=24581328/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=2600236 CPUtime=39641.9 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 29438072 1258 0 0 3959058 5135 0 0 25 0 9 0 387876214 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 650059 612026 180 55 0 647945 0
[pid=17607/tid=17614] ppid=17605 vsize=2600236 CPUtime=4946.24 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 2728385 1258 0 0 494161 463 0 0 25 0 9 0 387876282 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=2600236 CPUtime=4927.65 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 3047252 1258 0 0 492248 517 0 0 25 0 9 0 387876282 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=2600236 CPUtime=4960.46 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 4013293 1258 0 0 495285 761 0 0 25 0 9 0 387876282 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=2600236 CPUtime=4961.59 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 4524396 1258 0 0 495360 799 0 0 25 0 9 0 387876282 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=2600236 CPUtime=4961.17 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 2701383 1258 0 0 495659 458 0 0 25 0 9 0 387876282 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4251060 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=2600236 CPUtime=4960.93 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 3956654 1258 0 0 495385 708 0 0 25 0 9 0 387876282 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4358118 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=2600236 CPUtime=4961.56 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 3834050 1258 0 0 495469 687 0 0 25 0 9 0 387876283 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4263180 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=2600236 CPUtime=4961.58 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 4596655 1258 0 0 495424 734 0 0 25 0 9 0 387876283 2662641664 612026 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39641.9
Current children cumulated vsize (KiB) 2600236



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5007.21 s]
/proc/loadavg: 8.00 8.01 8.00 9/318 17766
/proc/meminfo: memFree=24762376/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=2419396 CPUtime=40000.8 cores=0-7
/proc/17607/stat : 17607 (plingeling) S 17605 17607 17445 0 -1 4202496 29682425 1258 0 0 3994895 5186 0 0 25 0 9 0 387876214 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 604849 566816 180 55 0 602735 0
[pid=17607/tid=17614] ppid=17605 vsize=2419396 CPUtime=4991.16 cores=0-7
/proc/17607/task/17614/stat : 17614 (plingeling) R 17605 17607 17445 0 -1 4202560 2779854 1258 0 0 498640 476 0 0 25 0 9 0 387876282 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4250651 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=2419396 CPUtime=4972.12 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4202560 3077560 1258 0 0 496690 522 0 0 25 0 9 0 387876282 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17607/tid=17616] ppid=17605 vsize=2419396 CPUtime=5005.37 cores=0-7
/proc/17607/task/17616/stat : 17616 (plingeling) R 17605 17607 17445 0 -1 4202560 4062249 1258 0 0 499763 774 0 0 25 0 9 0 387876282 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357961 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17607/tid=17617] ppid=17605 vsize=2419396 CPUtime=5006.52 cores=0-7
/proc/17607/task/17617/stat : 17617 (plingeling) R 17605 17607 17445 0 -1 4202560 4525032 1258 0 0 499853 799 0 0 25 0 9 0 387876282 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357959 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17607/tid=17618] ppid=17605 vsize=2419396 CPUtime=5006.1 cores=0-7
/proc/17607/task/17618/stat : 17618 (plingeling) R 17605 17607 17445 0 -1 4202560 2721462 1258 0 0 500148 462 0 0 25 0 9 0 387876282 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17607/tid=17619] ppid=17605 vsize=2419396 CPUtime=5005.86 cores=0-7
/proc/17607/task/17619/stat : 17619 (plingeling) R 17605 17607 17445 0 -1 4202560 3997787 1258 0 0 499873 713 0 0 25 0 9 0 387876282 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17607/tid=17620] ppid=17605 vsize=2419396 CPUtime=5006.48 cores=0-7
/proc/17607/task/17620/stat : 17620 (plingeling) R 17605 17607 17445 0 -1 4202560 3864128 1258 0 0 499955 693 0 0 25 0 9 0 387876283 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17607/tid=17621] ppid=17605 vsize=2419396 CPUtime=5006.5 cores=0-7
/proc/17607/task/17621/stat : 17621 (plingeling) R 17605 17607 17445 0 -1 4202560 4618349 1258 0 0 499911 739 0 0 25 0 9 0 387876283 2477461504 566816 33554432000 4194304 4417452 140736819481376 18446744073709551615 4357471 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 2419396

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.32 s]
/proc/loadavg: 8.00 8.01 8.00 9/318 17766
/proc/meminfo: memFree=24762376/32951124 swapFree=46575252/67111528
[pid=17607] ppid=17605 vsize=0 CPUtime=40001 cores=0-7
/proc/17607/stat : 17607 (plingeling) Z 17605 17607 17445 0 -1 4203548 29682425 1258 0 0 3994903 5195 0 0 18 0 2 0 387876214 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/17607/statm: 0 0 0 0 0 0 0
[pid=17607/tid=17615] ppid=17605 vsize=0 CPUtime=4972.21 cores=0-7
/proc/17607/task/17615/stat : 17615 (plingeling) R 17605 17607 17445 0 -1 4203588 3077560 1258 0 0 496690 531 0 0 25 0 2 0 387876282 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5007.34
CPU time (s): 40001
CPU user time (s): 39949
CPU system time (s): 51.9811
CPU usage (%): 798.847
Max. virtual memory (cumulated for all children) (KiB): 2967120

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39949
system time used= 51.9811
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29683683
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1118
involuntary context switches= 190233

runsolver used 14.4348 second user time and 35.6556 second system time

The end

Launcher Data 

Begin job on node107 at 2011-05-15 07:20:50
IDJOB=3372239
IDBENCH=70799
IDSOLVER=1851
FILE ID=node107/3372239-1305436849
RUNJOBID= node107-1305436255-17459
PBS_JOBID= 13324746
Free space on /tmp= 73488 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/APPLICATIONS/bitverif/countbitswegner/countbitswegner128.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372239-1305436849/watcher-3372239-1305436849 -o /tmp/evaluation-result-3372239-1305436849/solver-3372239-1305436849 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372239-1305436849.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4b75ef7fb46928f50793af1d74c176e2
RANDOM SEED=736261659

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27034192 kB
Buffers:        152680 kB
Cached:        1196276 kB
SwapCached:       9832 kB
Active:        5248476 kB
Inactive:       387148 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27034192 kB
SwapTotal:    67111528 kB
SwapFree:     46575252 kB
Dirty:            5028 kB
Writeback:           0 kB
AnonPages:     4284668 kB
Mapped:          18732 kB
Slab:           146280 kB
PageTables:      68780 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 64914268 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73488 MiB
End job on node107 at 2011-05-15 08:44:19