Trace number 3394630

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40001 5012.46

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
MD5SUMb61e426b264831836f140414cdcf3e23
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables238
Number of clauses15812
Sum of the clauses size70446
Maximum clause length16
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 314042
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51770

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394630-1306100591/watcher-3394630-1306100591 -o /tmp/evaluation-result-3394630-1306100591/solver-3394630-1306100591 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394630-1306100591.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.37 7.89 7.96 2/568 17556
/proc/meminfo: memFree=8328720/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=10988 CPUtime=0 cores=0-7
/proc/17556/stat : 17556 (plingeling) R 17554 17556 17530 0 -1 4202496 901 1253 0 0 0 0 0 0 23 0 1 0 721656845 11251712 754 33554432000 4194304 4417452 140737162988320 18446744073709551615 212687675136 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/17556/statm: 2747 754 149 55 0 633 0

[startup+0.0600239 s]
/proc/loadavg: 7.37 7.89 7.96 2/568 17556
/proc/meminfo: memFree=8328720/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=169684 CPUtime=0.15 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 3835 1253 0 0 15 0 0 0 24 0 9 0 721656845 173756416 3592 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 42421 3592 176 55 0 40307 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 169684

[startup+0.101016 s]
/proc/loadavg: 7.37 7.89 7.96 2/568 17556
/proc/meminfo: memFree=8328720/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=169684 CPUtime=0.47 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 3862 1253 0 0 47 0 0 0 24 0 9 0 721656845 173756416 3619 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 42421 3619 179 55 0 40307 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 169684

[startup+0.300979 s]
/proc/loadavg: 7.37 7.89 7.96 2/568 17556
/proc/meminfo: memFree=8328720/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=167976 CPUtime=2.07 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 4230 1253 0 0 207 0 0 0 24 0 9 0 721656845 172007424 3162 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 41994 3162 179 55 0 39880 0
Current children cumulated CPU time (s) 2.07
Current children cumulated vsize (KiB) 167976

[startup+0.700908 s]
/proc/loadavg: 7.37 7.89 7.96 2/568 17556
/proc/meminfo: memFree=8328720/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=173268 CPUtime=5.27 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 5645 1253 0 0 527 0 0 0 24 0 9 0 721656845 177426432 4575 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 43317 4575 179 55 0 41203 0
Current children cumulated CPU time (s) 5.27
Current children cumulated vsize (KiB) 173268

[startup+1.50076 s]
/proc/loadavg: 7.37 7.89 7.96 9/577 17570
/proc/meminfo: memFree=8307720/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=181752 CPUtime=11.66 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 8794 1253 0 0 1165 1 0 0 24 0 9 0 721656845 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 45438 6771 179 55 0 43324 0
[pid=17556/tid=17563] ppid=17554 vsize=181752 CPUtime=1.45 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 980 1253 0 0 145 0 0 0 20 0 9 0 721656849 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=181752 CPUtime=1.45 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 824 1253 0 0 145 0 0 0 25 0 9 0 721656849 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 4246302 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=181752 CPUtime=1.45 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 632 1253 0 0 145 0 0 0 25 0 9 0 721656849 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=181752 CPUtime=1.45 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1476 1253 0 0 145 0 0 0 25 0 9 0 721656849 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=181752 CPUtime=1.44 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 467 1253 0 0 144 0 0 0 25 0 9 0 721656849 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=181752 CPUtime=1.45 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 609 1253 0 0 145 0 0 0 25 0 9 0 721656849 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=181752 CPUtime=1.45 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 424 1253 0 0 145 0 0 0 25 0 9 0 721656849 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=181752 CPUtime=1.42 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 619 1253 0 0 142 0 0 0 25 0 9 0 721656850 186114048 6771 33554432000 4194304 4417452 140737162988320 18446744073709551615 4321570 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.66
Current children cumulated vsize (KiB) 181752

[startup+3.10047 s]
/proc/loadavg: 7.37 7.89 7.96 9/577 17570
/proc/meminfo: memFree=8293708/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=193268 CPUtime=24.43 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 15396 1253 0 0 2441 2 0 0 24 0 9 0 721656845 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 48317 9609 179 55 0 46203 0
[pid=17556/tid=17563] ppid=17554 vsize=193268 CPUtime=3.05 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 2257 1253 0 0 305 0 0 0 25 0 9 0 721656849 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364614 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=193268 CPUtime=3.05 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 1385 1253 0 0 305 0 0 0 25 0 9 0 721656849 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4365987 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=193268 CPUtime=3.05 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 1635 1253 0 0 305 0 0 0 25 0 9 0 721656849 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=193268 CPUtime=3.05 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 3206 1253 0 0 305 0 0 0 25 0 9 0 721656849 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=193268 CPUtime=3.04 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1222 1253 0 0 304 0 0 0 25 0 9 0 721656849 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4365181 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=193268 CPUtime=3.05 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1093 1253 0 0 305 0 0 0 25 0 9 0 721656849 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=193268 CPUtime=3.05 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1216 1253 0 0 305 0 0 0 25 0 9 0 721656849 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=193268 CPUtime=3 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 619 1253 0 0 300 0 0 0 25 0 9 0 721656850 197906432 9609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4353680 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.43
Current children cumulated vsize (KiB) 193268

[startup+6.30089 s]
/proc/loadavg: 7.42 7.89 7.96 9/577 17570
/proc/meminfo: memFree=8281556/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=201124 CPUtime=49.97 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 32411 1253 0 0 4992 5 0 0 24 0 9 0 721656845 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 50281 11544 179 55 0 48167 0
[pid=17556/tid=17563] ppid=17554 vsize=201124 CPUtime=6.26 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 5164 1253 0 0 625 1 0 0 25 0 9 0 721656849 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4320876 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=201124 CPUtime=6.25 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 2788 1253 0 0 625 0 0 0 25 0 9 0 721656849 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=201124 CPUtime=6.25 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 4027 1253 0 0 625 0 0 0 25 0 9 0 721656849 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=201124 CPUtime=6.25 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 6208 1253 0 0 624 1 0 0 25 0 9 0 721656849 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=201124 CPUtime=6.24 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 4372 1253 0 0 624 0 0 0 25 0 9 0 721656849 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=201124 CPUtime=6.25 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 2121 1253 0 0 625 0 0 0 25 0 9 0 721656849 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=201124 CPUtime=6.25 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 2227 1253 0 0 625 0 0 0 25 0 9 0 721656849 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=201124 CPUtime=6.13 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 2741 1253 0 0 613 0 0 0 25 0 9 0 721656850 205950976 11544 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.97
Current children cumulated vsize (KiB) 201124

[startup+12.7007 s]
/proc/loadavg: 7.47 7.89 7.96 9/577 17570
/proc/meminfo: memFree=8279000/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=207236 CPUtime=101.04 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 75634 1253 0 0 10089 15 0 0 24 0 9 0 721656845 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 51809 13041 179 55 0 49695 0
[pid=17556/tid=17563] ppid=17554 vsize=207236 CPUtime=12.65 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 11964 1253 0 0 1263 2 0 0 25 0 9 0 721656849 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=207236 CPUtime=12.65 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 7166 1253 0 0 1264 1 0 0 25 0 9 0 721656849 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=207236 CPUtime=12.65 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 10640 1253 0 0 1263 2 0 0 25 0 9 0 721656849 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4356916 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=207236 CPUtime=12.65 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 10947 1253 0 0 1263 2 0 0 25 0 9 0 721656849 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366486 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=207236 CPUtime=12.64 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 10373 1253 0 0 1262 2 0 0 25 0 9 0 721656849 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=207236 CPUtime=12.65 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 6795 1253 0 0 1264 1 0 0 25 0 9 0 721656849 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=207236 CPUtime=12.65 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 6880 1253 0 0 1264 1 0 0 25 0 9 0 721656849 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=207236 CPUtime=12.41 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 8106 1253 0 0 1240 1 0 0 25 0 9 0 721656850 212209664 13041 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.04
Current children cumulated vsize (KiB) 207236

[startup+25.5004 s]
/proc/loadavg: 7.66 7.92 7.96 9/577 17571
/proc/meminfo: memFree=8267688/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=217856 CPUtime=203.19 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 161997 1253 0 0 20287 32 0 0 24 0 9 0 721656845 223084544 15565 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 54464 15595 179 55 0 52350 0
[pid=17556/tid=17563] ppid=17554 vsize=217856 CPUtime=25.45 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 24419 1253 0 0 2540 5 0 0 25 0 9 0 721656849 223084544 15609 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=217856 CPUtime=25.45 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 15448 1253 0 0 2542 3 0 0 25 0 9 0 721656849 223084544 15626 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=217856 CPUtime=25.45 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 23292 1253 0 0 2540 5 0 0 25 0 9 0 721656849 223084544 15643 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=217856 CPUtime=25.45 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 22002 1253 0 0 2541 4 0 0 25 0 9 0 721656849 223084544 15661 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=217856 CPUtime=25.44 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 19469 1253 0 0 2541 3 0 0 25 0 9 0 721656849 223084544 15679 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=217856 CPUtime=25.45 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 19591 1253 0 0 2541 4 0 0 25 0 9 0 721656849 223084544 15694 33554432000 4194304 4417452 140737162988320 18446744073709551615 212687369275 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=217856 CPUtime=25.44 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 16892 1253 0 0 2542 2 0 0 25 0 9 0 721656849 223084544 15696 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=217856 CPUtime=24.95 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 18251 1253 0 0 2493 2 0 0 25 0 9 0 721656850 223084544 15696 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.19
Current children cumulated vsize (KiB) 217856

[startup+51.1007 s]
/proc/loadavg: 7.78 7.92 7.96 9/577 17571
/proc/meminfo: memFree=8230628/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=248852 CPUtime=407.5 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 335815 1253 0 0 40684 66 0 0 24 0 9 0 721656845 254824448 23445 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 62213 23445 179 55 0 60099 0
[pid=17556/tid=17563] ppid=17554 vsize=248852 CPUtime=51.05 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 46011 1253 0 0 5096 9 0 0 25 0 9 0 721656849 254824448 23445 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=248852 CPUtime=51.06 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 35379 1253 0 0 5098 8 0 0 25 0 9 0 721656849 254824448 23445 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=248852 CPUtime=51.04 cores=0-7

################
# More data... #
################

/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1466350 1253 0 0 465983 253 0 0 25 0 9 0 721656849 688361472 129305 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=672228 CPUtime=4662.35 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1374541 1253 0 0 465997 238 0 0 25 0 9 0 721656849 688361472 129305 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=672228 CPUtime=4662.37 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1415611 1253 0 0 465997 240 0 0 25 0 9 0 721656849 688361472 129305 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=672228 CPUtime=4662.37 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1360615 1253 0 0 465995 242 0 0 25 0 9 0 721656849 688361472 129305 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=672228 CPUtime=4573.2 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 1359067 1253 0 0 457077 243 0 0 25 0 9 0 721656850 688361472 129305 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37207.6
Current children cumulated vsize (KiB) 672228

[startup+4722.32 s]
/proc/loadavg: 8.03 8.07 8.01 9/577 17717
/proc/meminfo: memFree=7744172/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=742300 CPUtime=37686.5 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 11471245 1253 0 0 3766651 2000 0 0 24 0 9 0 721656845 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 185575 146823 179 55 0 183461 0
[pid=17556/tid=17563] ppid=17554 vsize=742300 CPUtime=4722.35 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 1596496 1253 0 0 471970 265 0 0 25 0 9 0 721656849 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=742300 CPUtime=4721.75 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 1428564 1253 0 0 471923 252 0 0 25 0 9 0 721656849 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=742300 CPUtime=4720.69 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 1410541 1253 0 0 471817 252 0 0 25 0 9 0 721656849 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=742300 CPUtime=4722.38 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1473056 1253 0 0 471985 253 0 0 25 0 9 0 721656849 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=742300 CPUtime=4722.38 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1379807 1253 0 0 471998 240 0 0 25 0 9 0 721656849 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=742300 CPUtime=4722.4 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1426993 1253 0 0 471997 243 0 0 25 0 9 0 721656849 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=742300 CPUtime=4722.39 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1375803 1253 0 0 471994 245 0 0 25 0 9 0 721656849 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=742300 CPUtime=4632.06 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 1377222 1253 0 0 462960 246 0 0 25 0 9 0 721656850 760115200 146823 33554432000 4194304 4417452 140737162988320 18446744073709551615 4259889 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37686.5
Current children cumulated vsize (KiB) 742300

[startup+4782.3 s]
/proc/loadavg: 8.05 8.07 8.01 9/577 17718
/proc/meminfo: memFree=7795228/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=691400 CPUtime=38165.2 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 11565268 1253 0 0 3814505 2015 0 0 24 0 9 0 721656845 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 172850 134098 179 55 0 170736 0
[pid=17556/tid=17563] ppid=17554 vsize=691400 CPUtime=4782.33 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 1601091 1253 0 0 477967 266 0 0 25 0 9 0 721656849 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=691400 CPUtime=4781.73 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 1438285 1253 0 0 477920 253 0 0 25 0 9 0 721656849 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4343748 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=691400 CPUtime=4780.65 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 1421551 1253 0 0 477811 254 0 0 25 0 9 0 721656849 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=691400 CPUtime=4782.36 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1493176 1253 0 0 477980 256 0 0 25 0 9 0 721656849 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=691400 CPUtime=4782.36 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1396114 1253 0 0 477994 242 0 0 25 0 9 0 721656849 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=691400 CPUtime=4782.38 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1439885 1253 0 0 477992 246 0 0 25 0 9 0 721656849 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366092 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=691400 CPUtime=4782.38 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1387979 1253 0 0 477991 247 0 0 25 0 9 0 721656849 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=691400 CPUtime=4690.91 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 1384424 1253 0 0 468843 248 0 0 25 0 9 0 721656850 707993600 134098 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38165.2
Current children cumulated vsize (KiB) 691400

[startup+4842.3 s]
/proc/loadavg: 8.02 8.05 8.00 9/577 17720
/proc/meminfo: memFree=7814580/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=673744 CPUtime=38644 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 11656892 1253 0 0 3862373 2030 0 0 24 0 9 0 721656845 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 168436 129684 179 55 0 166322 0
[pid=17556/tid=17563] ppid=17554 vsize=673744 CPUtime=4842.34 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 1612039 1253 0 0 483966 268 0 0 25 0 9 0 721656849 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=673744 CPUtime=4841.74 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 1456410 1253 0 0 483918 256 0 0 25 0 9 0 721656849 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=673744 CPUtime=4840.63 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 1432134 1253 0 0 483808 255 0 0 25 0 9 0 721656849 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=673744 CPUtime=4842.37 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1510901 1253 0 0 483978 259 0 0 25 0 9 0 721656849 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=673744 CPUtime=4842.36 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1404132 1253 0 0 483993 243 0 0 25 0 9 0 721656849 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=673744 CPUtime=4842.38 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1446358 1253 0 0 483991 247 0 0 25 0 9 0 721656849 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=673744 CPUtime=4842.38 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1396641 1253 0 0 483990 248 0 0 25 0 9 0 721656849 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=673744 CPUtime=4749.74 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 1395514 1253 0 0 474724 250 0 0 25 0 9 0 721656850 689913856 129684 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38644
Current children cumulated vsize (KiB) 673744

[startup+4902.3 s]
/proc/loadavg: 8.44 8.15 8.04 9/577 17725
/proc/meminfo: memFree=7747828/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=713844 CPUtime=39122.1 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 11733205 1253 0 0 3910165 2040 0 0 24 0 9 0 721656845 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 178461 139711 179 55 0 176347 0
[pid=17556/tid=17563] ppid=17554 vsize=713844 CPUtime=4902.34 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 1627146 1253 0 0 489964 270 0 0 25 0 9 0 721656849 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4259855 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=713844 CPUtime=4901.09 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 1462148 1253 0 0 489852 257 0 0 25 0 9 0 721656849 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=713844 CPUtime=4900.44 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 1442549 1253 0 0 489787 257 0 0 25 0 9 0 721656849 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=713844 CPUtime=4902.36 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1520132 1253 0 0 489976 260 0 0 25 0 9 0 721656849 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=713844 CPUtime=4902.37 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1418073 1253 0 0 489992 245 0 0 25 0 9 0 721656849 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=713844 CPUtime=4902.38 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1450852 1253 0 0 489990 248 0 0 25 0 9 0 721656849 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=713844 CPUtime=4902.39 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1406092 1253 0 0 489989 250 0 0 25 0 9 0 721656849 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=713844 CPUtime=4808.61 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 1403450 1253 0 0 480609 252 0 0 25 0 9 0 721656850 730976256 139711 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39122
Current children cumulated vsize (KiB) 713844

[startup+4962.3 s]
/proc/loadavg: 8.23 8.14 8.04 9/577 17726
/proc/meminfo: memFree=7772096/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=714568 CPUtime=39600.9 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 11812551 1253 0 0 3958036 2053 0 0 24 0 9 0 721656845 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 178642 139890 179 55 0 176528 0
[pid=17556/tid=17563] ppid=17554 vsize=714568 CPUtime=4962.33 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 1639690 1253 0 0 495962 271 0 0 25 0 9 0 721656849 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366804 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=714568 CPUtime=4961.09 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 1473249 1253 0 0 495851 258 0 0 25 0 9 0 721656849 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=714568 CPUtime=4960.43 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 1456350 1253 0 0 495784 259 0 0 25 0 9 0 721656849 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=714568 CPUtime=4962.36 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1535838 1253 0 0 495974 262 0 0 25 0 9 0 721656849 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=714568 CPUtime=4962.36 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1423025 1253 0 0 495990 246 0 0 25 0 9 0 721656849 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=714568 CPUtime=4962.38 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1462478 1253 0 0 495988 250 0 0 25 0 9 0 721656849 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364861 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=714568 CPUtime=4962.38 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1409968 1253 0 0 495988 250 0 0 25 0 9 0 721656849 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=714568 CPUtime=4867.45 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 1409190 1253 0 0 486492 253 0 0 25 0 9 0 721656850 731717632 139890 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39600.9
Current children cumulated vsize (KiB) 714568



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012.4 s]
/proc/loadavg: 8.18 8.13 8.04 9/577 17727
/proc/meminfo: memFree=7691024/32951124 swapFree=67111364/67111528
[pid=17556] ppid=17554 vsize=793800 CPUtime=40000.8 cores=0-7
/proc/17556/stat : 17556 (plingeling) S 17554 17556 17530 0 -1 4202496 11913790 1253 0 0 3998012 2072 0 0 24 0 9 0 721656845 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/17556/statm: 198450 159698 179 55 0 196336 0
[pid=17556/tid=17563] ppid=17554 vsize=793800 CPUtime=5012.46 cores=0-7
/proc/17556/task/17563/stat : 17563 (plingeling) R 17554 17556 17530 0 -1 4202560 1643014 1253 0 0 500974 272 0 0 25 0 9 0 721656849 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17556/tid=17564] ppid=17554 vsize=793800 CPUtime=5011.21 cores=0-7
/proc/17556/task/17564/stat : 17564 (plingeling) R 17554 17556 17530 0 -1 4202560 1493891 1253 0 0 500859 262 0 0 25 0 9 0 721656849 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17556/tid=17565] ppid=17554 vsize=793800 CPUtime=5010.53 cores=0-7
/proc/17556/task/17565/stat : 17565 (plingeling) R 17554 17556 17530 0 -1 4202560 1460090 1253 0 0 500794 259 0 0 25 0 9 0 721656849 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=17556/tid=17566] ppid=17554 vsize=793800 CPUtime=5012.49 cores=0-7
/proc/17556/task/17566/stat : 17566 (plingeling) R 17554 17556 17530 0 -1 4202560 1547265 1253 0 0 500985 264 0 0 25 0 9 0 721656849 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4246304 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=17556/tid=17567] ppid=17554 vsize=793800 CPUtime=5012.49 cores=0-7
/proc/17556/task/17567/stat : 17567 (plingeling) R 17554 17556 17530 0 -1 4202560 1435481 1253 0 0 501001 248 0 0 25 0 9 0 721656849 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=17556/tid=17568] ppid=17554 vsize=793800 CPUtime=5012.5 cores=0-7
/proc/17556/task/17568/stat : 17568 (plingeling) R 17554 17556 17530 0 -1 4202560 1484594 1253 0 0 500995 255 0 0 25 0 9 0 721656849 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=17556/tid=17569] ppid=17554 vsize=793800 CPUtime=5012.51 cores=0-7
/proc/17556/task/17569/stat : 17569 (plingeling) R 17554 17556 17530 0 -1 4202560 1423022 1253 0 0 500999 252 0 0 25 0 9 0 721656849 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17556/tid=17570] ppid=17554 vsize=793800 CPUtime=4916.6 cores=0-7
/proc/17556/task/17570/stat : 17570 (plingeling) R 17554 17556 17530 0 -1 4202560 1423670 1253 0 0 491404 256 0 0 25 0 9 0 721656850 812851200 159698 33554432000 4194304 4417452 140737162988320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 793800

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.46
CPU time (s): 40001
CPU user time (s): 39980.2
CPU system time (s): 20.7518
CPU usage (%): 798.031
Max. virtual memory (cumulated for all children) (KiB): 813256

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39980.2
system time used= 20.7518
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11915043
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 807
involuntary context switches= 187846

runsolver used 27.1719 second user time and 68.7485 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-22 23:43:11
IDJOB=3394630
IDBENCH=83365
IDSOLVER=1851
FILE ID=node139/3394630-1306100591
RUNJOBID= node139-1306100591-17544
PBS_JOBID= 13387990
Free space on /tmp= 73264 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394630-1306100591/watcher-3394630-1306100591 -o /tmp/evaluation-result-3394630-1306100591/solver-3394630-1306100591 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394630-1306100591.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b61e426b264831836f140414cdcf3e23
RANDOM SEED=113762871

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8328992 kB
Buffers:        367756 kB
Cached:        7517676 kB
SwapCached:          0 kB
Active:       18930612 kB
Inactive:      5326288 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8328992 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             400 kB
Writeback:           4 kB
AnonPages:    16371412 kB
Mapped:          43920 kB
Slab:           212568 kB
PageTables:      78712 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 170867144 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node139 at 2011-05-23 01:06:46