Trace number 3394584

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.5 5011.26

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_464.cnf
MD5SUMa722a199fd84ba0b319251daa47aa19c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2654.41
Satisfiable
(Un)Satisfiability was proved
Number of variables232
Number of clauses28991
Sum of the clauses size130855
Maximum clause length22
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 277
Number of clauses of size 326594
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52320

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394584-1306100064/watcher-3394584-1306100064 -o /tmp/evaluation-result-3394584-1306100064/solver-3394584-1306100064 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394584-1306100064.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.03 8.06 8.01 1/507 5895
/proc/meminfo: memFree=15330340/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=10004 CPUtime=0 cores=0-7
/proc/5895/stat : 5895 (plingeling) R 5893 5895 5643 0 -1 4202496 594 1254 0 0 0 0 0 0 22 0 1 0 800237166 10244096 524 33554432000 4194304 4417452 140734636041424 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/5895/statm: 2501 524 148 55 0 387 0

[startup+0.0715321 s]
/proc/loadavg: 8.03 8.06 8.01 1/507 5895
/proc/meminfo: memFree=15330340/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=27460 CPUtime=0.06 cores=0-7
/proc/5895/stat : 5895 (plingeling) R 5893 5895 5643 0 -1 4202496 5053 1254 0 0 6 0 0 0 22 0 1 0 800237166 28119040 4889 33554432000 4194304 4417452 140734636041424 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/5895/statm: 6865 4889 149 55 0 4751 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 27460

[startup+0.100454 s]
/proc/loadavg: 8.03 8.06 8.01 1/507 5895
/proc/meminfo: memFree=15330340/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=174768 CPUtime=0.24 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 5109 1254 0 0 24 0 0 0 18 0 9 0 800237166 178962432 4855 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 43692 4855 172 55 0 41578 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 174768

[startup+0.300419 s]
/proc/loadavg: 8.03 8.06 8.01 1/507 5895
/proc/meminfo: memFree=15330340/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=178212 CPUtime=1.84 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 8023 1254 0 0 184 0 0 0 18 0 9 0 800237166 182489088 5753 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 44553 5753 180 55 0 42439 0
Current children cumulated CPU time (s) 1.84
Current children cumulated vsize (KiB) 178212

[startup+0.700351 s]
/proc/loadavg: 8.03 8.06 8.01 1/507 5895
/proc/meminfo: memFree=15330340/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=178712 CPUtime=5.04 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 8148 1254 0 0 504 0 0 0 18 0 9 0 800237166 183001088 5878 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 44678 5878 180 55 0 42564 0
Current children cumulated CPU time (s) 5.04
Current children cumulated vsize (KiB) 178712

[startup+1.50121 s]
/proc/loadavg: 8.03 8.06 8.01 9/516 5909
/proc/meminfo: memFree=15304972/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=184552 CPUtime=11.43 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 9608 1254 0 0 1142 1 0 0 18 0 9 0 800237166 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 46138 7338 180 55 0 44024 0
[pid=5895/tid=5902] ppid=5893 vsize=184552 CPUtime=1.42 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 482 1254 0 0 142 0 0 0 19 0 9 0 800237173 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=184552 CPUtime=1.41 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 350 1254 0 0 141 0 0 0 25 0 9 0 800237173 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=184552 CPUtime=1.4 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 283 1254 0 0 140 0 0 0 25 0 9 0 800237173 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4343760 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=184552 CPUtime=1.42 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1389 1254 0 0 142 0 0 0 20 0 9 0 800237173 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4365952 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=184552 CPUtime=1.42 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 562 1254 0 0 142 0 0 0 20 0 9 0 800237173 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=184552 CPUtime=1.42 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 648 1254 0 0 142 0 0 0 23 0 9 0 800237174 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=184552 CPUtime=1.42 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 297 1254 0 0 142 0 0 0 25 0 9 0 800237174 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=184552 CPUtime=1.42 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 528 1254 0 0 142 0 0 0 25 0 9 0 800237174 188981248 7338 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.43
Current children cumulated vsize (KiB) 184552

[startup+3.10093 s]
/proc/loadavg: 8.03 8.06 8.01 9/516 5909
/proc/meminfo: memFree=15295052/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=192452 CPUtime=24.21 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 12402 1254 0 0 2420 1 0 0 18 0 9 0 800237166 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 48113 9313 180 55 0 45999 0
[pid=5895/tid=5902] ppid=5893 vsize=192452 CPUtime=3.02 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1042 1254 0 0 302 0 0 0 25 0 9 0 800237173 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=192452 CPUtime=3.01 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 658 1254 0 0 301 0 0 0 25 0 9 0 800237173 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=192452 CPUtime=2.98 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 702 1254 0 0 298 0 0 0 25 0 9 0 800237173 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4248242 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=192452 CPUtime=3.02 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1582 1254 0 0 302 0 0 0 25 0 9 0 800237173 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=192452 CPUtime=3.02 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1002 1254 0 0 302 0 0 0 25 0 9 0 800237173 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=192452 CPUtime=3.02 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 875 1254 0 0 302 0 0 0 25 0 9 0 800237174 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4258436 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=192452 CPUtime=3.02 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 764 1254 0 0 302 0 0 0 25 0 9 0 800237174 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=192452 CPUtime=3.01 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 708 1254 0 0 301 0 0 0 25 0 9 0 800237174 197070848 9313 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.21
Current children cumulated vsize (KiB) 192452

[startup+6.30037 s]
/proc/loadavg: 8.03 8.06 8.01 9/516 5909
/proc/meminfo: memFree=15274784/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=216580 CPUtime=49.75 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 19156 1254 0 0 4973 2 0 0 18 0 9 0 800237166 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 54145 15345 180 55 0 52031 0
[pid=5895/tid=5902] ppid=5893 vsize=216580 CPUtime=6.22 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1840 1254 0 0 622 0 0 0 25 0 9 0 800237173 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=216580 CPUtime=6.21 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 1333 1254 0 0 621 0 0 0 25 0 9 0 800237173 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=216580 CPUtime=6.12 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1641 1254 0 0 612 0 0 0 25 0 9 0 800237173 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=216580 CPUtime=6.22 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 2823 1254 0 0 622 0 0 0 25 0 9 0 800237173 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=216580 CPUtime=6.22 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1802 1254 0 0 622 0 0 0 25 0 9 0 800237173 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=216580 CPUtime=6.21 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1387 1254 0 0 621 0 0 0 25 0 9 0 800237174 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4251066 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=216580 CPUtime=6.21 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1423 1254 0 0 621 0 0 0 25 0 9 0 800237174 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366092 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=216580 CPUtime=6.21 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1838 1254 0 0 621 0 0 0 25 0 9 0 800237174 221777920 15345 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.75
Current children cumulated vsize (KiB) 216580

[startup+12.7013 s]
/proc/loadavg: 8.02 8.06 8.01 9/516 5909
/proc/meminfo: memFree=15255740/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=229708 CPUtime=100.84 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 27944 1254 0 0 10081 3 0 0 18 0 9 0 800237166 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 57427 18659 180 55 0 55313 0
[pid=5895/tid=5902] ppid=5893 vsize=229708 CPUtime=12.62 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 2335 1254 0 0 1262 0 0 0 25 0 9 0 800237173 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=229708 CPUtime=12.61 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 2376 1254 0 0 1261 0 0 0 25 0 9 0 800237173 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=229708 CPUtime=12.41 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1641 1254 0 0 1241 0 0 0 25 0 9 0 800237173 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=229708 CPUtime=12.62 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 5562 1254 0 0 1262 0 0 0 25 0 9 0 800237173 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=229708 CPUtime=12.61 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 3647 1254 0 0 1261 0 0 0 25 0 9 0 800237173 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=229708 CPUtime=12.61 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 3153 1254 0 0 1261 0 0 0 25 0 9 0 800237174 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=229708 CPUtime=12.62 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1423 1254 0 0 1262 0 0 0 25 0 9 0 800237174 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366087 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=229708 CPUtime=12.61 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 2738 1254 0 0 1261 0 0 0 25 0 9 0 800237174 235220992 18659 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 100.84
Current children cumulated vsize (KiB) 229708

[startup+25.501 s]
/proc/loadavg: 8.02 8.06 8.00 9/516 5910
/proc/meminfo: memFree=15245068/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=243716 CPUtime=203.02 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 60746 1254 0 0 20292 10 0 0 18 0 9 0 800237166 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 60929 22129 180 55 0 58815 0
[pid=5895/tid=5902] ppid=5893 vsize=243716 CPUtime=25.41 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 4003 1254 0 0 2541 0 0 0 25 0 9 0 800237173 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=243716 CPUtime=25.41 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 7519 1254 0 0 2540 1 0 0 25 0 9 0 800237173 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=243716 CPUtime=24.98 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 4953 1254 0 0 2498 0 0 0 25 0 9 0 800237173 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=243716 CPUtime=25.42 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 13181 1254 0 0 2540 2 0 0 25 0 9 0 800237173 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4356884 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=243716 CPUtime=25.42 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 8257 1254 0 0 2541 1 0 0 25 0 9 0 800237173 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=243716 CPUtime=25.42 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 7071 1254 0 0 2541 1 0 0 25 0 9 0 800237174 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=243716 CPUtime=25.41 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1700 1254 0 0 2541 0 0 0 25 0 9 0 800237174 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=243716 CPUtime=25.41 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 8993 1254 0 0 2540 1 0 0 25 0 9 0 800237174 249565184 22129 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.02
Current children cumulated vsize (KiB) 243716

[startup+51.1005 s]
/proc/loadavg: 8.08 8.07 8.01 9/516 5910
/proc/meminfo: memFree=15230696/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=265428 CPUtime=407.37 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 139313 1254 0 0 40714 23 0 0 18 0 9 0 800237166 271798272 27589 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 66357 27589 180 55 0 64243 0
[pid=5895/tid=5902] ppid=5893 vsize=265428 CPUtime=51.02 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 10368 1254 0 0 5100 2 0 0 25 0 9 0 800237173 271798272 27589 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=265428 CPUtime=51.01 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 18740 1254 0 0 5098 3 0 0 25 0 9 0 800237173 271798272 27589 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=265428 CPUtime=50.15 cores=0-7

################
# More data... #
################

/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1243157 1254 0 0 466012 220 0 0 25 0 9 0 800237173 688726016 129346 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=672584 CPUtime=4662.31 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1270459 1254 0 0 466015 216 0 0 25 0 9 0 800237173 688726016 129346 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=672584 CPUtime=4661.03 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1189804 1254 0 0 465894 209 0 0 25 0 9 0 800237174 688726016 129346 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=672584 CPUtime=4662.28 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1220603 1254 0 0 466032 196 0 0 25 0 9 0 800237174 688726016 129346 33554432000 4194304 4417452 140734636041424 18446744073709551615 4357737 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=672584 CPUtime=4660.75 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1349756 1254 0 0 465850 225 0 0 25 0 9 0 800237174 688726016 129346 33554432000 4194304 4417452 140734636041424 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37215.1
Current children cumulated vsize (KiB) 672584

[startup+4722.32 s]
/proc/loadavg: 8.02 8.05 8.02 9/516 6050
/proc/meminfo: memFree=14712432/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=773484 CPUtime=37694.2 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 9837175 1254 0 0 3767756 1666 0 0 18 0 9 0 800237166 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 193371 154571 180 55 0 191257 0
[pid=5895/tid=5902] ppid=5893 vsize=773484 CPUtime=4722.28 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1180028 1254 0 0 472031 197 0 0 25 0 9 0 800237173 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=773484 CPUtime=4722.17 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 1286368 1254 0 0 471999 218 0 0 25 0 9 0 800237173 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=773484 CPUtime=4640.86 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1040398 1254 0 0 463914 172 0 0 25 0 9 0 800237173 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=773484 CPUtime=4722.34 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1254471 1254 0 0 472012 222 0 0 25 0 9 0 800237173 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=773484 CPUtime=4722.34 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1282443 1254 0 0 472016 218 0 0 25 0 9 0 800237173 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=773484 CPUtime=4721.05 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1200674 1254 0 0 471894 211 0 0 25 0 9 0 800237174 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=773484 CPUtime=4722.31 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1229137 1254 0 0 472034 197 0 0 25 0 9 0 800237174 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=773484 CPUtime=4720.74 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1358587 1254 0 0 471848 226 0 0 25 0 9 0 800237174 792047616 154571 33554432000 4194304 4417452 140734636041424 18446744073709551615 4321299 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37694.2
Current children cumulated vsize (KiB) 773484

[startup+4782.3 s]
/proc/loadavg: 8.04 8.05 8.02 9/516 6051
/proc/meminfo: memFree=14773048/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=713516 CPUtime=38173 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 9928675 1254 0 0 3815623 1681 0 0 18 0 9 0 800237166 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 178379 139579 180 55 0 176265 0
[pid=5895/tid=5902] ppid=5893 vsize=713516 CPUtime=4782.27 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1187064 1254 0 0 478028 199 0 0 25 0 9 0 800237173 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=713516 CPUtime=4782.15 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 1293340 1254 0 0 477996 219 0 0 25 0 9 0 800237173 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=713516 CPUtime=4699.81 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1055883 1254 0 0 469807 174 0 0 25 0 9 0 800237173 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=713516 CPUtime=4782.32 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1261686 1254 0 0 478009 223 0 0 25 0 9 0 800237173 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=713516 CPUtime=4782.31 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1300434 1254 0 0 478010 221 0 0 25 0 9 0 800237173 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=713516 CPUtime=4781.03 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1218079 1254 0 0 477889 214 0 0 25 0 9 0 800237174 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=713516 CPUtime=4782.28 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1242026 1254 0 0 478029 199 0 0 25 0 9 0 800237174 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=713516 CPUtime=4780.72 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1365094 1254 0 0 477844 228 0 0 25 0 9 0 800237174 730640384 139579 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38173
Current children cumulated vsize (KiB) 713516

[startup+4842.3 s]
/proc/loadavg: 8.05 8.05 8.01 9/516 6053
/proc/meminfo: memFree=14752688/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=737656 CPUtime=38652 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 10032209 1254 0 0 3863502 1696 0 0 18 0 9 0 800237166 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 184414 145614 180 55 0 182300 0
[pid=5895/tid=5902] ppid=5893 vsize=737656 CPUtime=4842.27 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1202347 1254 0 0 484025 202 0 0 25 0 9 0 800237173 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=737656 CPUtime=4842.14 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 1310959 1254 0 0 483993 221 0 0 25 0 9 0 800237173 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4251107 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=737656 CPUtime=4758.77 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1064120 1254 0 0 475702 175 0 0 25 0 9 0 800237173 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=737656 CPUtime=4842.32 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1274530 1254 0 0 484007 225 0 0 25 0 9 0 800237173 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=737656 CPUtime=4842.32 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1310806 1254 0 0 484009 223 0 0 25 0 9 0 800237173 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=737656 CPUtime=4841.03 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1221588 1254 0 0 483888 215 0 0 25 0 9 0 800237174 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=737656 CPUtime=4842.29 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1256036 1254 0 0 484028 201 0 0 25 0 9 0 800237174 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=737656 CPUtime=4840.7 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1386754 1254 0 0 483840 230 0 0 25 0 9 0 800237174 755359744 145614 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38652
Current children cumulated vsize (KiB) 737656

[startup+4902.3 s]
/proc/loadavg: 8.21 8.09 8.02 9/516 6055
/proc/meminfo: memFree=14736268/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=750332 CPUtime=39130.9 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 10126960 1254 0 0 3911383 1711 0 0 18 0 9 0 800237166 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 187583 148782 180 55 0 185469 0
[pid=5895/tid=5902] ppid=5893 vsize=750332 CPUtime=4902.26 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1215114 1254 0 0 490022 204 0 0 25 0 9 0 800237173 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=750332 CPUtime=4902.15 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 1317932 1254 0 0 489992 223 0 0 25 0 9 0 800237173 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4343993 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=750332 CPUtime=4817.75 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1074563 1254 0 0 481598 177 0 0 25 0 9 0 800237173 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4250532 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=750332 CPUtime=4902.33 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1291880 1254 0 0 490005 228 0 0 25 0 9 0 800237173 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=750332 CPUtime=4902.32 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1319022 1254 0 0 490008 224 0 0 25 0 9 0 800237173 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=750332 CPUtime=4901.03 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1234069 1254 0 0 489886 217 0 0 25 0 9 0 800237174 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=750332 CPUtime=4902.29 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1268979 1254 0 0 490025 204 0 0 25 0 9 0 800237174 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=750332 CPUtime=4900.69 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1400332 1254 0 0 489837 232 0 0 25 0 9 0 800237174 768339968 148782 33554432000 4194304 4417452 140734636041424 18446744073709551615 4344131 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39130.9
Current children cumulated vsize (KiB) 750332

[startup+4962.3 s]
/proc/loadavg: 8.15 8.09 8.02 9/516 6056
/proc/meminfo: memFree=14765624/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=719940 CPUtime=39609.9 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 10250221 1254 0 0 3959255 1734 0 0 18 0 9 0 800237166 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 179985 141185 180 55 0 177871 0
[pid=5895/tid=5902] ppid=5893 vsize=719940 CPUtime=4962.26 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1233202 1254 0 0 496020 206 0 0 25 0 9 0 800237173 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=719940 CPUtime=4962.15 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 1331358 1254 0 0 495991 224 0 0 25 0 9 0 800237173 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=719940 CPUtime=4876.71 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1082536 1254 0 0 487493 178 0 0 25 0 9 0 800237173 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=719940 CPUtime=4962.33 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1311899 1254 0 0 496001 232 0 0 25 0 9 0 800237173 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=719940 CPUtime=4962.32 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1333464 1254 0 0 496005 227 0 0 25 0 9 0 800237173 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=719940 CPUtime=4961.04 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1255352 1254 0 0 495881 223 0 0 25 0 9 0 800237174 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=719940 CPUtime=4962.29 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1287199 1254 0 0 496021 208 0 0 25 0 9 0 800237174 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=719940 CPUtime=4960.67 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1410142 1254 0 0 495834 233 0 0 25 0 9 0 800237174 737218560 141185 33554432000 4194304 4417452 140734636041424 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39609.9
Current children cumulated vsize (KiB) 719940



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.2 s]
/proc/loadavg: 8.10 8.08 8.02 9/516 6057
/proc/meminfo: memFree=14649900/32950940 swapFree=67111364/67111528
[pid=5895] ppid=5893 vsize=836072 CPUtime=40000.3 cores=0-7
/proc/5895/stat : 5895 (plingeling) S 5893 5895 5643 0 -1 4202496 10334453 1254 0 0 3998284 1745 0 0 18 0 9 0 800237166 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5895/statm: 209018 170218 180 55 0 206904 0
[pid=5895/tid=5902] ppid=5893 vsize=836072 CPUtime=5011.18 cores=0-7
/proc/5895/task/5902/stat : 5902 (plingeling) R 5893 5895 5643 0 -1 4202560 1241836 1254 0 0 500910 208 0 0 25 0 9 0 800237173 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5895/tid=5903] ppid=5893 vsize=836072 CPUtime=5011.07 cores=0-7
/proc/5895/task/5903/stat : 5903 (plingeling) R 5893 5895 5643 0 -1 4202560 1347877 1254 0 0 500880 227 0 0 25 0 9 0 800237173 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5895/tid=5904] ppid=5893 vsize=836072 CPUtime=4924.77 cores=0-7
/proc/5895/task/5904/stat : 5904 (plingeling) R 5893 5895 5643 0 -1 4202560 1093150 1254 0 0 492298 179 0 0 25 0 9 0 800237173 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5895/tid=5905] ppid=5893 vsize=836072 CPUtime=5011.24 cores=0-7
/proc/5895/task/5905/stat : 5905 (plingeling) R 5893 5895 5643 0 -1 4202560 1318677 1254 0 0 500892 232 0 0 25 0 9 0 800237173 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5895/tid=5906] ppid=5893 vsize=836072 CPUtime=5011.24 cores=0-7
/proc/5895/task/5906/stat : 5906 (plingeling) R 5893 5895 5643 0 -1 4202560 1338728 1254 0 0 500896 228 0 0 25 0 9 0 800237173 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5895/tid=5907] ppid=5893 vsize=836072 CPUtime=5009.95 cores=0-7
/proc/5895/task/5907/stat : 5907 (plingeling) R 5893 5895 5643 0 -1 4202560 1275985 1254 0 0 500770 225 0 0 25 0 9 0 800237174 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5895/tid=5908] ppid=5893 vsize=836072 CPUtime=5011.21 cores=0-7
/proc/5895/task/5908/stat : 5908 (plingeling) R 5893 5895 5643 0 -1 4202560 1295918 1254 0 0 500912 209 0 0 25 0 9 0 800237174 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5895/tid=5909] ppid=5893 vsize=836072 CPUtime=5009.58 cores=0-7
/proc/5895/task/5909/stat : 5909 (plingeling) R 5893 5895 5643 0 -1 4202560 1417213 1254 0 0 500724 234 0 0 25 0 9 0 800237174 856137728 170218 33554432000 4194304 4417452 140734636041424 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 836072

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.26
CPU time (s): 40000.5
CPU user time (s): 39983
CPU system time (s): 17.4853
CPU usage (%): 798.212
Max. virtual memory (cumulated for all children) (KiB): 836072

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39983
system time used= 17.4853
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10335707
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 369
involuntary context switches= 190240

runsolver used 24.9622 second user time and 61.5266 second system time

The end

Launcher Data 

Begin job on node117 at 2011-05-22 23:34:24
IDJOB=3394584
IDBENCH=83268
IDSOLVER=1851
FILE ID=node117/3394584-1306100064
RUNJOBID= node117-1306094871-5657
PBS_JOBID= 13387966
Free space on /tmp= 73304 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-22_464.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394584-1306100064/watcher-3394584-1306100064 -o /tmp/evaluation-result-3394584-1306100064/solver-3394584-1306100064 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394584-1306100064.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a722a199fd84ba0b319251daa47aa19c
RANDOM SEED=84322915

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      15330620 kB
Buffers:        368696 kB
Cached:        7089192 kB
SwapCached:          0 kB
Active:       12797560 kB
Inactive:      4446080 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      15330620 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             800 kB
Writeback:           0 kB
AnonPages:     9786168 kB
Mapped:          41612 kB
Slab:           247308 kB
PageTables:      57952 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 149468292 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73300 MiB
End job on node117 at 2011-05-23 00:57:57