Trace number 3394570

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.6 5014.05

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-5-5_34309.cnf
MD5SUMe252fbf81407f3388187ab50f0786909
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables34307
Number of clauses708206
Sum of the clauses size3541030
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 5708206
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394570-1306099941/watcher-3394570-1306099941 -o /tmp/evaluation-result-3394570-1306099941/solver-3394570-1306099941 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394570-1306099941.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.48 7.95 7.97 2/481 4281
/proc/meminfo: memFree=16915552/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=10268 CPUtime=0 cores=0-7
/proc/4281/stat : 4281 (plingeling) R 4279 4281 4255 0 -1 4202496 635 1256 0 0 0 0 0 0 23 0 1 0 454185490 10514432 565 33554432000 4194304 4417452 140735042211536 18446744073709551615 268660356043 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/4281/statm: 2567 565 147 55 0 453 0

[startup+0.104037 s]
/proc/loadavg: 7.48 7.95 7.97 2/481 4281
/proc/meminfo: memFree=16915552/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=31192 CPUtime=0.09 cores=0-7
/proc/4281/stat : 4281 (plingeling) R 4279 4281 4255 0 -1 4202496 5891 1256 0 0 9 0 0 0 23 0 1 0 454185490 31940608 5821 33554432000 4194304 4417452 140735042211536 18446744073709551615 4259147 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/4281/statm: 7798 5821 148 55 0 5684 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31192

[startup+0.201002 s]
/proc/loadavg: 7.48 7.95 7.97 2/481 4281
/proc/meminfo: memFree=16915552/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=52080 CPUtime=0.19 cores=0-7
/proc/4281/stat : 4281 (plingeling) R 4279 4281 4255 0 -1 4202496 10913 1256 0 0 18 1 0 0 23 0 1 0 454185490 53329920 10844 33554432000 4194304 4417452 140735042211536 18446744073709551615 268660356189 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/4281/statm: 13020 10871 148 55 0 10906 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 52080

[startup+0.300985 s]
/proc/loadavg: 7.48 7.95 7.97 2/481 4281
/proc/meminfo: memFree=16915552/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=52080 CPUtime=0.29 cores=0-7
/proc/4281/stat : 4281 (plingeling) R 4279 4281 4255 0 -1 4202496 11113 1256 0 0 28 1 0 0 24 0 1 0 454185490 53329920 11043 33554432000 4194304 4417452 140735042211536 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/4281/statm: 13020 11043 148 55 0 10906 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 52080

[startup+0.700923 s]
/proc/loadavg: 7.48 7.95 7.97 2/481 4281
/proc/meminfo: memFree=16915552/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=93952 CPUtime=0.69 cores=0-7
/proc/4281/stat : 4281 (plingeling) R 4279 4281 4255 0 -1 4202496 21581 1256 0 0 67 2 0 0 25 0 1 0 454185490 96206848 21511 33554432000 4194304 4417452 140735042211536 18446744073709551615 4320938 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/4281/statm: 23488 21511 148 55 0 21374 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 93952

[startup+1.50078 s]
/proc/loadavg: 7.48 7.95 7.97 2/482 4287
/proc/meminfo: memFree=16763652/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=159488 CPUtime=1.49 cores=0-7
/proc/4281/stat : 4281 (plingeling) R 4279 4281 4255 0 -1 4202496 37965 1256 0 0 145 4 0 0 25 0 1 0 454185490 163315712 37895 33554432000 4194304 4417452 140735042211536 18446744073709551615 4323168 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/4281/statm: 39872 37895 148 55 0 37758 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 159488

[startup+3.10049 s]
/proc/loadavg: 7.48 7.95 7.97 2/482 4287
/proc/meminfo: memFree=16612248/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=309900 CPUtime=3.08 cores=0-7
/proc/4281/stat : 4281 (plingeling) R 4279 4281 4255 0 -1 4202496 75576 1256 0 0 301 7 0 0 25 0 1 0 454185490 317337600 75498 33554432000 4194304 4417452 140735042211536 18446744073709551615 4323168 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/4281/statm: 77475 75498 148 55 0 75361 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 309900

[startup+6.3009 s]
/proc/loadavg: 7.60 7.97 7.98 9/490 4295
/proc/meminfo: memFree=16475908/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=518720 CPUtime=22.89 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 150707 1256 0 0 2268 21 0 0 18 0 9 0 454185490 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 129680 107229 178 55 0 127566 0
[pid=4281/tid=4288] ppid=4279 vsize=518720 CPUtime=2.38 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 5335 1256 0 0 238 0 0 0 21 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4261903 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=518720 CPUtime=2.37 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 5427 1256 0 0 236 1 0 0 25 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4259186 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=518720 CPUtime=2.37 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 5670 1256 0 0 236 1 0 0 25 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=518720 CPUtime=2.38 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 4737 1256 0 0 238 0 0 0 22 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4357826 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=518720 CPUtime=2.32 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 5361 1256 0 0 232 0 0 0 25 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=518720 CPUtime=2.37 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 5325 1256 0 0 236 1 0 0 25 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4277567 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=518720 CPUtime=2.34 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 5168 1256 0 0 233 1 0 0 21 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4234399 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=518720 CPUtime=2.37 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 5324 1256 0 0 236 1 0 0 21 0 9 0 454185880 531169280 107229 33554432000 4194304 4417452 140735042211536 18446744073709551615 4236598 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.89
Current children cumulated vsize (KiB) 518720

[startup+12.7008 s]
/proc/loadavg: 7.64 7.97 7.98 9/490 4295
/proc/meminfo: memFree=16474452/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=591264 CPUtime=73.98 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 157108 1256 0 0 7377 21 0 0 18 0 9 0 454185490 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 147816 109936 179 55 0 145702 0
[pid=4281/tid=4288] ppid=4279 vsize=591264 CPUtime=8.78 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 5737 1256 0 0 878 0 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=591264 CPUtime=8.77 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 5695 1256 0 0 876 1 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=591264 CPUtime=8.77 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 6268 1256 0 0 876 1 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=591264 CPUtime=8.78 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 7834 1256 0 0 878 0 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=591264 CPUtime=8.72 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 5361 1256 0 0 872 0 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4236290 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=591264 CPUtime=8.77 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 5593 1256 0 0 876 1 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=591264 CPUtime=8.63 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 5637 1256 0 0 862 1 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=591264 CPUtime=8.77 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 6623 1256 0 0 876 1 0 0 25 0 9 0 454185880 605454336 109936 33554432000 4194304 4417452 140735042211536 18446744073709551615 4260714 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 73.98
Current children cumulated vsize (KiB) 591264

[startup+25.5005 s]
/proc/loadavg: 7.72 7.97 7.98 9/490 4296
/proc/meminfo: memFree=16448684/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=617996 CPUtime=176.16 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 171624 1256 0 0 17593 23 0 0 18 0 9 0 454185490 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 154499 116391 179 55 0 152385 0
[pid=4281/tid=4288] ppid=4279 vsize=617996 CPUtime=21.59 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 5902 1256 0 0 2158 1 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=617996 CPUtime=21.58 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 6420 1256 0 0 2156 2 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4250715 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=617996 CPUtime=21.57 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 7560 1256 0 0 2156 1 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4278367 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=617996 CPUtime=21.58 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 16031 1256 0 0 2157 1 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=617996 CPUtime=21.53 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 7079 1256 0 0 2152 1 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4259140 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=617996 CPUtime=21.57 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 6380 1256 0 0 2156 1 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4365042 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=617996 CPUtime=21.22 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 6731 1256 0 0 2121 1 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4358060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=617996 CPUtime=21.57 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 7161 1256 0 0 2156 1 0 0 25 0 9 0 454185880 632827904 116391 33554432000 4194304 4417452 140735042211536 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 176.16
Current children cumulated vsize (KiB) 617996

[startup+51.101 s]
/proc/loadavg: 7.88 7.99 7.98 9/490 4296
/proc/meminfo: memFree=16384556/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=670240 CPUtime=380.55 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 208039 1256 0 0 38026 29 0 0 18 0 9 0 454185490 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 167560 129452 179 55 0 165446 0
[pid=4281/tid=4288] ppid=4279 vsize=670240 CPUtime=47.18 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 8648 1256 0 0 4717 1 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=670240 CPUtime=47.17 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 9872 1256 0 0 4715 2 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=670240 CPUtime=47.16 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 11347 1256 0 0 4715 1 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=670240 CPUtime=47.18 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 34702 1256 0 0 4714 4 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=670240 CPUtime=47.13 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 8652 1256 0 0 4712 1 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=670240 CPUtime=47.15 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 8802 1256 0 0 4714 1 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=670240 CPUtime=46.4 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 9044 1256 0 0 4639 1 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=670240 CPUtime=47.17 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 8612 1256 0 0 4716 1 0 0 25 0 9 0 454185880 686325760 129452 33554432000 4194304 4417452 140735042211536 18446744073709551615 4353531 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 380.55
Current children cumulated vsize (KiB) 670240

[startup+102.301 s]
/proc/loadavg: 8.02 8.00 7.99 9/490 4298
/proc/meminfo: memFree=16348872/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=721416 CPUtime=789.36 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 301238 1256 0 0 78893 43 0 0 18 0 9 0 454185490 738729984 142255 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 180354 142255 179 55 0 178240 0
[pid=4281/tid=4288] ppid=4279 vsize=721416 CPUtime=98.41 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 17570 1256 0 0 9839 2 0 0 25 0 9 0 454185880 738729984 142255 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=721416 CPUtime=98.4 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 19771 1256 0 0 9836 4 0 0 25 0 9 0 454185880 738729984 142255 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=721416 CPUtime=98.38 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 21829 1256 0 0 9835 3 0 0 25 0 9 0 454185880 738729984 142255 33554432000 4194304 4417452 140735042211536 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=721416 CPUtime=98.4 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 69224 1256 0 0 9831 9 0 0 25 0 9 0 454185880 738729984 142255 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=721416 CPUtime=98.34 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 17187 1256 0 0 9831 3 0 0 25 0 9 0 454185880 738729984 142255 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366113 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=721416 CPUtime=98.36 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 18874 1256 0 0 9834 2 0 0 25 0 9 0 454185880 738729984 142255 33554432000 4194304 4417452 140735042211536 18446744073709551615 4357300 0 0 4096 17442 0 0 0 -1 2 0 0 0

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.07 8.07 8.01 9/490 4433
/proc/meminfo: memFree=13691384/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=3372536 CPUtime=37672.4 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 10742991 1256 0 0 3765495 1747 0 0 18 0 9 0 454185490 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 843134 805026 179 55 0 841020 0
[pid=4281/tid=4288] ppid=4279 vsize=3372536 CPUtime=4718.5 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 1377096 1256 0 0 471627 223 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4263180 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=3372536 CPUtime=4718.49 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 1445906 1256 0 0 471618 231 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=3372536 CPUtime=4718.49 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 1503752 1256 0 0 471617 232 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=3372536 CPUtime=4718.48 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 917335 1256 0 0 471667 181 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=3372536 CPUtime=4717.59 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 1163771 1256 0 0 471575 184 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=3372536 CPUtime=4717.16 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 1500940 1256 0 0 471480 236 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=3372536 CPUtime=4641.33 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 1174270 1256 0 0 463937 196 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=3372536 CPUtime=4718.49 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 1551561 1256 0 0 471600 249 0 0 25 0 9 0 454185880 3453476864 805026 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37672.4
Current children cumulated vsize (KiB) 3372536

[startup+4782.3 s]
/proc/loadavg: 8.07 8.07 8.01 9/490 4435
/proc/meminfo: memFree=14005576/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=3063980 CPUtime=38151.4 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 10820007 1256 0 0 3813381 1757 0 0 18 0 9 0 454185490 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 765995 727887 179 55 0 763881 0
[pid=4281/tid=4288] ppid=4279 vsize=3063980 CPUtime=4778.48 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 1386803 1256 0 0 477624 224 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=3063980 CPUtime=4778.47 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 1454808 1256 0 0 477615 232 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=3063980 CPUtime=4778.48 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 1516682 1256 0 0 477613 235 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4357787 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=3063980 CPUtime=4778.46 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 917335 1256 0 0 477665 181 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=3063980 CPUtime=4777.57 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 1168316 1256 0 0 477573 184 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=3063980 CPUtime=4777.13 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 1515732 1256 0 0 477475 238 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=3063980 CPUtime=4700.34 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 1180459 1256 0 0 469838 196 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=3063980 CPUtime=4778.48 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 1571512 1256 0 0 477597 251 0 0 25 0 9 0 454185880 3137515520 727887 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38151.4
Current children cumulated vsize (KiB) 3063980

[startup+4842.32 s]
/proc/loadavg: 8.10 8.08 8.01 9/490 4436
/proc/meminfo: memFree=13739216/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=3324868 CPUtime=38630.5 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 10945912 1256 0 0 3861276 1777 0 0 18 0 9 0 454185490 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 831217 793109 179 55 0 829103 0
[pid=4281/tid=4288] ppid=4279 vsize=3324868 CPUtime=4838.5 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 1394268 1256 0 0 483624 226 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=3324868 CPUtime=4838.49 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 1479764 1256 0 0 483613 236 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=3324868 CPUtime=4838.49 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 1546811 1256 0 0 483612 237 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=3324868 CPUtime=4838.48 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 917335 1256 0 0 483667 181 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=3324868 CPUtime=4837.59 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 1206161 1256 0 0 483569 190 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=3324868 CPUtime=4837.13 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 1529386 1256 0 0 483472 241 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=3324868 CPUtime=4759.37 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 1182497 1256 0 0 475740 197 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=3324868 CPUtime=4838.49 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 1581330 1256 0 0 483596 253 0 0 25 0 9 0 454185880 3404664832 793109 33554432000 4194304 4417452 140735042211536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38630.5
Current children cumulated vsize (KiB) 3324868

[startup+4902.3 s]
/proc/loadavg: 8.07 8.08 8.01 9/490 4438
/proc/meminfo: memFree=14157060/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=2896916 CPUtime=39109.4 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 11056175 1256 0 0 3909146 1794 0 0 18 0 9 0 454185490 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 724229 686121 179 55 0 722115 0
[pid=4281/tid=4288] ppid=4279 vsize=2896916 CPUtime=4898.48 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 1419849 1256 0 0 489619 229 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=2896916 CPUtime=4898.48 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 1486720 1256 0 0 489611 237 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4365050 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=2896916 CPUtime=4898.48 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 1558493 1256 0 0 489608 240 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4260714 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=2896916 CPUtime=4898.46 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 917335 1256 0 0 489665 181 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=2896916 CPUtime=4897.58 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 1214329 1256 0 0 489566 192 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=2896916 CPUtime=4897.1 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 1556517 1256 0 0 489465 245 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4351725 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=2896916 CPUtime=4818.38 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 1193159 1256 0 0 481639 199 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=2896916 CPUtime=4898.48 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 1601413 1256 0 0 489591 257 0 0 25 0 9 0 454185880 2966441984 686121 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39109.4
Current children cumulated vsize (KiB) 2896916

[startup+4962.3 s]
/proc/loadavg: 8.02 8.06 8.00 9/490 4439
/proc/meminfo: memFree=13837884/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=3226316 CPUtime=39588.4 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 11209529 1256 0 0 3957028 1813 0 0 18 0 9 0 454185490 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 806579 768471 179 55 0 804465 0
[pid=4281/tid=4288] ppid=4279 vsize=3226316 CPUtime=4958.48 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 1444888 1256 0 0 495616 232 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=3226316 CPUtime=4958.49 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 1515186 1256 0 0 495608 241 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=3226316 CPUtime=4958.47 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 1571790 1256 0 0 495606 241 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=3226316 CPUtime=4958.47 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 917335 1256 0 0 495666 181 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=3226316 CPUtime=4957.58 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 1234511 1256 0 0 495564 194 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=3226316 CPUtime=4957.09 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 1565023 1256 0 0 495463 246 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4365130 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=3226316 CPUtime=4877.39 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 1226787 1256 0 0 487536 203 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=3226316 CPUtime=4958.48 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 1625649 1256 0 0 495587 261 0 0 25 0 9 0 454185880 3303747584 768471 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39588.4
Current children cumulated vsize (KiB) 3226316



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5013.92 s]
/proc/loadavg: 8.16 8.08 8.01 10/491 4444
/proc/meminfo: memFree=13946844/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=3102780 CPUtime=40000.4 cores=0-7
/proc/4281/stat : 4281 (plingeling) S 4279 4281 4255 0 -1 4202496 11307982 1256 0 0 3998209 1826 0 0 18 0 9 0 454185490 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 775695 737587 179 55 0 773581 0
[pid=4281/tid=4288] ppid=4279 vsize=3102780 CPUtime=5010.12 cores=0-7
/proc/4281/task/4288/stat : 4288 (plingeling) R 4279 4281 4255 0 -1 4202560 1452704 1256 0 0 500779 233 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4281/tid=4289] ppid=4279 vsize=3102780 CPUtime=5010.12 cores=0-7
/proc/4281/task/4289/stat : 4289 (plingeling) R 4279 4281 4255 0 -1 4202560 1521114 1256 0 0 500771 241 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4281/tid=4290] ppid=4279 vsize=3102780 CPUtime=5010.11 cores=0-7
/proc/4281/task/4290/stat : 4290 (plingeling) R 4279 4281 4255 0 -1 4202560 1597974 1256 0 0 500767 244 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4281/tid=4291] ppid=4279 vsize=3102780 CPUtime=5010.11 cores=0-7
/proc/4281/task/4291/stat : 4291 (plingeling) R 4279 4281 4255 0 -1 4202560 926044 1256 0 0 500827 184 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4281/tid=4292] ppid=4279 vsize=3102780 CPUtime=5009.02 cores=0-7
/proc/4281/task/4292/stat : 4292 (plingeling) R 4279 4281 4255 0 -1 4202560 1240937 1256 0 0 500708 194 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4281/tid=4293] ppid=4279 vsize=3102780 CPUtime=5008.71 cores=0-7
/proc/4281/task/4293/stat : 4293 (plingeling) R 4279 4281 4255 0 -1 4202560 1589367 1256 0 0 500622 249 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=3102780 CPUtime=4928.17 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4202560 1230158 1256 0 0 492613 204 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4281/tid=4295] ppid=4279 vsize=3102780 CPUtime=5010.12 cores=0-7
/proc/4281/task/4295/stat : 4295 (plingeling) R 4279 4281 4255 0 -1 4202560 1641324 1256 0 0 500749 263 0 0 25 0 9 0 454185880 3177246720 737587 33554432000 4194304 4417452 140735042211536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 3102780

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5014.02 s]
/proc/loadavg: 8.16 8.08 8.01 10/491 4444
/proc/meminfo: memFree=13946844/32951124 swapFree=46575304/67111528
[pid=4281] ppid=4279 vsize=0 CPUtime=40000.6 cores=0-7
/proc/4281/stat : 4281 (plingeling) Z 4279 4281 4255 0 -1 4203548 11307982 1256 0 0 3998221 1835 0 0 18 0 2 0 454185490 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 6 0 0 0
/proc/4281/statm: 0 0 0 0 0 0 0
[pid=4281/tid=4294] ppid=4279 vsize=0 CPUtime=4928.26 cores=0-7
/proc/4281/task/4294/stat : 4294 (plingeling) R 4279 4281 4255 0 -1 4203588 1230158 1256 0 0 492614 212 0 0 25 0 2 0 454185880 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5014.05
CPU time (s): 40000.6
CPU user time (s): 39982.2
CPU system time (s): 18.3772
CPU usage (%): 797.77
Max. virtual memory (cumulated for all children) (KiB): 3465596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39982.2
system time used= 18.3772
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11309238
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 420
involuntary context switches= 190587

runsolver used 23.6214 second user time and 58.3781 second system time

The end

Launcher Data 

Begin job on node107 at 2011-05-22 23:32:22
IDJOB=3394570
IDBENCH=83251
IDSOLVER=1851
FILE ID=node107/3394570-1306099941
RUNJOBID= node107-1306099941-4269
PBS_JOBID= 13387980
Free space on /tmp= 73168 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-5-5_34309.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394570-1306099941/watcher-3394570-1306099941 -o /tmp/evaluation-result-3394570-1306099941/solver-3394570-1306099941 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394570-1306099941.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e252fbf81407f3388187ab50f0786909
RANDOM SEED=231899581

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16915708 kB
Buffers:        300368 kB
Cached:        6723860 kB
SwapCached:       9840 kB
Active:       11717272 kB
Inactive:      3994620 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16915708 kB
SwapTotal:    67111528 kB
SwapFree:     46575304 kB
Dirty:           23196 kB
Writeback:           0 kB
AnonPages:     8685396 kB
Mapped:          32088 kB
Slab:           157856 kB
PageTables:      94444 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145073584 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73168 MiB
End job on node107 at 2011-05-23 00:55:58