Trace number 3371287

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.2 1205.39

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/11pipe_11_ooo.cnf
MD5SUMf603f11fbfe855df381282b7bce010ea
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables88289
Number of clauses4187694
Sum of the clauses size12410354
Maximum clause length341
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 23770000
Number of clauses of size 3347602
Number of clauses of size 41622
Number of clauses of size 51351
Number of clauses of size over 567118

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371287-1305432777/watcher-3371287-1305432777 -o /tmp/evaluation-result-3371287-1305432777/solver-3371287-1305432777 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371287-1305432777.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.71 4.30 2.29 5/233 14132
/proc/meminfo: memFree=19024824/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=10708 CPUtime=0 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) R 14130 14132 4864 0 -1 4202496 770 1253 0 0 0 0 0 0 24 0 1 0 654877617 10964992 700 33554432000 4194304 4417452 140734236252448 18446744073709551615 248089698048 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14132/statm: 2677 700 148 55 0 563 0

[startup+0.0344599 s]
/proc/loadavg: 7.71 4.30 2.29 5/233 14132
/proc/meminfo: memFree=19024824/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=13756 CPUtime=0.02 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) R 14130 14132 4864 0 -1 4202496 1533 1253 0 0 2 0 0 0 24 0 1 0 654877617 14086144 1463 33554432000 4194304 4417452 140734236252448 18446744073709551615 4231303 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14132/statm: 3439 1463 149 55 0 1325 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13756

[startup+0.100452 s]
/proc/loadavg: 7.71 4.30 2.29 5/233 14132
/proc/meminfo: memFree=19024824/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=22612 CPUtime=0.09 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) R 14130 14132 4864 0 -1 4202496 3779 1253 0 0 9 0 0 0 24 0 1 0 654877617 23154688 3677 33554432000 4194304 4417452 140734236252448 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14132/statm: 5653 3677 149 55 0 3539 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 22612

[startup+0.300415 s]
/proc/loadavg: 7.71 4.30 2.29 5/233 14132
/proc/meminfo: memFree=19024824/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=55904 CPUtime=0.29 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) R 14130 14132 4864 0 -1 4202496 12103 1253 0 0 28 1 0 0 25 0 1 0 654877617 57245696 12000 33554432000 4194304 4417452 140734236252448 18446744073709551615 4209584 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14132/statm: 13976 12000 149 55 0 11862 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 55904

[startup+1.58419 s]
/proc/loadavg: 7.71 4.30 2.29 5/233 14132
/proc/meminfo: memFree=19024824/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=192892 CPUtime=1.57 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) R 14130 14132 4864 0 -1 4202496 46350 1253 0 0 151 6 0 0 25 0 1 0 654877617 197521408 46247 33554432000 4194304 4417452 140734236252448 18446744073709551615 4320926 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14132/statm: 48223 46247 149 55 0 46109 0
Current children cumulated CPU time (s) 1.57
Current children cumulated vsize (KiB) 192892

[startup+1.60018 s]
/proc/loadavg: 7.71 4.30 2.29 5/233 14132
/proc/meminfo: memFree=19024824/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=192892 CPUtime=1.59 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) R 14130 14132 4864 0 -1 4202496 46350 1253 0 0 153 6 0 0 25 0 1 0 654877617 197521408 46247 33554432000 4194304 4417452 140734236252448 18446744073709551615 4235997 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14132/statm: 48223 46247 149 55 0 46109 0
Current children cumulated CPU time (s) 1.59
Current children cumulated vsize (KiB) 192892

[startup+3.10092 s]
/proc/loadavg: 7.66 4.34 2.32 6/234 14138
/proc/meminfo: memFree=18802988/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=375424 CPUtime=3.08 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) R 14130 14132 4864 0 -1 4202496 91983 1253 0 0 296 12 0 0 25 0 1 0 654877617 384434176 91880 33554432000 4194304 4417452 140734236252448 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14132/statm: 93856 91880 149 55 0 91742 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 375424

[startup+6.30036 s]
/proc/loadavg: 7.66 4.34 2.32 9/238 14142
/proc/meminfo: memFree=18655516/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=479752 CPUtime=12.79 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 105167 1253 0 0 1263 16 0 0 25 0 5 0 654877617 491266048 93232 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 119938 93232 174 55 0 117824 0
[pid=14132/tid=14139] ppid=14130 vsize=479752 CPUtime=2.16 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 3012 1253 0 0 216 0 0 0 25 0 5 0 654878030 491266048 93232 33554432000 4194304 4417452 140734236252448 18446744073709551615 4305857 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=479752 CPUtime=2.14 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 3943 1253 0 0 214 0 0 0 25 0 5 0 654878030 491266048 93232 33554432000 4194304 4417452 140734236252448 18446744073709551615 4309982 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=479752 CPUtime=2.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 4404 1253 0 0 216 0 0 0 25 0 5 0 654878030 491266048 93232 33554432000 4194304 4417452 140734236252448 18446744073709551615 4282806 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=479752 CPUtime=2.16 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 1813 1253 0 0 216 0 0 0 25 0 5 0 654878030 491266048 93232 33554432000 4194304 4417452 140734236252448 18446744073709551615 4265462 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.79
Current children cumulated vsize (KiB) 479752

[startup+12.7002 s]
/proc/loadavg: 7.71 4.46 2.38 9/238 14142
/proc/meminfo: memFree=18486636/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=715868 CPUtime=38.33 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 263866 1253 0 0 3792 41 0 0 25 0 5 0 654877617 733048832 143267 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 178967 143267 178 55 0 176853 0
[pid=14132/tid=14139] ppid=14130 vsize=715868 CPUtime=8.55 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 59122 1253 0 0 846 9 0 0 25 0 5 0 654878030 733048832 143267 33554432000 4194304 4417452 140734236252448 18446744073709551615 4254255 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=715868 CPUtime=8.49 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 48195 1253 0 0 842 7 0 0 25 0 5 0 654878030 733048832 143267 33554432000 4194304 4417452 140734236252448 18446744073709551615 248089392221 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=715868 CPUtime=8.56 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 62741 1253 0 0 847 9 0 0 25 0 5 0 654878030 733048832 143267 33554432000 4194304 4417452 140734236252448 18446744073709551615 4233495 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=715868 CPUtime=8.56 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 1813 1253 0 0 856 0 0 0 25 0 5 0 654878030 733048832 143267 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38.33
Current children cumulated vsize (KiB) 715868

[startup+25.501 s]
/proc/loadavg: 7.75 4.58 2.44 9/238 14142
/proc/meminfo: memFree=18372468/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=761424 CPUtime=89.43 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 283592 1253 0 0 8900 43 0 0 25 0 5 0 654877617 779698176 162978 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 190356 162978 180 55 0 188242 0
[pid=14132/tid=14139] ppid=14130 vsize=761424 CPUtime=21.35 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 62928 1253 0 0 2125 10 0 0 25 0 5 0 654878030 779698176 162978 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=761424 CPUtime=21.2 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 60308 1253 0 0 2111 9 0 0 25 0 5 0 654878030 779698176 162978 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=761424 CPUtime=21.36 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 66548 1253 0 0 2127 9 0 0 25 0 5 0 654878030 779698176 162978 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=761424 CPUtime=21.36 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 1813 1253 0 0 2136 0 0 0 25 0 5 0 654878030 779698176 162978 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 89.43
Current children cumulated vsize (KiB) 761424

[startup+51.1004 s]
/proc/loadavg: 7.90 4.87 2.59 9/238 14143
/proc/meminfo: memFree=18359572/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=773268 CPUtime=191.64 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 386224 1253 0 0 19107 57 0 0 25 0 5 0 654877617 791826432 165939 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 193317 165939 180 55 0 191203 0
[pid=14132/tid=14139] ppid=14130 vsize=773268 CPUtime=46.95 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 95778 1253 0 0 4681 14 0 0 25 0 5 0 654878030 791826432 165939 33554432000 4194304 4417452 140734236252448 18446744073709551615 248089392221 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=773268 CPUtime=46.62 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 95104 1253 0 0 4648 14 0 0 25 0 5 0 654878030 791826432 165939 33554432000 4194304 4417452 140734236252448 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=773268 CPUtime=46.96 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 101298 1253 0 0 4682 14 0 0 25 0 5 0 654878030 791826432 165939 33554432000 4194304 4417452 140734236252448 18446744073709551615 4282791 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=773268 CPUtime=46.96 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 2049 1253 0 0 4696 0 0 0 25 0 5 0 654878030 791826432 165939 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 191.64
Current children cumulated vsize (KiB) 773268

[startup+102.308 s]
/proc/loadavg: 7.96 5.39 2.90 9/238 14144
/proc/meminfo: memFree=18289704/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=842624 CPUtime=396.07 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 513439 1253 0 0 39533 74 0 0 25 0 5 0 654877617 862846976 183278 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 210656 183278 180 55 0 208542 0
[pid=14132/tid=14139] ppid=14130 vsize=842624 CPUtime=98.16 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 131811 1253 0 0 9798 18 0 0 25 0 5 0 654878030 862846976 183278 33554432000 4194304 4417452 140734236252448 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=842624 CPUtime=97.43 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 130000 1253 0 0 9724 19 0 0 25 0 5 0 654878030 862846976 183278 33554432000 4194304 4417452 140734236252448 18446744073709551615 4353598 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=842624 CPUtime=98.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 135966 1253 0 0 9797 19 0 0 25 0 5 0 654878030 862846976 183278 33554432000 4194304 4417452 140734236252448 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=842624 CPUtime=98.15 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 23667 1253 0 0 9813 2 0 0 25 0 5 0 654878030 862846976 183278 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 396.07
Current children cumulated vsize (KiB) 842624

[startup+162.301 s]
/proc/loadavg: 7.98 5.87 3.21 9/238 14146
/proc/meminfo: memFree=18238288/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=883988 CPUtime=635.6 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 622349 1253 0 0 63472 88 0 0 25 0 5 0 654877617 905203712 193625 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 220997 193625 180 55 0 218883 0
[pid=14132/tid=14139] ppid=14130 vsize=883988 CPUtime=158.15 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 164651 1253 0 0 15793 22 0 0 25 0 5 0 654878030 905203712 193625 33554432000 4194304 4417452 140734236252448 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=883988 CPUtime=156.99 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 168736 1253 0 0 15675 24 0 0 25 0 5 0 654878030 905203712 193625 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236761 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=883988 CPUtime=158.14 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 173243 1253 0 0 15791 23 0 0 25 0 5 0 654878030 905203712 193625 33554432000 4194304 4417452 140734236252448 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=883988 CPUtime=158.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 23724 1253 0 0 15812 2 0 0 25 0 5 0 654878030 905203712 193625 33554432000 4194304 4417452 140734236252448 18446744073709551615 4365572 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 635.6
Current children cumulated vsize (KiB) 883988

[startup+222.301 s]
/proc/loadavg: 7.99 6.25 3.51 9/238 14148
/proc/meminfo: memFree=18232688/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=884808 CPUtime=875.15 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 626423 1253 0 0 87427 88 0 0 25 0 5 0 654877617 906043392 193830 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 221202 193830 180 55 0 219088 0
[pid=14132/tid=14139] ppid=14130 vsize=884808 CPUtime=218.15 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 164651 1253 0 0 21793 22 0 0 25 0 5 0 654878030 906043392 193830 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=884808 CPUtime=216.55 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 168803 1253 0 0 21631 24 0 0 25 0 5 0 654878030 906043392 193830 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236655 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=884808 CPUtime=218.14 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 173318 1253 0 0 21791 23 0 0 25 0 5 0 654878030 906043392 193830 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236827 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=884808 CPUtime=218.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 27656 1253 0 0 21812 2 0 0 25 0 5 0 654878030 906043392 193830 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 875.15
Current children cumulated vsize (KiB) 884808

################
# More data... #
################

[pid=14132/tid=14140] ppid=14130 vsize=1818856 CPUtime=693.08 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 341476 1253 0 0 69263 45 0 0 25 0 5 0 654878030 1862508544 427342 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364854 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1818856 CPUtime=698.15 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 259608 1253 0 0 69782 33 0 0 25 0 5 0 654878030 1862508544 427342 33554432000 4194304 4417452 140734236252448 18446744073709551615 4265387 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1818856 CPUtime=698.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 337863 1253 0 0 69772 42 0 0 25 0 5 0 654878030 1862508544 427342 33554432000 4194304 4417452 140734236252448 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2791.68
Current children cumulated vsize (KiB) 1818856

[startup+762.309 s]
/proc/loadavg: 8.07 7.76 5.50 9/238 14162
/proc/meminfo: memFree=17315256/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=1550220 CPUtime=3031.28 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1361538 1253 0 0 302948 180 0 0 25 0 5 0 654877617 1587425280 360183 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 387555 360183 180 55 0 385441 0
[pid=14132/tid=14139] ppid=14130 vsize=1550220 CPUtime=758.17 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253044 1253 0 0 75784 33 0 0 25 0 5 0 654878030 1587425280 360183 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=1550220 CPUtime=752.64 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 366391 1253 0 0 75216 48 0 0 25 0 5 0 654878030 1587425280 360183 33554432000 4194304 4417452 140734236252448 18446744073709551615 4250927 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1550220 CPUtime=758.17 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 295950 1253 0 0 75779 38 0 0 25 0 5 0 654878030 1587425280 360183 33554432000 4194304 4417452 140734236252448 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1550220 CPUtime=758.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 354158 1253 0 0 75769 45 0 0 25 0 5 0 654878030 1587425280 360183 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3031.28
Current children cumulated vsize (KiB) 1550220

[startup+822.301 s]
/proc/loadavg: 8.07 7.82 5.66 9/238 14164
/proc/meminfo: memFree=17162328/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=1683748 CPUtime=3270.82 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1408951 1253 0 0 326897 185 0 0 25 0 5 0 654877617 1724157952 393565 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 420937 393565 180 55 0 418823 0
[pid=14132/tid=14139] ppid=14130 vsize=1683748 CPUtime=818.16 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253044 1253 0 0 81783 33 0 0 25 0 5 0 654878030 1724157952 393565 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=1683748 CPUtime=812.21 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 366391 1253 0 0 81173 48 0 0 25 0 5 0 654878030 1724157952 393565 33554432000 4194304 4417452 140734236252448 18446744073709551615 4365198 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1683748 CPUtime=818.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 295950 1253 0 0 81778 38 0 0 25 0 5 0 654878030 1724157952 393565 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1683748 CPUtime=818.13 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 401571 1253 0 0 81763 50 0 0 25 0 5 0 654878030 1724157952 393565 33554432000 4194304 4417452 140734236252448 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3270.82
Current children cumulated vsize (KiB) 1683748

[startup+882.301 s]
/proc/loadavg: 8.25 7.91 5.82 9/238 14165
/proc/meminfo: memFree=17193544/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=1584788 CPUtime=3510.39 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1458671 1253 0 0 350847 192 0 0 25 0 5 0 654877617 1622822912 368825 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 396197 368825 180 55 0 394083 0
[pid=14132/tid=14139] ppid=14130 vsize=1584788 CPUtime=878.16 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253099 1253 0 0 87783 33 0 0 25 0 5 0 654878030 1622822912 368825 33554432000 4194304 4417452 140734236252448 18446744073709551615 4265399 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=1584788 CPUtime=871.77 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 377305 1253 0 0 87127 50 0 0 25 0 5 0 654878030 1622822912 368825 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1584788 CPUtime=878.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 298344 1253 0 0 87778 38 0 0 25 0 5 0 654878030 1622822912 368825 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1584788 CPUtime=878.13 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 437928 1253 0 0 87758 55 0 0 25 0 5 0 654878030 1622822912 368825 33554432000 4194304 4417452 140734236252448 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3510.39
Current children cumulated vsize (KiB) 1584788

[startup+942.301 s]
/proc/loadavg: 8.16 7.94 5.96 9/238 14167
/proc/meminfo: memFree=17044584/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=1689364 CPUtime=3749.96 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1524501 1253 0 0 374796 200 0 0 25 0 5 0 654877617 1729908736 394969 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 422341 394969 180 55 0 420227 0
[pid=14132/tid=14139] ppid=14130 vsize=1689364 CPUtime=938.16 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253099 1253 0 0 93783 33 0 0 25 0 5 0 654878030 1729908736 394969 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=1689364 CPUtime=931.34 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 396306 1253 0 0 93082 52 0 0 25 0 5 0 654878030 1729908736 394969 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1689364 CPUtime=938.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 323080 1253 0 0 93775 41 0 0 25 0 5 0 654878030 1729908736 394969 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1689364 CPUtime=938.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 460021 1253 0 0 93756 58 0 0 25 0 5 0 654878030 1729908736 394969 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3749.96
Current children cumulated vsize (KiB) 1689364

[startup+1002.3 s]
/proc/loadavg: 8.13 7.96 6.09 9/238 14168
/proc/meminfo: memFree=17168424/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=1573344 CPUtime=3989.52 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1615544 1253 0 0 398736 216 0 0 25 0 5 0 654877617 1611104256 365964 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 393336 365964 180 55 0 391222 0
[pid=14132/tid=14139] ppid=14130 vsize=1573344 CPUtime=998.16 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253148 1253 0 0 99783 33 0 0 25 0 5 0 654878030 1611104256 365964 33554432000 4194304 4417452 140734236252448 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=1573344 CPUtime=990.9 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 397694 1253 0 0 99038 52 0 0 25 0 5 0 654878030 1611104256 365964 33554432000 4194304 4417452 140734236252448 18446744073709551615 4255010 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1573344 CPUtime=998.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 327328 1253 0 0 99774 42 0 0 25 0 5 0 654878030 1611104256 365964 33554432000 4194304 4417452 140734236252448 18446744073709551615 4312151 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1573344 CPUtime=998.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 545379 1253 0 0 99741 73 0 0 25 0 5 0 654878030 1611104256 365964 33554432000 4194304 4417452 140734236252448 18446744073709551615 4281851 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3989.52
Current children cumulated vsize (KiB) 1573344

[startup+1062.3 s]
/proc/loadavg: 5.99 7.42 6.02 5/228 14188
/proc/meminfo: memFree=17601640/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=1628428 CPUtime=4229.09 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1638147 1253 0 0 422691 218 0 0 25 0 5 0 654877617 1667510272 379735 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 407107 379735 180 55 0 404993 0
[pid=14132/tid=14139] ppid=14130 vsize=1628428 CPUtime=1058.17 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253148 1253 0 0 105784 33 0 0 25 0 5 0 654878030 1667510272 379735 33554432000 4194304 4417452 140734236252448 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=1628428 CPUtime=1050.48 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 400903 1253 0 0 104995 53 0 0 25 0 5 0 654878030 1667510272 379735 33554432000 4194304 4417452 140734236252448 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1628428 CPUtime=1058.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 329495 1253 0 0 105774 42 0 0 25 0 5 0 654878030 1667510272 379735 33554432000 4194304 4417452 140734236252448 18446744073709551615 4354178 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1628428 CPUtime=1058.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 562606 1253 0 0 105739 75 0 0 25 0 5 0 654878030 1667510272 379735 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4229.09
Current children cumulated vsize (KiB) 1628428

[startup+1122.3 s]
/proc/loadavg: 4.79 6.81 5.90 5/228 14190
/proc/meminfo: memFree=17355460/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=1865360 CPUtime=4468.67 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1720909 1253 0 0 446639 228 0 0 25 0 5 0 654877617 1910128640 438968 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 466340 438968 180 55 0 464226 0
[pid=14132/tid=14139] ppid=14130 vsize=1865360 CPUtime=1118.17 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253148 1253 0 0 111784 33 0 0 25 0 5 0 654878030 1910128640 438968 33554432000 4194304 4417452 140734236252448 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=1865360 CPUtime=1110.04 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 400967 1253 0 0 110951 53 0 0 25 0 5 0 654878030 1910128640 438968 33554432000 4194304 4417452 140734236252448 18446744073709551615 4275894 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=1865360 CPUtime=1118.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 344119 1253 0 0 111773 43 0 0 25 0 5 0 654878030 1910128640 438968 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=1865360 CPUtime=1118.13 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 630680 1253 0 0 111730 83 0 0 25 0 5 0 654878030 1910128640 438968 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4468.67
Current children cumulated vsize (KiB) 1865360

[startup+1182.3 s]
/proc/loadavg: 4.29 6.30 5.78 5/228 14191
/proc/meminfo: memFree=17167060/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=2054024 CPUtime=4708.23 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1849465 1253 0 0 470578 245 0 0 25 0 5 0 654877617 2103320576 486134 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 513506 486134 180 55 0 511392 0
[pid=14132/tid=14139] ppid=14130 vsize=2054024 CPUtime=1178.17 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253209 1253 0 0 117784 33 0 0 25 0 5 0 654878030 2103320576 486134 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=2054024 CPUtime=1169.61 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 419372 1253 0 0 116906 55 0 0 25 0 5 0 654878030 2103320576 486134 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=2054024 CPUtime=1178.16 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 392226 1253 0 0 117767 49 0 0 25 0 5 0 654878030 2103320576 486134 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=2054024 CPUtime=1178.13 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 692663 1253 0 0 117721 92 0 0 25 0 5 0 654878030 2103320576 486134 33554432000 4194304 4417452 140734236252448 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4708.23
Current children cumulated vsize (KiB) 2054024



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.3 s]
/proc/loadavg: 4.20 6.15 5.74 5/228 14192
/proc/meminfo: memFree=17181924/32950928 swapFree=64721848/67111528
[pid=14132] ppid=14130 vsize=2038444 CPUtime=4800.08 cores=1,3,5,7
/proc/14132/stat : 14132 (plingeling) S 14130 14132 4864 0 -1 4202496 1853985 1253 0 0 479762 246 0 0 25 0 5 0 654877617 2087366656 482239 33554432000 4194304 4417452 140734236252448 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/14132/statm: 509611 482239 180 55 0 507497 0
[pid=14132/tid=14139] ppid=14130 vsize=2038444 CPUtime=1201.17 cores=1,3,5,7
/proc/14132/task/14139/stat : 14139 (plingeling) R 14130 14132 4864 0 -1 4202560 253209 1253 0 0 120084 33 0 0 25 0 5 0 654878030 2087366656 482239 33554432000 4194304 4417452 140734236252448 18446744073709551615 4308228 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14132/tid=14140] ppid=14130 vsize=2038444 CPUtime=1192.44 cores=1,3,5,7
/proc/14132/task/14140/stat : 14140 (plingeling) R 14130 14132 4864 0 -1 4202560 419372 1253 0 0 119189 55 0 0 25 0 5 0 654878030 2087366656 482239 33554432000 4194304 4417452 140734236252448 18446744073709551615 4346501 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14132/tid=14141] ppid=14130 vsize=2038444 CPUtime=1201.17 cores=1,3,5,7
/proc/14132/task/14141/stat : 14141 (plingeling) R 14130 14132 4864 0 -1 4202560 392226 1253 0 0 120068 49 0 0 25 0 5 0 654878030 2087366656 482239 33554432000 4194304 4417452 140734236252448 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14132/tid=14142] ppid=14130 vsize=2038444 CPUtime=1201.14 cores=1,3,5,7
/proc/14132/task/14142/stat : 14142 (plingeling) R 14130 14132 4864 0 -1 4202560 697183 1253 0 0 120021 93 0 0 25 0 5 0 654878030 2087366656 482239 33554432000 4194304 4417452 140734236252448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 2038444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.39
CPU time (s): 4800.2
CPU user time (s): 4797.65
CPU system time (s): 2.54261
CPU usage (%): 398.227
Max. virtual memory (cumulated for all children) (KiB): 2069540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.65
system time used= 2.54261
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1855238
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 131
involuntary context switches= 35525

runsolver used 2.45663 second user time and 6.29904 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-15 06:12:58
IDJOB=3371287
IDBENCH=88163
IDSOLVER=1848
FILE ID=node123/3371287-1305432777
RUNJOBID= node123-1305432588-13670
PBS_JOBID= 13324571
Free space on /tmp= 73392 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/11pipe_11_ooo.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371287-1305432777/watcher-3371287-1305432777 -o /tmp/evaluation-result-3371287-1305432777/solver-3371287-1305432777 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371287-1305432777.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f603f11fbfe855df381282b7bce010ea
RANDOM SEED=924863078

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19025228 kB
Buffers:        306248 kB
Cached:        4197852 kB
SwapCached:      10528 kB
Active:       10730540 kB
Inactive:      2926536 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19025228 kB
SwapTotal:    67111528 kB
SwapFree:     64721848 kB
Dirty:           81488 kB
Writeback:           8 kB
AnonPages:     9150540 kB
Mapped:          16216 kB
Slab:           177168 kB
PageTables:      31360 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 13168416 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73392 MiB
End job on node123 at 2011-05-15 06:33:06