Trace number 3280421

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.08 1202.23

General information on the benchmark

Nameindustrial/anbulagan/
hard-unsat/dated-5-13-u.cnf
MD5SUM45ee13b66821e6c36f3e38be418fa121
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3586.1
Satisfiable
(Un)Satisfiability was proved
Number of variables138808
Number of clauses626501
Sum of the clauses size1431026
Maximum clause length10
Minimum clause length1
Number of clauses of size 111712
Number of clauses of size 2503953
Number of clauses of size 384536
Number of clauses of size 42920
Number of clauses of size 511680
Number of clauses of size over 511700

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280421-1304037280/watcher-3280421-1304037280 -o /tmp/evaluation-result-3280421-1304037280/solver-3280421-1304037280 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3280421-1304037280.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.81 7.20 7.71 2/174 28283
/proc/meminfo: memFree=20500980/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=10640 CPUtime=0 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) R 28281 28283 28251 0 -1 4202496 747 1251 0 0 0 0 0 0 24 0 1 0 593958731 10895360 677 33554432000 4194304 4417332 140733401762384 18446744073709551615 4264950 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/28283/statm: 2660 677 146 55 0 546 0

[startup+0.053102 s]
/proc/loadavg: 4.81 7.20 7.71 2/174 28283
/proc/meminfo: memFree=20500980/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=24872 CPUtime=0.04 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) R 28281 28283 28251 0 -1 4202496 4310 1251 0 0 4 0 0 0 24 0 1 0 593958731 25468928 4240 33554432000 4194304 4417332 140733401762384 18446744073709551615 231895109148 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/28283/statm: 6218 4240 147 55 0 4104 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 24872

[startup+0.101092 s]
/proc/loadavg: 4.81 7.20 7.71 2/174 28283
/proc/meminfo: memFree=20500980/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=38320 CPUtime=0.09 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) R 28281 28283 28251 0 -1 4202496 7672 1251 0 0 8 1 0 0 24 0 1 0 593958731 39239680 7602 33554432000 4194304 4417332 140733401762384 18446744073709551615 4264950 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/28283/statm: 9580 7602 147 55 0 7466 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 38320

[startup+0.30106 s]
/proc/loadavg: 4.81 7.20 7.71 2/174 28283
/proc/meminfo: memFree=20500980/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=65204 CPUtime=0.29 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) R 28281 28283 28251 0 -1 4202496 14393 1251 0 0 27 2 0 0 25 0 1 0 593958731 66768896 14323 33554432000 4194304 4417332 140733401762384 18446744073709551615 231895490304 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/28283/statm: 16301 14323 147 55 0 14187 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 65204

[startup+0.700981 s]
/proc/loadavg: 4.81 7.20 7.71 2/174 28283
/proc/meminfo: memFree=20500980/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=155980 CPUtime=0.68 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) R 28281 28283 28251 0 -1 4202496 37088 1251 0 0 65 3 0 0 25 0 1 0 593958731 159723520 37018 33554432000 4194304 4417332 140733401762384 18446744073709551615 4227825 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/28283/statm: 38995 37018 148 55 0 36881 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 155980

[startup+1.50072 s]
/proc/loadavg: 4.81 7.20 7.71 9/186 28308
/proc/meminfo: memFree=20237508/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=233724 CPUtime=3.67 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 49477 1251 0 0 361 6 0 0 25 0 5 0 593958731 239333376 31228 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 58431 31228 173 55 0 56317 0
[pid=28283/tid=28301] ppid=28281 vsize=233724 CPUtime=0.72 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 3265 1251 0 0 72 0 0 0 18 0 5 0 593958808 239333376 31228 33554432000 4194304 4417332 140733401762384 18446744073709551615 4290691 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=233724 CPUtime=0.72 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 3313 1251 0 0 72 0 0 0 18 0 5 0 593958808 239333376 31228 33554432000 4194304 4417332 140733401762384 18446744073709551615 4290595 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=233724 CPUtime=0.72 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 3136 1251 0 0 72 0 0 0 18 0 5 0 593958808 239333376 31228 33554432000 4194304 4417332 140733401762384 18446744073709551615 4301932 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=233724 CPUtime=0.72 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 2663 1251 0 0 72 0 0 0 18 0 5 0 593958808 239333376 31228 33554432000 4194304 4417332 140733401762384 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.67
Current children cumulated vsize (KiB) 233724

[startup+3.10042 s]
/proc/loadavg: 4.81 7.20 7.71 9/186 28308
/proc/meminfo: memFree=20238376/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=223828 CPUtime=10.06 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 49841 1251 0 0 1000 6 0 0 25 0 5 0 593958731 229199872 28774 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 55957 28774 181 55 0 53843 0
[pid=28283/tid=28301] ppid=28281 vsize=223828 CPUtime=2.32 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 3272 1251 0 0 232 0 0 0 21 0 5 0 593958808 229199872 28774 33554432000 4194304 4417332 140733401762384 18446744073709551615 4366419 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=223828 CPUtime=2.32 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 3663 1251 0 0 232 0 0 0 21 0 5 0 593958808 229199872 28774 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=223828 CPUtime=2.31 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 3142 1251 0 0 231 0 0 0 21 0 5 0 593958808 229199872 28774 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=223828 CPUtime=2.32 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 2664 1251 0 0 232 0 0 0 21 0 5 0 593958808 229199872 28774 33554432000 4194304 4417332 140733401762384 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.06
Current children cumulated vsize (KiB) 223828

[startup+6.30082 s]
/proc/loadavg: 5.06 7.21 7.72 9/186 28308
/proc/meminfo: memFree=20283140/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=190032 CPUtime=22.85 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 50105 1251 0 0 2278 7 0 0 25 0 5 0 593958731 194592768 20325 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 47508 20325 181 55 0 45394 0
[pid=28283/tid=28301] ppid=28281 vsize=190032 CPUtime=5.52 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 3530 1251 0 0 552 0 0 0 25 0 5 0 593958808 194592768 20325 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=190032 CPUtime=5.52 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 3665 1251 0 0 551 1 0 0 25 0 5 0 593958808 194592768 20325 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=190032 CPUtime=5.49 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 3146 1251 0 0 549 0 0 0 25 0 5 0 593958808 194592768 20325 33554432000 4194304 4417332 140733401762384 18446744073709551615 4346425 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=190032 CPUtime=5.52 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 2664 1251 0 0 552 0 0 0 25 0 5 0 593958808 194592768 20325 33554432000 4194304 4417332 140733401762384 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 22.85
Current children cumulated vsize (KiB) 190032

[startup+12.7006 s]
/proc/loadavg: 5.30 7.23 7.72 9/186 28308
/proc/meminfo: memFree=20285068/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=192272 CPUtime=48.41 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 51910 1251 0 0 4834 7 0 0 25 0 5 0 593958731 196886528 20885 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 48068 20885 181 55 0 45954 0
[pid=28283/tid=28301] ppid=28281 vsize=192272 CPUtime=11.92 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 4047 1251 0 0 1192 0 0 0 25 0 5 0 593958808 196886528 20885 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=192272 CPUtime=11.92 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 4438 1251 0 0 1191 1 0 0 25 0 5 0 593958808 196886528 20885 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=192272 CPUtime=11.85 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 3661 1251 0 0 1185 0 0 0 25 0 5 0 593958808 196886528 20885 33554432000 4194304 4417332 140733401762384 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=192272 CPUtime=11.92 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 2664 1251 0 0 1192 0 0 0 25 0 5 0 593958808 196886528 20885 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 48.41
Current children cumulated vsize (KiB) 192272

[startup+25.5012 s]
/proc/loadavg: 5.90 7.26 7.72 9/186 28309
/proc/meminfo: memFree=20270432/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=200272 CPUtime=99.54 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 57530 1251 0 0 9946 8 0 0 25 0 5 0 593958731 205078528 22891 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 50068 22891 181 55 0 47954 0
[pid=28283/tid=28301] ppid=28281 vsize=200272 CPUtime=24.73 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 6477 1251 0 0 2472 1 0 0 25 0 5 0 593958808 205078528 22891 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=200272 CPUtime=24.72 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 6119 1251 0 0 2471 1 0 0 25 0 5 0 593958808 205078528 22891 33554432000 4194304 4417332 140733401762384 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=200272 CPUtime=24.58 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 5170 1251 0 0 2458 0 0 0 25 0 5 0 593958808 205078528 22891 33554432000 4194304 4417332 140733401762384 18446744073709551615 4237202 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=200272 CPUtime=24.72 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 2664 1251 0 0 2472 0 0 0 25 0 5 0 593958808 205078528 22891 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 99.54
Current children cumulated vsize (KiB) 200272

[startup+51.1004 s]
/proc/loadavg: 6.61 7.32 7.73 9/186 28309
/proc/meminfo: memFree=20191580/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=227104 CPUtime=201.8 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 70776 1251 0 0 20171 9 0 0 25 0 5 0 593958731 232554496 29473 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 56776 29473 181 55 0 54662 0
[pid=28283/tid=28301] ppid=28281 vsize=227104 CPUtime=50.32 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 11058 1251 0 0 5031 1 0 0 25 0 5 0 593958808 232554496 29473 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=227104 CPUtime=50.32 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 12123 1251 0 0 5030 2 0 0 25 0 5 0 593958808 232554496 29473 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=227104 CPUtime=50.05 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 7732 1251 0 0 5004 1 0 0 25 0 5 0 593958808 232554496 29473 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=227104 CPUtime=50.32 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 2763 1251 0 0 5032 0 0 0 25 0 5 0 593958808 232554496 29473 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364362 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 201.8
Current children cumulated vsize (KiB) 227104

[startup+102.307 s]
/proc/loadavg: 7.45 7.44 7.74 9/186 28311
/proc/meminfo: memFree=20131904/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=250256 CPUtime=406.35 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 92868 1251 0 0 40623 12 0 0 25 0 5 0 593958731 256262144 35387 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 62564 35387 181 55 0 60450 0
[pid=28283/tid=28301] ppid=28281 vsize=250256 CPUtime=101.53 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 18689 1251 0 0 10151 2 0 0 25 0 5 0 593958808 256262144 35387 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=250256 CPUtime=101.53 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 21394 1251 0 0 10150 3 0 0 25 0 5 0 593958808 256262144 35387 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=250256 CPUtime=100.97 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 12028 1251 0 0 10096 1 0 0 25 0 5 0 593958808 256262144 35387 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=250256 CPUtime=101.53 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 3657 1251 0 0 10153 0 0 0 25 0 5 0 593958808 256262144 35387 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 406.35
Current children cumulated vsize (KiB) 250256

[startup+162.301 s]
/proc/loadavg: 7.85 7.56 7.76 9/186 28312
/proc/meminfo: memFree=20099000/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=262428 CPUtime=646.01 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 122987 1251 0 0 64584 17 0 0 25 0 5 0 593958731 268726272 38430 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 65607 38430 181 55 0 63493 0
[pid=28283/tid=28301] ppid=28281 vsize=262428 CPUtime=161.53 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 28886 1251 0 0 16150 3 0 0 25 0 5 0 593958808 268726272 38430 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=262428 CPUtime=161.53 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 35171 1251 0 0 16147 6 0 0 25 0 5 0 593958808 268726272 38430 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=262428 CPUtime=160.64 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 18173 1251 0 0 16062 2 0 0 25 0 5 0 593958808 268726272 38430 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=262428 CPUtime=161.52 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 3657 1251 0 0 16152 0 0 0 25 0 5 0 593958808 268726272 38430 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 646.01
Current children cumulated vsize (KiB) 262428


################
# More data... #
################

[pid=28283/tid=28302] ppid=28281 vsize=331000 CPUtime=701.54 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 167323 1251 0 0 70128 26 0 0 25 0 5 0 593958808 338944000 55576 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=331000 CPUtime=697.67 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 88161 1251 0 0 69754 13 0 0 25 0 5 0 593958808 338944000 55576 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=331000 CPUtime=701.54 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 63598 1251 0 0 70145 9 0 0 25 0 5 0 593958808 338944000 55576 33554432000 4194304 4417332 140733401762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2803.1
Current children cumulated vsize (KiB) 331000

[startup+762.306 s]
/proc/loadavg: 8.01 8.04 7.93 9/186 28331
/proc/meminfo: memFree=19829200/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=366620 CPUtime=3042.79 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 560197 1251 0 0 304196 83 0 0 25 0 5 0 593958731 375418880 64481 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 91655 64481 181 55 0 89541 0
[pid=28283/tid=28301] ppid=28281 vsize=366620 CPUtime=761.56 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 169049 1251 0 0 76132 24 0 0 25 0 5 0 593958808 375418880 64481 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=366620 CPUtime=761.55 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 183376 1251 0 0 76126 29 0 0 25 0 5 0 593958808 375418880 64481 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=366620 CPUtime=757.33 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 101079 1251 0 0 75719 14 0 0 25 0 5 0 593958808 375418880 64481 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=366620 CPUtime=761.55 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 69593 1251 0 0 76145 10 0 0 25 0 5 0 593958808 375418880 64481 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3042.79
Current children cumulated vsize (KiB) 366620

[startup+822.301 s]
/proc/loadavg: 8.00 8.03 7.93 9/186 28333
/proc/meminfo: memFree=19797144/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=358956 CPUtime=3282.44 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 599799 1251 0 0 328155 89 0 0 25 0 5 0 593958731 367570944 62565 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 89739 62565 181 55 0 87625 0
[pid=28283/tid=28301] ppid=28281 vsize=358956 CPUtime=821.56 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 183640 1251 0 0 82130 26 0 0 25 0 5 0 593958808 367570944 62565 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=358956 CPUtime=821.55 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 191025 1251 0 0 82125 30 0 0 25 0 5 0 593958808 367570944 62565 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=358956 CPUtime=817 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 112036 1251 0 0 81684 16 0 0 25 0 5 0 593958808 367570944 62565 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=358956 CPUtime=821.54 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 75998 1251 0 0 82143 11 0 0 25 0 5 0 593958808 367570944 62565 33554432000 4194304 4417332 140733401762384 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3282.44
Current children cumulated vsize (KiB) 358956

[startup+882.301 s]
/proc/loadavg: 8.05 8.03 7.93 9/186 28334
/proc/meminfo: memFree=19816692/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=352140 CPUtime=3522.12 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 642154 1251 0 0 352116 96 0 0 25 0 5 0 593958731 360591360 60861 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 88035 60861 181 55 0 85921 0
[pid=28283/tid=28301] ppid=28281 vsize=352140 CPUtime=881.55 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 200001 1251 0 0 88128 27 0 0 25 0 5 0 593958808 360591360 60861 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=352140 CPUtime=881.55 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 203251 1251 0 0 88122 33 0 0 25 0 5 0 593958808 360591360 60861 33554432000 4194304 4417332 140733401762384 18446744073709551615 4237221 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=352140 CPUtime=876.68 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 120747 1251 0 0 87650 18 0 0 25 0 5 0 593958808 360591360 60861 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=352140 CPUtime=881.55 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 81055 1251 0 0 88143 12 0 0 25 0 5 0 593958808 360591360 60861 33554432000 4194304 4417332 140733401762384 18446744073709551615 4366002 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3522.12
Current children cumulated vsize (KiB) 352140

[startup+942.301 s]
/proc/loadavg: 8.06 8.04 7.94 9/186 28336
/proc/meminfo: memFree=19753272/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=390708 CPUtime=3761.79 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 690456 1251 0 0 376076 103 0 0 25 0 5 0 593958731 400084992 70503 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 97677 70503 181 55 0 95563 0
[pid=28283/tid=28301] ppid=28281 vsize=390708 CPUtime=941.55 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 213399 1251 0 0 94126 29 0 0 25 0 5 0 593958808 400084992 70503 33554432000 4194304 4417332 140733401762384 18446744073709551615 4309888 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=390708 CPUtime=941.55 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 214727 1251 0 0 94120 35 0 0 25 0 5 0 593958808 400084992 70503 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=390708 CPUtime=936.35 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 134742 1251 0 0 93615 20 0 0 25 0 5 0 593958808 400084992 70503 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=390708 CPUtime=941.55 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 90488 1251 0 0 94141 14 0 0 25 0 5 0 593958808 400084992 70503 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3761.79
Current children cumulated vsize (KiB) 390708

[startup+1002.3 s]
/proc/loadavg: 8.11 8.06 7.95 9/186 28338
/proc/meminfo: memFree=19773312/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=350032 CPUtime=4001.47 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 723623 1251 0 0 400038 109 0 0 25 0 5 0 593958731 358432768 60334 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 87508 60334 181 55 0 85394 0
[pid=28283/tid=28301] ppid=28281 vsize=350032 CPUtime=1001.55 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 219460 1251 0 0 100125 30 0 0 25 0 5 0 593958808 358432768 60334 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=350032 CPUtime=1001.55 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 227138 1251 0 0 100118 37 0 0 25 0 5 0 593958808 358432768 60334 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=350032 CPUtime=996.01 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 141091 1251 0 0 99580 21 0 0 25 0 5 0 593958808 358432768 60334 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=350032 CPUtime=1001.55 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 98834 1251 0 0 100140 15 0 0 25 0 5 0 593958808 358432768 60334 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4001.47
Current children cumulated vsize (KiB) 350032

[startup+1062.3 s]
/proc/loadavg: 8.08 8.06 7.95 9/186 28339
/proc/meminfo: memFree=19662516/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=387592 CPUtime=4241.15 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 768421 1251 0 0 423999 116 0 0 25 0 5 0 593958731 396894208 69724 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 96898 69724 181 55 0 94784 0
[pid=28283/tid=28301] ppid=28281 vsize=387592 CPUtime=1061.56 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 237298 1251 0 0 106123 33 0 0 25 0 5 0 593958808 396894208 69724 33554432000 4194304 4417332 140733401762384 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=387592 CPUtime=1061.55 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 235150 1251 0 0 106117 38 0 0 25 0 5 0 593958808 396894208 69724 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=387592 CPUtime=1055.68 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 153273 1251 0 0 105545 23 0 0 25 0 5 0 593958808 396894208 69724 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=387592 CPUtime=1061.55 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 105600 1251 0 0 106139 16 0 0 25 0 5 0 593958808 396894208 69724 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364482 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4241.15
Current children cumulated vsize (KiB) 387592

[startup+1122.3 s]
/proc/loadavg: 8.03 8.05 7.95 9/186 28341
/proc/meminfo: memFree=19637672/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=398120 CPUtime=4480.83 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 817729 1251 0 0 447959 124 0 0 25 0 5 0 593958731 407674880 72356 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 99530 72356 181 55 0 97416 0
[pid=28283/tid=28301] ppid=28281 vsize=398120 CPUtime=1121.56 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 251827 1251 0 0 112121 35 0 0 25 0 5 0 593958808 407674880 72356 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=398120 CPUtime=1121.55 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 247420 1251 0 0 112116 39 0 0 25 0 5 0 593958808 407674880 72356 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=398120 CPUtime=1115.35 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 163141 1251 0 0 111510 25 0 0 25 0 5 0 593958808 407674880 72356 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=398120 CPUtime=1121.56 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 118241 1251 0 0 112138 18 0 0 25 0 5 0 593958808 407674880 72356 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4480.83
Current children cumulated vsize (KiB) 398120

[startup+1182.3 s]
/proc/loadavg: 8.01 8.04 7.95 9/186 28342
/proc/meminfo: memFree=19679408/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=374480 CPUtime=4720.5 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 855360 1251 0 0 471920 130 0 0 25 0 5 0 593958731 383467520 66446 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 93620 66446 181 55 0 91506 0
[pid=28283/tid=28301] ppid=28281 vsize=374480 CPUtime=1181.56 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 258617 1251 0 0 118119 37 0 0 25 0 5 0 593958808 383467520 66446 33554432000 4194304 4417332 140733401762384 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=374480 CPUtime=1181.56 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 258518 1251 0 0 118115 41 0 0 25 0 5 0 593958808 383467520 66446 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=374480 CPUtime=1175.03 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 172674 1251 0 0 117476 27 0 0 25 0 5 0 593958808 383467520 66446 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=374480 CPUtime=1181.56 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 128451 1251 0 0 118137 19 0 0 25 0 5 0 593958808 383467520 66446 33554432000 4194304 4417332 140733401762384 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4720.5
Current children cumulated vsize (KiB) 374480



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.00 8.03 7.95 9/186 28343
/proc/meminfo: memFree=19627800/32950928 swapFree=67111524/67111528
[pid=28283] ppid=28281 vsize=387968 CPUtime=4800.02 cores=0,2,4,6
/proc/28283/stat : 28283 (plingeling) S 28281 28283 28251 0 -1 4202496 870452 1251 0 0 479870 132 0 0 25 0 5 0 593958731 397279232 69818 33554432000 4194304 4417332 140733401762384 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28283/statm: 96992 69818 181 55 0 94878 0
[pid=28283/tid=28301] ppid=28281 vsize=387968 CPUtime=1201.47 cores=0,2,4,6
/proc/28283/task/28301/stat : 28301 (plingeling) R 28281 28283 28251 0 -1 4202560 264218 1251 0 0 120109 38 0 0 25 0 5 0 593958808 397279232 69818 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28283/tid=28302] ppid=28281 vsize=387968 CPUtime=1201.47 cores=0,2,4,6
/proc/28283/task/28302/stat : 28302 (plingeling) R 28281 28283 28251 0 -1 4202560 260998 1251 0 0 120106 41 0 0 25 0 5 0 593958808 397279232 69818 33554432000 4194304 4417332 140733401762384 18446744073709551615 4365007 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28283/tid=28303] ppid=28281 vsize=387968 CPUtime=1194.81 cores=0,2,4,6
/proc/28283/task/28303/stat : 28303 (plingeling) R 28281 28283 28251 0 -1 4202560 175156 1251 0 0 119454 27 0 0 25 0 5 0 593958808 397279232 69818 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28283/tid=28304] ppid=28281 vsize=387968 CPUtime=1201.47 cores=0,2,4,6
/proc/28283/task/28304/stat : 28304 (plingeling) R 28281 28283 28251 0 -1 4202560 132980 1251 0 0 120127 20 0 0 25 0 5 0 593958808 397279232 69818 33554432000 4194304 4417332 140733401762384 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.02
Current children cumulated vsize (KiB) 387968

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.23
CPU time (s): 4800.08
CPU user time (s): 4798.73
CPU system time (s): 1.3458
CPU usage (%): 399.264
Max. virtual memory (cumulated for all children) (KiB): 411508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.73
system time used= 1.34579
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 871703
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 135
involuntary context switches= 21342

runsolver used 1.87071 second user time and 4.67929 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 02:34:41
IDJOB=3280421
IDBENCH=20387
IDSOLVER=1605
FILE ID=node114/3280421-1304037280
RUNJOBID= node114-1304037280-28269
PBS_JOBID= 13170369
Free space on /tmp= 71784 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT07/industrial/anbulagan/hard-unsat/dated-5-13-u.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280421-1304037280/watcher-3280421-1304037280 -o /tmp/evaluation-result-3280421-1304037280/solver-3280421-1304037280 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3280421-1304037280.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 45ee13b66821e6c36f3e38be418fa121
RANDOM SEED=1614623673

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20501144 kB
Buffers:       2248928 kB
Cached:        9551036 kB
SwapCached:          4 kB
Active:        3343468 kB
Inactive:      8524880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20501144 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           22232 kB
Writeback:           0 kB
AnonPages:       67600 kB
Mapped:          14328 kB
Slab:           515852 kB
PageTables:       5032 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   193260 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71780 MiB
End job on node114 at 2011-04-29 02:54:45