Trace number 3371466

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.42 1203.64

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom25.cnf
MD5SUMc40bd543dad558d19995fef4fd742233
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables67777
Number of clauses227761
Sum of the clauses size582177
Maximum clause length2084
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2115213
Number of clauses of size 3111398
Number of clauses of size 4324
Number of clauses of size 523
Number of clauses of size over 5802

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371466-1305422840/watcher-3371466-1305422840 -o /tmp/evaluation-result-3371466-1305422840/solver-3371466-1305422840 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371466-1305422840.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.98 8.06 8.02 5/353 28480
/proc/meminfo: memFree=20998548/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=19160 CPUtime=0 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) R 28478 28480 27864 0 -1 4202496 2851 1257 0 0 0 0 0 0 25 0 1 0 634700169 19619840 2781 33554432000 4194304 4417452 140736484107552 18446744073709551615 4274256 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/28480/statm: 4790 2781 148 55 0 2676 0

[startup+0.0646809 s]
/proc/loadavg: 7.98 8.06 8.02 5/353 28480
/proc/meminfo: memFree=20998548/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=29844 CPUtime=0.05 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) R 28478 28480 27864 0 -1 4202496 5603 1257 0 0 5 0 0 0 25 0 1 0 634700169 30560256 5485 33554432000 4194304 4417452 140736484107552 18446744073709551615 4262092 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/28480/statm: 7461 5485 149 55 0 5347 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 29844

[startup+0.100675 s]
/proc/loadavg: 7.98 8.06 8.02 5/353 28480
/proc/meminfo: memFree=20998548/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=33940 CPUtime=0.09 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) R 28478 28480 27864 0 -1 4202496 6627 1257 0 0 8 1 0 0 25 0 1 0 634700169 34754560 6509 33554432000 4194304 4417452 140736484107552 18446744073709551615 4259035 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/28480/statm: 8485 6509 149 55 0 6371 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 33940

[startup+0.300591 s]
/proc/loadavg: 7.98 8.06 8.02 5/353 28480
/proc/meminfo: memFree=20998548/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=107720 CPUtime=0.29 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 18365 1257 0 0 27 2 0 0 25 0 5 0 634700169 110305280 14727 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 26930 14727 158 55 0 24816 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 107720

[startup+0.700524 s]
/proc/loadavg: 7.98 8.06 8.02 5/353 28480
/proc/meminfo: memFree=20998548/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=180048 CPUtime=1.87 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 30604 1257 0 0 183 4 0 0 25 0 5 0 634700169 184369152 18171 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 45012 18171 174 55 0 42898 0
Current children cumulated CPU time (s) 1.87
Current children cumulated vsize (KiB) 180048

[startup+1.50038 s]
/proc/loadavg: 7.98 8.06 8.02 11/358 28490
/proc/meminfo: memFree=20926216/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=173188 CPUtime=5.06 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 45603 1257 0 0 499 7 0 0 25 0 5 0 634700169 177344512 17816 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 43297 17816 175 55 0 41183 0
[pid=28480/tid=28487] ppid=28478 vsize=173188 CPUtime=1.2 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 10234 1257 0 0 119 1 0 0 19 0 5 0 634700198 177344512 17816 33554432000 4194304 4417452 140736484107552 18446744073709551615 4282361 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=173188 CPUtime=1.19 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 8595 1257 0 0 118 1 0 0 25 0 5 0 634700198 177344512 17816 33554432000 4194304 4417452 140736484107552 18446744073709551615 4265832 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=173188 CPUtime=1.16 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 7257 1257 0 0 115 1 0 0 25 0 5 0 634700198 177344512 17816 33554432000 4194304 4417452 140736484107552 18446744073709551615 4287606 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=173188 CPUtime=1.19 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 1160 1257 0 0 119 0 0 0 25 0 5 0 634700198 177344512 17816 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236961 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.06
Current children cumulated vsize (KiB) 173188

[startup+3.1011 s]
/proc/loadavg: 7.98 8.06 8.02 9/358 28490
/proc/meminfo: memFree=20920884/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=187776 CPUtime=11.44 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 56600 1257 0 0 1136 8 0 0 25 0 5 0 634700169 192282624 18382 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 46944 18382 180 55 0 44830 0
[pid=28480/tid=28487] ppid=28478 vsize=187776 CPUtime=2.79 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 13624 1257 0 0 278 1 0 0 23 0 5 0 634700198 192282624 18382 33554432000 4194304 4417452 140736484107552 18446744073709551615 4239739 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=187776 CPUtime=2.79 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 12291 1257 0 0 277 2 0 0 25 0 5 0 634700198 192282624 18382 33554432000 4194304 4417452 140736484107552 18446744073709551615 4247942 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=187776 CPUtime=2.75 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 11168 1257 0 0 273 2 0 0 25 0 5 0 634700198 192282624 18382 33554432000 4194304 4417452 140736484107552 18446744073709551615 4233589 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=187776 CPUtime=2.79 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 1160 1257 0 0 279 0 0 0 25 0 5 0 634700198 192282624 18382 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236722 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.44
Current children cumulated vsize (KiB) 187776

[startup+6.30054 s]
/proc/loadavg: 8.06 8.08 8.02 9/358 28490
/proc/meminfo: memFree=20974624/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=205940 CPUtime=24.21 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 61208 1257 0 0 2412 9 0 0 25 0 5 0 634700169 210882560 22933 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 51485 22933 180 55 0 49371 0
[pid=28480/tid=28487] ppid=28478 vsize=205940 CPUtime=6 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 15389 1257 0 0 598 2 0 0 25 0 5 0 634700198 210882560 22933 33554432000 4194304 4417452 140736484107552 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=205940 CPUtime=5.99 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 13833 1257 0 0 597 2 0 0 25 0 5 0 634700198 210882560 22933 33554432000 4194304 4417452 140736484107552 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=205940 CPUtime=5.92 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 11197 1257 0 0 590 2 0 0 25 0 5 0 634700198 210882560 22933 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=205940 CPUtime=5.99 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 2432 1257 0 0 599 0 0 0 25 0 5 0 634700198 210882560 22933 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.21
Current children cumulated vsize (KiB) 205940

[startup+12.7004 s]
/proc/loadavg: 8.05 8.08 8.02 9/358 28490
/proc/meminfo: memFree=20947280/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=205624 CPUtime=49.73 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 61339 1257 0 0 4964 9 0 0 25 0 5 0 634700169 210558976 22854 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 51406 22854 180 55 0 49292 0
[pid=28480/tid=28487] ppid=28478 vsize=205624 CPUtime=12.4 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 15408 1257 0 0 1238 2 0 0 25 0 5 0 634700198 210558976 22854 33554432000 4194304 4417452 140736484107552 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=205624 CPUtime=12.39 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 13917 1257 0 0 1237 2 0 0 25 0 5 0 634700198 210558976 22854 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=205624 CPUtime=12.24 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 11225 1257 0 0 1222 2 0 0 25 0 5 0 634700198 210558976 22854 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=205624 CPUtime=12.39 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 2432 1257 0 0 1239 0 0 0 25 0 5 0 634700198 210558976 22854 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236574 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.73
Current children cumulated vsize (KiB) 205624

[startup+25.5012 s]
/proc/loadavg: 8.04 8.07 8.02 9/358 28490
/proc/meminfo: memFree=20901776/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=216644 CPUtime=100.8 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 64201 1257 0 0 10070 10 0 0 25 0 5 0 634700169 221843456 25615 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 54161 25615 180 55 0 52047 0
[pid=28480/tid=28487] ppid=28478 vsize=216644 CPUtime=25.2 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 15824 1257 0 0 2518 2 0 0 25 0 5 0 634700198 221843456 25615 33554432000 4194304 4417452 140736484107552 18446744073709551615 4366661 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=216644 CPUtime=25.19 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 13953 1257 0 0 2517 2 0 0 25 0 5 0 634700198 221843456 25615 33554432000 4194304 4417452 140736484107552 18446744073709551615 4275944 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=216644 CPUtime=24.9 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 12683 1257 0 0 2488 2 0 0 25 0 5 0 634700198 221843456 25615 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236722 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=216644 CPUtime=25.19 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 3384 1257 0 0 2519 0 0 0 25 0 5 0 634700198 221843456 25615 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 100.8
Current children cumulated vsize (KiB) 216644

[startup+51.1007 s]
/proc/loadavg: 8.11 8.08 8.02 9/358 28491
/proc/meminfo: memFree=20843140/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=259096 CPUtime=202.92 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 80540 1257 0 0 20279 13 0 0 25 0 5 0 634700169 265314304 36228 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 64774 36228 180 55 0 62660 0
[pid=28480/tid=28487] ppid=28478 vsize=259096 CPUtime=50.8 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 19535 1257 0 0 5077 3 0 0 25 0 5 0 634700198 265314304 36228 33554432000 4194304 4417452 140736484107552 18446744073709551615 4357883 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=259096 CPUtime=50.79 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 16516 1257 0 0 5077 2 0 0 25 0 5 0 634700198 265314304 36228 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=259096 CPUtime=50.22 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 14482 1257 0 0 5020 2 0 0 25 0 5 0 634700198 265314304 36228 33554432000 4194304 4417452 140736484107552 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=259096 CPUtime=50.79 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 11650 1257 0 0 5078 1 0 0 25 0 5 0 634700198 265314304 36228 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 202.92
Current children cumulated vsize (KiB) 259096

[startup+102.314 s]
/proc/loadavg: 8.13 8.10 8.03 9/358 28493
/proc/meminfo: memFree=20745912/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=267428 CPUtime=407.2 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 97828 1257 0 0 40705 15 0 0 25 0 5 0 634700169 273846272 38311 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 66857 38311 180 55 0 64743 0
[pid=28480/tid=28487] ppid=28478 vsize=267428 CPUtime=102.01 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 20956 1257 0 0 10198 3 0 0 25 0 5 0 634700198 273846272 38311 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=267428 CPUtime=102 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 17579 1257 0 0 10198 2 0 0 25 0 5 0 634700198 273846272 38311 33554432000 4194304 4417452 140736484107552 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=267428 CPUtime=100.86 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 15337 1257 0 0 10084 2 0 0 25 0 5 0 634700198 273846272 38311 33554432000 4194304 4417452 140736484107552 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=267428 CPUtime=102 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 25599 1257 0 0 10197 3 0 0 25 0 5 0 634700198 273846272 38311 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.2
Current children cumulated vsize (KiB) 267428

[startup+162.301 s]
/proc/loadavg: 8.08 8.09 8.03 9/358 28494
/proc/meminfo: memFree=20726428/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=278848 CPUtime=646.5 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 181110 1257 0 0 64622 28 0 0 25 0 5 0 634700169 285540352 41166 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 69712 41166 180 55 0 67598 0
[pid=28480/tid=28487] ppid=28478 vsize=278848 CPUtime=162 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 38368 1257 0 0 16194 6 0 0 25 0 5 0 634700198 285540352 41166 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=278848 CPUtime=161.99 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 34451 1257 0 0 16194 5 0 0 25 0 5 0 634700198 285540352 41166 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=278848 CPUtime=160.19 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 18799 1257 0 0 16016 3 0 0 25 0 5 0 634700198 285540352 41166 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=278848 CPUtime=162 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 71135 1257 0 0 16189 11 0 0 25 0 5 0 634700198 285540352 41166 33554432000 4194304 4417452 140736484107552 18446744073709551615 4237332 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 646.5
Current children cumulated vsize (KiB) 278848


################
# More data... #
################

[pid=28480/tid=28488] ppid=28478 vsize=463912 CPUtime=702 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 92722 1257 0 0 70188 12 0 0 25 0 5 0 634700198 475045888 87432 33554432000 4194304 4417452 140736484107552 18446744073709551615 4365959 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=463912 CPUtime=694.23 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 50292 1257 0 0 69416 7 0 0 25 0 5 0 634700198 475045888 87432 33554432000 4194304 4417452 140736484107552 18446744073709551615 4365990 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=463912 CPUtime=702.01 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 190524 1257 0 0 70172 29 0 0 25 0 5 0 634700198 475045888 87432 33554432000 4194304 4417452 140736484107552 18446744073709551615 4353607 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2800.57
Current children cumulated vsize (KiB) 463912

[startup+762.314 s]
/proc/loadavg: 4.08 5.85 7.11 5/348 28528
/proc/meminfo: memFree=21209192/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=443092 CPUtime=3039.96 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 438439 1257 0 0 303931 65 0 0 25 0 5 0 634700169 453726208 82227 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 110773 82227 180 55 0 108659 0
[pid=28480/tid=28487] ppid=28478 vsize=443092 CPUtime=762.02 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 79950 1257 0 0 76190 12 0 0 25 0 5 0 634700198 453726208 82227 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=443092 CPUtime=762.01 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 93368 1257 0 0 76189 12 0 0 25 0 5 0 634700198 453726208 82227 33554432000 4194304 4417452 140736484107552 18446744073709551615 4353598 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=443092 CPUtime=753.58 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 50838 1257 0 0 75351 7 0 0 25 0 5 0 634700198 453726208 82227 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=443092 CPUtime=762.02 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 195926 1257 0 0 76173 29 0 0 25 0 5 0 634700198 453726208 82227 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3039.96
Current children cumulated vsize (KiB) 443092

[startup+822.301 s]
/proc/loadavg: 4.03 5.51 6.91 5/348 28530
/proc/meminfo: memFree=21191316/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=461720 CPUtime=3279.26 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 466530 1257 0 0 327857 69 0 0 25 0 5 0 634700169 472801280 86884 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 115430 86884 180 55 0 113316 0
[pid=28480/tid=28487] ppid=28478 vsize=461720 CPUtime=822.01 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 85662 1257 0 0 82188 13 0 0 25 0 5 0 634700198 472801280 86884 33554432000 4194304 4417452 140736484107552 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=461720 CPUtime=822 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 103496 1257 0 0 82187 13 0 0 25 0 5 0 634700198 472801280 86884 33554432000 4194304 4417452 140736484107552 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=461720 CPUtime=812.91 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 50853 1257 0 0 81284 7 0 0 25 0 5 0 634700198 472801280 86884 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=461720 CPUtime=822.01 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 208162 1257 0 0 82170 31 0 0 25 0 5 0 634700198 472801280 86884 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236577 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3279.26
Current children cumulated vsize (KiB) 461720

[startup+882.301 s]
/proc/loadavg: 4.01 5.23 6.72 5/348 28531
/proc/meminfo: memFree=21153232/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=500568 CPUtime=3518.61 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 487383 1257 0 0 351789 72 0 0 25 0 5 0 634700169 512581632 96596 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 125142 96596 180 55 0 123028 0
[pid=28480/tid=28487] ppid=28478 vsize=500568 CPUtime=882.01 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 91136 1257 0 0 88188 13 0 0 25 0 5 0 634700198 512581632 96596 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=500568 CPUtime=882 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 107953 1257 0 0 88186 14 0 0 25 0 5 0 634700198 512581632 96596 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=500568 CPUtime=872.25 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 53260 1257 0 0 87218 7 0 0 25 0 5 0 634700198 512581632 96596 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=500568 CPUtime=882.01 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 216677 1257 0 0 88168 33 0 0 25 0 5 0 634700198 512581632 96596 33554432000 4194304 4417452 140736484107552 18446744073709551615 4236803 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3518.61
Current children cumulated vsize (KiB) 500568

[startup+942.301 s]
/proc/loadavg: 4.00 5.00 6.55 5/348 28533
/proc/meminfo: memFree=21190804/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=465656 CPUtime=3757.96 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 516499 1257 0 0 375720 76 0 0 25 0 5 0 634700169 476831744 87887 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 116414 87887 180 55 0 114300 0
[pid=28480/tid=28487] ppid=28478 vsize=465656 CPUtime=942.02 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 96604 1257 0 0 94188 14 0 0 25 0 5 0 634700198 476831744 87887 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=465656 CPUtime=942.01 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 112065 1257 0 0 94186 15 0 0 25 0 5 0 634700198 476831744 87887 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=465656 CPUtime=931.61 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 55328 1257 0 0 93153 8 0 0 25 0 5 0 634700198 476831744 87887 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=465656 CPUtime=942.02 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 234145 1257 0 0 94166 36 0 0 25 0 5 0 634700198 476831744 87887 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3757.96
Current children cumulated vsize (KiB) 465656

[startup+1002.3 s]
/proc/loadavg: 4.00 4.82 6.39 5/348 28535
/proc/meminfo: memFree=21149124/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=503616 CPUtime=3997.3 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 543286 1257 0 0 399650 80 0 0 25 0 5 0 634700169 515702784 97358 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 125904 97358 180 55 0 123790 0
[pid=28480/tid=28487] ppid=28478 vsize=503616 CPUtime=1002.02 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 104463 1257 0 0 100187 15 0 0 25 0 5 0 634700198 515702784 97358 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=503616 CPUtime=1002.01 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 112065 1257 0 0 100186 15 0 0 25 0 5 0 634700198 515702784 97358 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=503616 CPUtime=990.94 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 59424 1257 0 0 99086 8 0 0 25 0 5 0 634700198 515702784 97358 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=503616 CPUtime=1002.01 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 248977 1257 0 0 100163 38 0 0 25 0 5 0 634700198 515702784 97358 33554432000 4194304 4417452 140736484107552 18446744073709551615 4251160 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3997.3
Current children cumulated vsize (KiB) 503616

[startup+1062.3 s]
/proc/loadavg: 4.00 4.67 6.24 5/348 28536
/proc/meminfo: memFree=21126908/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=526072 CPUtime=4236.66 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 563113 1257 0 0 423584 82 0 0 25 0 5 0 634700169 538697728 102972 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 131518 102972 180 55 0 129404 0
[pid=28480/tid=28487] ppid=28478 vsize=526072 CPUtime=1062.01 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 108575 1257 0 0 106186 15 0 0 25 0 5 0 634700198 538697728 102972 33554432000 4194304 4417452 140736484107552 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=526072 CPUtime=1062.01 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 122306 1257 0 0 106185 16 0 0 25 0 5 0 634700198 538697728 102972 33554432000 4194304 4417452 140736484107552 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=526072 CPUtime=1050.3 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 59440 1257 0 0 105022 8 0 0 25 0 5 0 634700198 538697728 102972 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=526072 CPUtime=1062.01 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 254435 1257 0 0 106163 38 0 0 25 0 5 0 634700198 538697728 102972 33554432000 4194304 4417452 140736484107552 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4236.66
Current children cumulated vsize (KiB) 526072

[startup+1122.3 s]
/proc/loadavg: 4.03 4.56 6.10 5/348 28538
/proc/meminfo: memFree=21128504/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=524832 CPUtime=4476.01 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 608606 1257 0 0 447512 89 0 0 25 0 5 0 634700169 537427968 102694 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 131208 102694 180 55 0 129094 0
[pid=28480/tid=28487] ppid=28478 vsize=524832 CPUtime=1122.01 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 117439 1257 0 0 112185 16 0 0 25 0 5 0 634700198 537427968 102694 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=524832 CPUtime=1122.01 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 130941 1257 0 0 112184 17 0 0 25 0 5 0 634700198 537427968 102694 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=524832 CPUtime=1109.64 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 78346 1257 0 0 110952 12 0 0 25 0 5 0 634700198 537427968 102694 33554432000 4194304 4417452 140736484107552 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=524832 CPUtime=1122.01 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 263523 1257 0 0 112162 39 0 0 25 0 5 0 634700198 537427968 102694 33554432000 4194304 4417452 140736484107552 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4476.01
Current children cumulated vsize (KiB) 524832

[startup+1182.3 s]
/proc/loadavg: 4.20 4.50 5.98 5/348 28539
/proc/meminfo: memFree=21119056/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=518260 CPUtime=4715.37 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 624026 1257 0 0 471446 91 0 0 25 0 5 0 634700169 530698240 101019 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 129565 101019 180 55 0 127451 0
[pid=28480/tid=28487] ppid=28478 vsize=518260 CPUtime=1182.02 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 124214 1257 0 0 118185 17 0 0 25 0 5 0 634700198 530698240 101019 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=518260 CPUtime=1182.01 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 135054 1257 0 0 118184 17 0 0 25 0 5 0 634700198 530698240 101019 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=518260 CPUtime=1168.99 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 78346 1257 0 0 116887 12 0 0 25 0 5 0 634700198 530698240 101019 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=518260 CPUtime=1182.02 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 268055 1257 0 0 118162 40 0 0 25 0 5 0 634700198 530698240 101019 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4715.37
Current children cumulated vsize (KiB) 518260



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 4.14 4.47 5.94 5/348 28540
/proc/meminfo: memFree=21156876/32951124 swapFree=67111348/67111528
[pid=28480] ppid=28478 vsize=495720 CPUtime=4800.36 cores=1,3,5,7
/proc/28480/stat : 28480 (plingeling) S 28478 28480 27864 0 -1 4202496 626776 1257 0 0 479944 92 0 0 25 0 5 0 634700169 507617280 95384 33554432000 4194304 4417452 140736484107552 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/28480/statm: 123930 95384 180 55 0 121816 0
[pid=28480/tid=28487] ppid=28478 vsize=495720 CPUtime=1203.33 cores=1,3,5,7
/proc/28480/task/28487/stat : 28487 (plingeling) R 28478 28480 27864 0 -1 4202560 124230 1257 0 0 120316 17 0 0 25 0 5 0 634700198 507617280 95384 33554432000 4194304 4417452 140736484107552 18446744073709551615 4232659 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28480/tid=28488] ppid=28478 vsize=495720 CPUtime=1203.32 cores=1,3,5,7
/proc/28480/task/28488/stat : 28488 (plingeling) R 28478 28480 27864 0 -1 4202560 135054 1257 0 0 120315 17 0 0 25 0 5 0 634700198 507617280 95384 33554432000 4194304 4417452 140736484107552 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28480/tid=28489] ppid=28478 vsize=495720 CPUtime=1190.06 cores=1,3,5,7
/proc/28480/task/28489/stat : 28489 (plingeling) R 28478 28480 27864 0 -1 4202560 78346 1257 0 0 118994 12 0 0 25 0 5 0 634700198 507617280 95384 33554432000 4194304 4417452 140736484107552 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28480/tid=28490] ppid=28478 vsize=495720 CPUtime=1203.34 cores=1,3,5,7
/proc/28480/task/28490/stat : 28490 (plingeling) R 28478 28480 27864 0 -1 4202560 270789 1257 0 0 120293 41 0 0 25 0 5 0 634700198 507617280 95384 33554432000 4194304 4417452 140736484107552 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 495720

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.64
CPU time (s): 4800.42
CPU user time (s): 4799.48
CPU system time (s): 0.941856
CPU usage (%): 398.825
Max. virtual memory (cumulated for all children) (KiB): 607748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.48
system time used= 0.941856
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 628033
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 215
involuntary context switches= 34293

runsolver used 3.60645 second user time and 9.62054 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-15 03:27:20
IDJOB=3371466
IDBENCH=83109
IDSOLVER=1848
FILE ID=node144/3371466-1305422840
RUNJOBID= node144-1305419670-27883
PBS_JOBID= 13324583
Free space on /tmp= 73232 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom25.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371466-1305422840/watcher-3371466-1305422840 -o /tmp/evaluation-result-3371466-1305422840/solver-3371466-1305422840 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371466-1305422840.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c40bd543dad558d19995fef4fd742233
RANDOM SEED=1066074319

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20998820 kB
Buffers:        292716 kB
Cached:        3648416 kB
SwapCached:          0 kB
Active:        8769080 kB
Inactive:      2836328 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20998820 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            3888 kB
Writeback:           0 kB
AnonPages:     7664128 kB
Mapped:          27804 kB
Slab:           244868 kB
PageTables:      38168 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 82579140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73236 MiB
End job on node144 at 2011-05-15 03:47:26