Trace number 3309930

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.5 5011.73

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00N23.cnf
MD5SUM1a1f0dddf727883e0973677dd00e9269
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3122.96
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2210893
Sum of the clauses size20370578
Maximum clause length105
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 241189
Number of clauses of size 336730
Number of clauses of size 432798
Number of clauses of size 5188784
Number of clauses of size over 51911364

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309930-1304015264/watcher-3309930-1304015264 -o /tmp/evaluation-result-3309930-1304015264/solver-3309930-1304015264 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309930-1304015264.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 8.01 7.62 1/170 354
/proc/meminfo: memFree=31952260/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=8728 CPUtime=0 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 216 0 0 0 0 0 0 0 24 0 1 0 493942324 8937472 146 33554432000 4194304 4417332 140734924122256 18446744073709551615 270338383616 0 0 4096 0 18446744071562362840 0 0 17 0 0 0 0
/proc/354/statm: 2182 146 122 55 0 68 0

[startup+0.011177 s]
/proc/loadavg: 8.10 8.01 7.62 1/170 354
/proc/meminfo: memFree=31952260/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=11336 CPUtime=0 cores=0-7
/proc/354/stat : 354 (plingeling) R 352 354 32399 0 -1 4202496 927 1253 0 0 0 0 0 0 24 0 1 0 493942324 11608064 856 33554432000 4194304 4417332 140734924122256 18446744073709551615 4274426 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/354/statm: 2834 856 147 55 0 720 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 11336

[startup+0.101124 s]
/proc/loadavg: 8.10 8.01 7.62 1/170 354
/proc/meminfo: memFree=31952260/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=22904 CPUtime=0.09 cores=0-7
/proc/354/stat : 354 (plingeling) R 352 354 32399 0 -1 4202496 3932 1253 0 0 9 0 0 0 25 0 1 0 493942324 23453696 3749 33554432000 4194304 4417332 140734924122256 18446744073709551615 4231291 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/354/statm: 5726 3749 148 55 0 3612 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 22904

[startup+0.301086 s]
/proc/loadavg: 8.10 8.01 7.62 1/170 354
/proc/meminfo: memFree=31952260/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=51576 CPUtime=0.29 cores=0-7
/proc/354/stat : 354 (plingeling) R 352 354 32399 0 -1 4202496 11100 1253 0 0 28 1 0 0 25 0 1 0 493942324 52813824 10917 33554432000 4194304 4417332 140734924122256 18446744073709551615 270338002400 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/354/statm: 12894 10917 148 55 0 10780 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 51576

[startup+0.701009 s]
/proc/loadavg: 8.10 8.01 7.62 1/170 354
/proc/meminfo: memFree=31952260/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=92536 CPUtime=0.69 cores=0-7
/proc/354/stat : 354 (plingeling) R 352 354 32399 0 -1 4202496 21340 1253 0 0 66 3 0 0 25 0 1 0 493942324 94756864 21157 33554432000 4194304 4417332 140734924122256 18446744073709551615 4321569 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/354/statm: 23134 21157 148 55 0 21020 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 92536

[startup+1.50085 s]
/proc/loadavg: 7.53 7.90 7.59 2/171 360
/proc/meminfo: memFree=31802964/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=215568 CPUtime=1.48 cores=0-7
/proc/354/stat : 354 (plingeling) R 352 354 32399 0 -1 4202496 52066 1253 0 0 142 6 0 0 25 0 1 0 493942324 220741632 51883 33554432000 4194304 4417332 140734924122256 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/354/statm: 53892 51883 148 55 0 51778 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 215568

[startup+3.10053 s]
/proc/loadavg: 7.53 7.90 7.59 2/171 360
/proc/meminfo: memFree=31802964/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=543248 CPUtime=3.09 cores=0-7
/proc/354/stat : 354 (plingeling) R 352 354 32399 0 -1 4202496 133986 1253 0 0 293 16 0 0 25 0 1 0 493942324 556285952 133803 33554432000 4194304 4417332 140734924122256 18446744073709551615 4231381 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/354/statm: 135812 133803 148 55 0 133698 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 543248

[startup+6.30089 s]
/proc/loadavg: 7.53 7.90 7.59 2/171 361
/proc/meminfo: memFree=30893892/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=1067536 CPUtime=6.29 cores=0-7
/proc/354/stat : 354 (plingeling) R 352 354 32399 0 -1 4202496 265058 1253 0 0 597 32 0 0 25 0 1 0 493942324 1093156864 264875 33554432000 4194304 4417332 140734924122256 18446744073709551615 4231327 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/354/statm: 266884 264875 148 55 0 264770 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1067536

[startup+12.7006 s]
/proc/loadavg: 7.09 7.79 7.55 9/179 369
/proc/meminfo: memFree=30584280/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=1592096 CPUtime=36.2 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 449000 1253 0 0 3557 63 0 0 18 0 9 0 493942324 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 398024 359220 176 55 0 395910 0
[pid=354/tid=362] ppid=352 vsize=1592096 CPUtime=3.36 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 204 1253 0 0 336 0 0 0 25 0 9 0 493943256 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4310180 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=363] ppid=352 vsize=1592096 CPUtime=3.36 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 404 1253 0 0 336 0 0 0 25 0 9 0 493943256 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4305912 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=364] ppid=352 vsize=1592096 CPUtime=3.36 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 17152 1253 0 0 331 5 0 0 25 0 9 0 493943256 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4255675 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=1592096 CPUtime=3.36 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 17044 1253 0 0 331 5 0 0 25 0 9 0 493943256 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=366] ppid=352 vsize=1592096 CPUtime=3.35 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 399 1253 0 0 335 0 0 0 25 0 9 0 493943257 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4308565 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=1592096 CPUtime=3.33 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 399 1253 0 0 333 0 0 0 25 0 9 0 493943258 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4316164 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=368] ppid=352 vsize=1592096 CPUtime=3.34 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 16853 1253 0 0 330 4 0 0 25 0 9 0 493943258 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=1592096 CPUtime=3.34 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 399 1253 0 0 334 0 0 0 25 0 9 0 493943258 1630306304 359220 33554432000 4194304 4417332 140734924122256 18446744073709551615 4306923 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 36.2
Current children cumulated vsize (KiB) 1592096

[startup+25.5011 s]
/proc/loadavg: 7.23 7.79 7.56 9/179 369
/proc/meminfo: memFree=30086952/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2018900 CPUtime=138.26 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 800263 1253 0 0 13661 165 0 0 18 0 9 0 493942324 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 504725 465925 180 55 0 502611 0
[pid=354/tid=362] ppid=352 vsize=2018900 CPUtime=16.16 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 52207 1253 0 0 1604 12 0 0 25 0 9 0 493943256 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4232317 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2018900 CPUtime=16.1 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 73962 1253 0 0 1584 26 0 0 25 0 9 0 493943256 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=364] ppid=352 vsize=2018900 CPUtime=16.16 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 50656 1253 0 0 1600 16 0 0 25 0 9 0 493943256 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2018900 CPUtime=16.04 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 19850 1253 0 0 1599 5 0 0 25 0 9 0 493943256 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2018900 CPUtime=16.06 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 52930 1253 0 0 1589 17 0 0 25 0 9 0 493943257 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2018900 CPUtime=16.06 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 52340 1253 0 0 1593 13 0 0 25 0 9 0 493943258 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=368] ppid=352 vsize=2018900 CPUtime=16.15 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 50118 1253 0 0 1599 16 0 0 25 0 9 0 493943258 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2018900 CPUtime=16.14 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 52054 1253 0 0 1604 10 0 0 25 0 9 0 493943258 2067353600 465925 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 138.26
Current children cumulated vsize (KiB) 2018900

[startup+51.101 s]
/proc/loadavg: 7.49 7.81 7.57 9/179 370
/proc/meminfo: memFree=29996980/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2110184 CPUtime=342.89 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 1015736 1253 0 0 34096 193 0 0 18 0 9 0 493942324 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 527546 488746 180 55 0 525432 0
[pid=354/tid=362] ppid=352 vsize=2110184 CPUtime=41.76 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 84975 1253 0 0 4159 17 0 0 25 0 9 0 493943256 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2110184 CPUtime=41.66 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 109098 1253 0 0 4136 30 0 0 25 0 9 0 493943256 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4278345 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=364] ppid=352 vsize=2110184 CPUtime=41.75 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 88454 1253 0 0 4153 22 0 0 25 0 9 0 493943256 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2110184 CPUtime=41.64 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 27140 1253 0 0 4158 6 0 0 25 0 9 0 493943256 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2110184 CPUtime=41.66 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 87507 1253 0 0 4145 21 0 0 25 0 9 0 493943257 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2110184 CPUtime=41.52 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 87476 1253 0 0 4135 17 0 0 25 0 9 0 493943258 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=368] ppid=352 vsize=2110184 CPUtime=41.75 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 82886 1253 0 0 4155 20 0 0 25 0 9 0 493943258 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4239411 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2110184 CPUtime=41.74 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 52054 1253 0 0 4164 10 0 0 25 0 9 0 493943258 2160828416 488746 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 342.89
Current children cumulated vsize (KiB) 2110184

[startup+102.307 s]
/proc/loadavg: 7.85 7.85 7.59 9/179 371
/proc/meminfo: memFree=29992792/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2114800 CPUtime=752.28 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 1187794 1253 0 0 75014 214 0 0 18 0 9 0 493942324 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 528700 489900 180 55 0 526586 0
[pid=354/tid=362] ppid=352 vsize=2114800 CPUtime=92.97 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 84975 1253 0 0 9280 17 0 0 25 0 9 0 493943256 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4247538 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2114800 CPUtime=92.87 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 141866 1253 0 0 9253 34 0 0 25 0 9 0 493943256 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=364] ppid=352 vsize=2114800 CPUtime=92.95 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 121222 1253 0 0 9269 26 0 0 25 0 9 0 493943256 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2114800 CPUtime=92.85 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 33661 1253 0 0 9278 7 0 0 25 0 9 0 493943256 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2114800 CPUtime=92.87 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 87507 1253 0 0 9266 21 0 0 25 0 9 0 493943257 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2114800 CPUtime=92.45 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 120244 1253 0 0 9224 21 0 0 25 0 9 0 493943258 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=368] ppid=352 vsize=2114800 CPUtime=92.96 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 117030 1253 0 0 9272 24 0 0 25 0 9 0 493943258 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4253440 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2114800 CPUtime=92.95 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 85143 1253 0 0 9281 14 0 0 25 0 9 0 493943258 2165555200 489900 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 752.28
Current children cumulated vsize (KiB) 2114800

[startup+162.301 s]
/proc/loadavg: 7.99 7.89 7.62 9/179 373
/proc/meminfo: memFree=29601936/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2506712 CPUtime=1231.94 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 1369584 1253 0 0 122961 233 0 0 18 0 9 0 493942324 2566873088 587878 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 626678 587878 180 55 0 624564 0
[pid=354/tid=362] ppid=352 vsize=2506712 CPUtime=152.97 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 117743 1253 0 0 15276 21 0 0 25 0 9 0 493943256 2566873088 587878 33554432000 4194304 4417332 140734924122256 18446744073709551615 4357964 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2506712 CPUtime=152.87 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.10 8.06 8.01 9/179 516
/proc/meminfo: memFree=29696104/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2409888 CPUtime=37687.4 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 5345049 1253 0 0 3767731 1004 0 0 18 0 9 0 493942324 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 602472 563700 180 55 0 600358 0
[pid=354/tid=362] ppid=352 vsize=2409888 CPUtime=4713.16 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 560604 1253 0 0 471206 110 0 0 25 0 9 0 493943256 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2409888 CPUtime=4696.05 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 571103 1253 0 0 469494 111 0 0 25 0 9 0 493943256 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=364] ppid=352 vsize=2409888 CPUtime=4712.54 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 649059 1253 0 0 471122 132 0 0 25 0 9 0 493943256 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2409888 CPUtime=4712.39 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 854995 1253 0 0 471074 165 0 0 25 0 9 0 493943256 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2409888 CPUtime=4713.08 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 728553 1253 0 0 471157 151 0 0 25 0 9 0 493943257 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2409888 CPUtime=4704.56 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 513561 1253 0 0 470361 95 0 0 25 0 9 0 493943258 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=368] ppid=352 vsize=2409888 CPUtime=4713.17 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 523146 1253 0 0 471226 91 0 0 25 0 9 0 493943258 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2409888 CPUtime=4713.02 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 547882 1253 0 0 471202 100 0 0 25 0 9 0 493943258 2467725312 563700 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37687.3
Current children cumulated vsize (KiB) 2409888

[startup+4782.3 s]
/proc/loadavg: 8.10 8.06 8.01 9/179 518
/proc/meminfo: memFree=29707488/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2399936 CPUtime=38167 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 5423587 1253 0 0 3815683 1017 0 0 18 0 9 0 493942324 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 599984 561212 180 55 0 597870 0
[pid=354/tid=362] ppid=352 vsize=2399936 CPUtime=4773.16 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 566334 1253 0 0 477205 111 0 0 25 0 9 0 493943256 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2399936 CPUtime=4755.72 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 576842 1253 0 0 475460 112 0 0 25 0 9 0 493943256 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=364] ppid=352 vsize=2399936 CPUtime=4772.54 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 658492 1253 0 0 477120 134 0 0 25 0 9 0 493943256 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2399936 CPUtime=4772.39 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 868101 1253 0 0 477071 168 0 0 25 0 9 0 493943256 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4250464 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2399936 CPUtime=4773.07 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 736194 1253 0 0 477156 151 0 0 25 0 9 0 493943257 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2399936 CPUtime=4764.56 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 528560 1253 0 0 476358 98 0 0 25 0 9 0 493943258 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=368] ppid=352 vsize=2399936 CPUtime=4773.16 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 533750 1253 0 0 477223 93 0 0 25 0 9 0 493943258 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2399936 CPUtime=4773.01 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 559168 1253 0 0 477200 101 0 0 25 0 9 0 493943258 2457534464 561212 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38167
Current children cumulated vsize (KiB) 2399936

[startup+4842.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/179 520
/proc/meminfo: memFree=29658428/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2448196 CPUtime=38646.7 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 5467196 1253 0 0 3863645 1024 0 0 18 0 9 0 493942324 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 612049 573277 180 55 0 609935 0
[pid=354/tid=362] ppid=352 vsize=2448196 CPUtime=4833.17 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 569092 1253 0 0 483206 111 0 0 25 0 9 0 493943256 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2448196 CPUtime=4815.38 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 579082 1253 0 0 481426 112 0 0 25 0 9 0 493943256 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=364] ppid=352 vsize=2448196 CPUtime=4832.54 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 666495 1253 0 0 483119 135 0 0 25 0 9 0 493943256 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2448196 CPUtime=4832.39 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 874699 1253 0 0 483070 169 0 0 25 0 9 0 493943256 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2448196 CPUtime=4833.07 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 751557 1253 0 0 483154 153 0 0 25 0 9 0 493943257 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2448196 CPUtime=4824.56 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 532922 1253 0 0 482358 98 0 0 25 0 9 0 493943258 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=368] ppid=352 vsize=2448196 CPUtime=4833.16 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 535657 1253 0 0 483223 93 0 0 25 0 9 0 493943258 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364512 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2448196 CPUtime=4833.01 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 561546 1253 0 0 483199 102 0 0 25 0 9 0 493943258 2506952704 573277 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38646.7
Current children cumulated vsize (KiB) 2448196

[startup+4902.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/179 521
/proc/meminfo: memFree=29757852/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2339160 CPUtime=39126.4 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 5523274 1253 0 0 3911603 1034 0 0 18 0 9 0 493942324 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 584790 546018 180 55 0 582676 0
[pid=354/tid=362] ppid=352 vsize=2339160 CPUtime=4893.17 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 574823 1253 0 0 489205 112 0 0 25 0 9 0 493943256 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2339160 CPUtime=4875.07 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 581652 1253 0 0 487394 113 0 0 25 0 9 0 493943256 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=364] ppid=352 vsize=2339160 CPUtime=4892.53 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 672117 1253 0 0 489117 136 0 0 25 0 9 0 493943256 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2339160 CPUtime=4892.39 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 881315 1253 0 0 489068 171 0 0 25 0 9 0 493943256 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364631 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2339160 CPUtime=4893.08 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 760027 1253 0 0 489152 156 0 0 25 0 9 0 493943257 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2339160 CPUtime=4884.57 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 548456 1253 0 0 488356 101 0 0 25 0 9 0 493943258 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=368] ppid=352 vsize=2339160 CPUtime=4893.17 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 539406 1253 0 0 489223 94 0 0 25 0 9 0 493943258 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2339160 CPUtime=4893.01 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 569332 1253 0 0 489198 103 0 0 25 0 9 0 493943258 2395299840 546018 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39126.4
Current children cumulated vsize (KiB) 2339160

[startup+4962.3 s]
/proc/loadavg: 8.11 8.06 8.01 9/179 523
/proc/meminfo: memFree=29695084/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2421428 CPUtime=39606.1 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 5579709 1253 0 0 3959563 1043 0 0 18 0 9 0 493942324 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 605357 566585 180 55 0 603243 0
[pid=354/tid=362] ppid=352 vsize=2421428 CPUtime=4953.17 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 580552 1253 0 0 495205 112 0 0 25 0 9 0 493943256 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2421428 CPUtime=4934.75 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 584394 1253 0 0 493362 113 0 0 25 0 9 0 493943256 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=364] ppid=352 vsize=2421428 CPUtime=4952.53 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 683530 1253 0 0 495114 139 0 0 25 0 9 0 493943256 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2421428 CPUtime=4952.4 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 885632 1253 0 0 495069 171 0 0 25 0 9 0 493943256 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2421428 CPUtime=4953.08 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 772013 1253 0 0 495151 157 0 0 25 0 9 0 493943257 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2421428 CPUtime=4944.57 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 555701 1253 0 0 494355 102 0 0 25 0 9 0 493943258 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=368] ppid=352 vsize=2421428 CPUtime=4953.17 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 541213 1253 0 0 495223 94 0 0 25 0 9 0 493943258 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4239605 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2421428 CPUtime=4953.01 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 580528 1253 0 0 495197 104 0 0 25 0 9 0 493943258 2479542272 566585 33554432000 4194304 4417332 140734924122256 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39606.1
Current children cumulated vsize (KiB) 2421428



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.61 s]
/proc/loadavg: 8.05 8.05 8.00 9/179 524
/proc/meminfo: memFree=29704096/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=2402464 CPUtime=40000.3 cores=0-7
/proc/354/stat : 354 (plingeling) S 352 354 32399 0 -1 4202496 5635112 1253 0 0 3998974 1053 0 0 18 0 9 0 493942324 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 600616 561844 180 55 0 598502 0
[pid=354/tid=362] ppid=352 vsize=2402464 CPUtime=5002.48 cores=0-7
/proc/354/task/362/stat : 362 (plingeling) R 352 354 32399 0 -1 4202560 583164 1253 0 0 500135 113 0 0 25 0 9 0 493943256 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=2402464 CPUtime=4983.79 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4202560 604336 1253 0 0 498263 116 0 0 25 0 9 0 493943256 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4269710 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=354/tid=364] ppid=352 vsize=2402464 CPUtime=5001.83 cores=0-7
/proc/354/task/364/stat : 364 (plingeling) R 352 354 32399 0 -1 4202560 688420 1253 0 0 500044 139 0 0 25 0 9 0 493943256 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=354/tid=365] ppid=352 vsize=2402464 CPUtime=5001.71 cores=0-7
/proc/354/task/365/stat : 365 (plingeling) R 352 354 32399 0 -1 4202560 890139 1253 0 0 499999 172 0 0 25 0 9 0 493943256 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=354/tid=366] ppid=352 vsize=2402464 CPUtime=5002.39 cores=0-7
/proc/354/task/366/stat : 366 (plingeling) R 352 354 32399 0 -1 4202560 783390 1253 0 0 500078 161 0 0 25 0 9 0 493943257 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=354/tid=367] ppid=352 vsize=2402464 CPUtime=4993.88 cores=0-7
/proc/354/task/367/stat : 367 (plingeling) R 352 354 32399 0 -1 4202560 560964 1253 0 0 499285 103 0 0 25 0 9 0 493943258 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=354/tid=368] ppid=352 vsize=2402464 CPUtime=5002.48 cores=0-7
/proc/354/task/368/stat : 368 (plingeling) R 352 354 32399 0 -1 4202560 548025 1253 0 0 500153 95 0 0 25 0 9 0 493943258 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=354/tid=369] ppid=352 vsize=2402464 CPUtime=5002.32 cores=0-7
/proc/354/task/369/stat : 369 (plingeling) R 352 354 32399 0 -1 4202560 580528 1253 0 0 500128 104 0 0 25 0 9 0 493943258 2460123136 561844 33554432000 4194304 4417332 140734924122256 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 2402464

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.71 s]
/proc/loadavg: 8.05 8.05 8.00 9/179 524
/proc/meminfo: memFree=29704096/32951124 swapFree=67111356/67111528
[pid=354] ppid=352 vsize=0 CPUtime=40000.4 cores=0-7
/proc/354/stat : 354 (plingeling) Z 352 354 32399 0 -1 4203548 5635113 1253 0 0 3998981 1062 0 0 18 0 2 0 493942324 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 7 0 0 0
/proc/354/statm: 0 0 0 0 0 0 0
[pid=354/tid=363] ppid=352 vsize=0 CPUtime=4983.89 cores=0-7
/proc/354/task/363/stat : 363 (plingeling) R 352 354 32399 0 -1 4203588 604336 1253 0 0 498264 125 0 0 25 0 2 0 493943256 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.73
CPU time (s): 40000.5
CPU user time (s): 39989.8
CPU system time (s): 10.6464
CPU usage (%): 798.137
Max. virtual memory (cumulated for all children) (KiB): 2708816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39989.8
system time used= 10.6464
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5636366
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 263
involuntary context switches= 192615

runsolver used 7.61984 second user time and 19.627 second system time

The end

Launcher Data 

Begin job on node143 at 2011-04-28 20:27:47
IDJOB=3309930
IDBENCH=83466
IDSOLVER=1695
FILE ID=node143/3309930-1304015264
RUNJOBID= node143-1304009290-32413
PBS_JOBID= 13168850
Free space on /tmp= 72812 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00N23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309930-1304015264/watcher-3309930-1304015264 -o /tmp/evaluation-result-3309930-1304015264/solver-3309930-1304015264 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309930-1304015264.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1a1f0dddf727883e0973677dd00e9269
RANDOM SEED=332332397

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31952540 kB
Buffers:        122696 kB
Cached:         543032 kB
SwapCached:        168 kB
Active:         308424 kB
Inactive:       421144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31952540 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:          114412 kB
Writeback:           0 kB
AnonPages:       63656 kB
Mapped:          14672 kB
Slab:           201460 kB
PageTables:       4284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   183420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72812 MiB
End job on node143 at 2011-04-28 21:51:21