Trace number 3309849

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.4 5004.06

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom23.cnf
MD5SUMe560aa6505ddce6d3784f70d5b7aff66
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables57800
Number of clauses193923
Sum of the clauses size495331
Maximum clause length1803
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 298497
Number of clauses of size 394437
Number of clauses of size 4275
Number of clauses of size 521
Number of clauses of size over 5692

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309849-1304011686/watcher-3309849-1304011686 -o /tmp/evaluation-result-3309849-1304011686/solver-3309849-1304011686 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309849-1304011686.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 8.03 8.00 1/170 24633
/proc/meminfo: memFree=22161164/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=15580 CPUtime=0 cores=0-7
/proc/24633/stat : 24633 (plingeling) R 24631 24633 23873 0 -1 4202496 1742 1251 0 0 0 0 0 0 20 0 1 0 512766292 15953920 1672 33554432000 4194304 4417332 140734694706944 18446744073709551615 218905424989 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24633/statm: 3895 1685 140 55 0 1781 0

[startup+0.0169149 s]
/proc/loadavg: 8.04 8.03 8.00 1/170 24633
/proc/meminfo: memFree=22161164/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=20636 CPUtime=0.01 cores=0-7
/proc/24633/stat : 24633 (plingeling) R 24631 24633 23873 0 -1 4202496 3251 1251 0 0 1 0 0 0 20 0 1 0 512766292 21131264 3181 33554432000 4194304 4417332 140734694706944 18446744073709551615 218905730816 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24633/statm: 5159 3181 147 55 0 3045 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 20636

[startup+0.100882 s]
/proc/loadavg: 8.04 8.03 8.00 1/170 24633
/proc/meminfo: memFree=22161164/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=41472 CPUtime=0.08 cores=0-7
/proc/24633/stat : 24633 (plingeling) R 24631 24633 23873 0 -1 4202496 8477 1251 0 0 8 0 0 0 20 0 1 0 512766292 42467328 8391 33554432000 4194304 4417332 140734694706944 18446744073709551615 4259665 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24633/statm: 10368 8391 148 55 0 8254 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 41472

[startup+0.300853 s]
/proc/loadavg: 8.04 8.03 8.00 1/170 24633
/proc/meminfo: memFree=22161164/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=81276 CPUtime=0.28 cores=0-7
/proc/24633/stat : 24633 (plingeling) R 24631 24633 23873 0 -1 4202496 18436 1251 0 0 27 1 0 0 21 0 1 0 512766292 83226624 18342 33554432000 4194304 4417332 140734694706944 18446744073709551615 4231626 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24633/statm: 20319 18342 148 55 0 18205 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 81276

[startup+0.70074 s]
/proc/loadavg: 8.04 8.03 8.00 1/170 24633
/proc/meminfo: memFree=22161164/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=296320 CPUtime=2.27 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 33701 1251 0 0 223 4 0 0 18 0 9 0 512766292 303431680 24404 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 74080 24404 173 55 0 71966 0
Current children cumulated CPU time (s) 2.27
Current children cumulated vsize (KiB) 296320

[startup+1.5006 s]
/proc/loadavg: 8.04 8.03 8.00 10/179 24647
/proc/meminfo: memFree=22063268/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=299104 CPUtime=8.67 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 45099 1251 0 0 861 6 0 0 18 0 9 0 512766292 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 74776 24768 175 55 0 72662 0
[pid=24633/tid=24640] ppid=24631 vsize=299104 CPUtime=1.03 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 2211 1251 0 0 103 0 0 0 19 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4302036 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=299104 CPUtime=1.03 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 1509 1251 0 0 103 0 0 0 25 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4287304 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=299104 CPUtime=0.98 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 5641 1251 0 0 98 0 0 0 25 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4282352 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=299104 CPUtime=1 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 2282 1251 0 0 100 0 0 0 21 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=299104 CPUtime=1.03 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 3576 1251 0 0 103 0 0 0 19 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=299104 CPUtime=1.03 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 7925 1251 0 0 102 1 0 0 21 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4283143 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=299104 CPUtime=1.03 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 1643 1251 0 0 103 0 0 0 19 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4287195 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=299104 CPUtime=1.02 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 1859 1251 0 0 102 0 0 0 22 0 9 0 512766338 306282496 24768 33554432000 4194304 4417332 140734694706944 18446744073709551615 4284784 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 8.67
Current children cumulated vsize (KiB) 299104

[startup+3.1013 s]
/proc/loadavg: 8.04 8.03 8.00 9/179 24647
/proc/meminfo: memFree=22044916/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=330120 CPUtime=21.46 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 69908 1251 0 0 2136 10 0 0 18 0 9 0 512766292 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 82530 32274 179 55 0 80416 0
[pid=24633/tid=24640] ppid=24631 vsize=330120 CPUtime=2.63 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 4293 1251 0 0 262 1 0 0 22 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4346278 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=330120 CPUtime=2.63 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 4016 1251 0 0 263 0 0 0 25 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4346375 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=330120 CPUtime=2.58 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 10219 1251 0 0 257 1 0 0 25 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4256889 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=330120 CPUtime=2.6 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 2282 1251 0 0 260 0 0 0 25 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=330120 CPUtime=2.63 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 8472 1251 0 0 262 1 0 0 22 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4346407 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=330120 CPUtime=2.62 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 15435 1251 0 0 261 1 0 0 25 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4216463 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=330120 CPUtime=2.62 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 3855 1251 0 0 262 0 0 0 22 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4256889 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=330120 CPUtime=2.62 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 2883 1251 0 0 262 0 0 0 25 0 9 0 512766338 338042880 32274 33554432000 4194304 4417332 140734694706944 18446744073709551615 4346399 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 21.46
Current children cumulated vsize (KiB) 330120

[startup+6.30072 s]
/proc/loadavg: 8.04 8.03 8.00 9/179 24647
/proc/meminfo: memFree=22012096/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=332044 CPUtime=47.05 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 78801 1251 0 0 4693 12 0 0 18 0 9 0 512766292 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 83011 30964 181 55 0 80897 0
[pid=24633/tid=24640] ppid=24631 vsize=332044 CPUtime=5.83 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 5196 1251 0 0 582 1 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364512 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=332044 CPUtime=5.83 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 6702 1251 0 0 583 0 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364383 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=332044 CPUtime=5.76 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 10882 1251 0 0 575 1 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4365864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=332044 CPUtime=5.8 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 2282 1251 0 0 580 0 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4365101 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=332044 CPUtime=5.83 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 9858 1251 0 0 582 1 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=332044 CPUtime=5.83 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 16978 1251 0 0 581 2 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=332044 CPUtime=5.82 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 5049 1251 0 0 582 0 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=332044 CPUtime=5.81 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 3401 1251 0 0 581 0 0 0 25 0 9 0 512766338 340013056 30964 33554432000 4194304 4417332 140734694706944 18446744073709551615 4264953 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 47.05
Current children cumulated vsize (KiB) 332044

[startup+12.7006 s]
/proc/loadavg: 8.03 8.03 8.00 9/179 24647
/proc/meminfo: memFree=22028112/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=343576 CPUtime=98.2 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 81789 1251 0 0 9808 12 0 0 18 0 9 0 512766292 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 85894 33847 181 55 0 83780 0
[pid=24633/tid=24640] ppid=24631 vsize=343576 CPUtime=12.23 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 5750 1251 0 0 1222 1 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=343576 CPUtime=12.23 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 6718 1251 0 0 1223 0 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=343576 CPUtime=12.12 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 12382 1251 0 0 1211 1 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=343576 CPUtime=12.2 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 2830 1251 0 0 1220 0 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4365018 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=343576 CPUtime=12.23 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 9873 1251 0 0 1222 1 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4357493 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=343576 CPUtime=12.23 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 16992 1251 0 0 1221 2 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=343576 CPUtime=12.23 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 5374 1251 0 0 1222 1 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4276231 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=343576 CPUtime=12.21 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 3417 1251 0 0 1221 0 0 0 25 0 9 0 512766338 351821824 33847 33554432000 4194304 4417332 140734694706944 18446744073709551615 4354385 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 98.2
Current children cumulated vsize (KiB) 343576

[startup+25.5012 s]
/proc/loadavg: 8.02 8.03 8.00 9/179 24648
/proc/meminfo: memFree=21983984/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=387840 CPUtime=200.54 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 95121 1251 0 0 20040 14 0 0 18 0 9 0 512766292 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 96960 44925 181 55 0 94846 0
[pid=24633/tid=24640] ppid=24631 vsize=387840 CPUtime=25.03 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 8487 1251 0 0 2502 1 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=387840 CPUtime=25.03 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 8201 1251 0 0 2503 0 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=387840 CPUtime=24.86 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 13707 1251 0 0 2484 2 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4270966 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=387840 CPUtime=25.01 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 3920 1251 0 0 2501 0 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=387840 CPUtime=25.03 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 11553 1251 0 0 2501 2 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=387840 CPUtime=25.03 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 18328 1251 0 0 2501 2 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4354498 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=387840 CPUtime=25.03 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 6783 1251 0 0 2502 1 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4366038 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=387840 CPUtime=25.01 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 5689 1251 0 0 2501 0 0 0 25 0 9 0 512766338 397148160 44925 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364581 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 200.54
Current children cumulated vsize (KiB) 387840

[startup+51.1006 s]
/proc/loadavg: 8.02 8.02 8.00 9/179 24648
/proc/meminfo: memFree=21925972/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=445036 CPUtime=405.19 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 117167 1251 0 0 40502 17 0 0 18 0 9 0 512766292 455716864 59224 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 111259 59224 181 55 0 109145 0
[pid=24633/tid=24640] ppid=24631 vsize=445036 CPUtime=50.63 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 13338 1251 0 0 5061 2 0 0 25 0 9 0 512766338 455716864 59224 33554432000 4194304 4417332 140734694706944 18446744073709551615 4284943 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=445036 CPUtime=50.63 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 9384 1251 0 0 5062 1 0 0 25 0 9 0 512766338 455716864 59224 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=445036 CPUtime=50.31 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.12 8.07 8.01 9/179 24785
/proc/meminfo: memFree=19718536/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=2648952 CPUtime=37748.9 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 3840619 1251 0 0 3774256 633 0 0 18 0 9 0 512766292 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 662238 610231 181 55 0 660124 0
[pid=24633/tid=24640] ppid=24631 vsize=2648952 CPUtime=4721.94 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 263097 1251 0 0 472151 43 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=2648952 CPUtime=4721.94 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 402258 1251 0 0 472123 71 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=2648952 CPUtime=4696.17 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 457069 1251 0 0 469540 77 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=2648952 CPUtime=4721.76 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 673483 1251 0 0 472069 107 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=2648952 CPUtime=4721.94 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 709494 1251 0 0 472065 129 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=2648952 CPUtime=4721.94 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 439140 1251 0 0 472123 71 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=2648952 CPUtime=4721.82 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 462857 1251 0 0 472116 66 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4236852 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=2648952 CPUtime=4720.85 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 414768 1251 0 0 472023 62 0 0 25 0 9 0 512766338 2712526848 610231 33554432000 4194304 4417332 140734694706944 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37748.9
Current children cumulated vsize (KiB) 2648952

[startup+4782.3 s]
/proc/loadavg: 8.10 8.07 8.01 9/179 24786
/proc/meminfo: memFree=19565596/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=2801808 CPUtime=38228.5 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 3878833 1251 0 0 3822211 641 0 0 18 0 9 0 512766292 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 700452 648445 181 55 0 698338 0
[pid=24633/tid=24640] ppid=24631 vsize=2801808 CPUtime=4781.94 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 263097 1251 0 0 478151 43 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=2801808 CPUtime=4781.94 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 402258 1251 0 0 478123 71 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364951 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=2801808 CPUtime=4755.84 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 457069 1251 0 0 475507 77 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=2801808 CPUtime=4781.75 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 683046 1251 0 0 478067 108 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=2801808 CPUtime=4781.94 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 725878 1251 0 0 478060 134 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=2801808 CPUtime=4781.94 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 439140 1251 0 0 478123 71 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=2801808 CPUtime=4781.81 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 475124 1251 0 0 478112 69 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4310641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=2801808 CPUtime=4780.83 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 414768 1251 0 0 478021 62 0 0 25 0 9 0 512766338 2869051392 648445 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38228.5
Current children cumulated vsize (KiB) 2801808

[startup+4842.3 s]
/proc/loadavg: 8.09 8.07 8.01 9/179 24788
/proc/meminfo: memFree=19172616/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=3194544 CPUtime=38708.2 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 4010699 1251 0 0 3870150 669 0 0 18 0 9 0 512766292 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 798636 746539 181 55 0 796522 0
[pid=24633/tid=24640] ppid=24631 vsize=3194544 CPUtime=4841.94 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 295437 1251 0 0 484145 49 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=3194544 CPUtime=4841.94 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 418642 1251 0 0 484118 76 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=3194544 CPUtime=4815.51 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 457069 1251 0 0 481474 77 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=3194544 CPUtime=4841.76 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 710582 1251 0 0 484059 117 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=3194544 CPUtime=4841.93 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 730197 1251 0 0 484059 134 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=3194544 CPUtime=4841.94 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 449125 1251 0 0 484122 72 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=3194544 CPUtime=4841.81 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 492518 1251 0 0 484108 73 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=3194544 CPUtime=4840.83 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 438676 1251 0 0 484018 65 0 0 25 0 9 0 512766338 3271213056 746539 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38708.2
Current children cumulated vsize (KiB) 3194544

[startup+4902.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/179 24790
/proc/meminfo: memFree=19098316/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=3268172 CPUtime=39187.9 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 4052284 1251 0 0 3918110 678 0 0 18 0 9 0 512766292 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 817043 764995 181 55 0 814929 0
[pid=24633/tid=24640] ppid=24631 vsize=3268172 CPUtime=4901.94 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 303629 1251 0 0 490143 51 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4263067 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=3268172 CPUtime=4901.94 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 418642 1251 0 0 490118 76 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=3268172 CPUtime=4875.19 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 457069 1251 0 0 487442 77 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=3268172 CPUtime=4901.76 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 720954 1251 0 0 490057 119 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=3268172 CPUtime=4901.93 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 730197 1251 0 0 490059 134 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=3268172 CPUtime=4901.94 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 462441 1251 0 0 490120 74 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=3268172 CPUtime=4901.8 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 495752 1251 0 0 490107 73 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=3268172 CPUtime=4900.83 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 445147 1251 0 0 490016 67 0 0 25 0 9 0 512766338 3346608128 764995 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39187.9
Current children cumulated vsize (KiB) 3268172

[startup+4962.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/179 24791
/proc/meminfo: memFree=19173808/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=3192416 CPUtime=39667.6 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 4070915 1251 0 0 3966072 683 0 0 18 0 9 0 512766292 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 798104 746056 181 55 0 795990 0
[pid=24633/tid=24640] ppid=24631 vsize=3192416 CPUtime=4961.94 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 303629 1251 0 0 496143 51 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=3192416 CPUtime=4961.94 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 418642 1251 0 0 496118 76 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=3192416 CPUtime=4934.86 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 457069 1251 0 0 493409 77 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4353929 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=3192416 CPUtime=4961.76 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 731825 1251 0 0 496054 122 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=3192416 CPUtime=4961.94 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 730197 1251 0 0 496060 134 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=3192416 CPUtime=4961.94 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 464554 1251 0 0 496120 74 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=3192416 CPUtime=4961.81 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 501385 1251 0 0 496106 75 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=3192416 CPUtime=4960.82 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 445161 1251 0 0 496015 67 0 0 25 0 9 0 512766338 3269033984 746056 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39667.5
Current children cumulated vsize (KiB) 3192416



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.91 s]
/proc/loadavg: 8.00 8.03 8.00 9/179 24792
/proc/meminfo: memFree=19033048/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=3331972 CPUtime=40000.2 cores=0-7
/proc/24633/stat : 24633 (plingeling) S 24631 24633 23873 0 -1 4202496 4122202 1251 0 0 3999327 695 0 0 18 0 9 0 512766292 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 832993 780958 181 55 0 830879 0
[pid=24633/tid=24640] ppid=24631 vsize=3331972 CPUtime=5003.56 cores=0-7
/proc/24633/task/24640/stat : 24640 (plingeling) R 24631 24633 23873 0 -1 4202560 317917 1251 0 0 500303 53 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24633/tid=24641] ppid=24631 vsize=3331972 CPUtime=5003.55 cores=0-7
/proc/24633/task/24641/stat : 24641 (plingeling) R 24631 24633 23873 0 -1 4202560 418656 1251 0 0 500279 76 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=3331972 CPUtime=4976.25 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4202560 473453 1251 0 0 497543 82 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24633/tid=24643] ppid=24631 vsize=3331972 CPUtime=5003.37 cores=0-7
/proc/24633/task/24643/stat : 24643 (plingeling) R 24631 24633 23873 0 -1 4202560 736029 1251 0 0 500215 122 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24633/tid=24644] ppid=24631 vsize=3331972 CPUtime=5003.55 cores=0-7
/proc/24633/task/24644/stat : 24644 (plingeling) R 24631 24633 23873 0 -1 4202560 730197 1251 0 0 500221 134 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24633/tid=24645] ppid=24631 vsize=3331972 CPUtime=5003.56 cores=0-7
/proc/24633/task/24645/stat : 24645 (plingeling) R 24631 24633 23873 0 -1 4202560 480938 1251 0 0 500276 80 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24633/tid=24646] ppid=24631 vsize=3331972 CPUtime=5003.42 cores=0-7
/proc/24633/task/24646/stat : 24646 (plingeling) R 24631 24633 23873 0 -1 4202560 501385 1251 0 0 500267 75 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24633/tid=24647] ppid=24631 vsize=3331972 CPUtime=5002.43 cores=0-7
/proc/24633/task/24647/stat : 24647 (plingeling) R 24631 24633 23873 0 -1 4202560 445174 1251 0 0 500176 67 0 0 25 0 9 0 512766338 3411939328 780958 33554432000 4194304 4417332 140734694706944 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 3331972

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5004.01 s]
/proc/loadavg: 8.00 8.03 8.00 9/179 24792
/proc/meminfo: memFree=19033048/32951124 swapFree=67111412/67111528
[pid=24633] ppid=24631 vsize=0 CPUtime=40000.4 cores=0-7
/proc/24633/stat : 24633 (plingeling) Z 24631 24633 23873 0 -1 4203548 4122202 1251 0 0 3999331 705 0 0 18 0 2 0 512766292 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 6 0 0 0
/proc/24633/statm: 0 0 0 0 0 0 0
[pid=24633/tid=24642] ppid=24631 vsize=0 CPUtime=4976.34 cores=0-7
/proc/24633/task/24642/stat : 24642 (plingeling) R 24631 24633 23873 0 -1 4203588 473453 1251 0 0 497543 91 0 0 25 0 2 0 512766338 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5004.06
CPU time (s): 40000.4
CPU user time (s): 39993.3
CPU system time (s): 7.10492
CPU usage (%): 799.359
Max. virtual memory (cumulated for all children) (KiB): 3360128

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.3
system time used= 7.10492
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4123453
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 671
involuntary context switches= 193498

runsolver used 8.08677 second user time and 19.1891 second system time

The end

Launcher Data 

Begin job on node137 at 2011-04-28 19:28:06
IDJOB=3309849
IDBENCH=83137
IDSOLVER=1695
FILE ID=node137/3309849-1304011686
RUNJOBID= node137-1304003266-23887
PBS_JOBID= 13168803
Free space on /tmp= 71616 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309849-1304011686/watcher-3309849-1304011686 -o /tmp/evaluation-result-3309849-1304011686/solver-3309849-1304011686 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309849-1304011686.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e560aa6505ddce6d3784f70d5b7aff66
RANDOM SEED=796085598

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22161320 kB
Buffers:       1784000 kB
Cached:        8383372 kB
SwapCached:        112 kB
Active:        4234504 kB
Inactive:      5998412 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22161320 kB
SwapTotal:    67111528 kB
SwapFree:     67111412 kB
Dirty:            3536 kB
Writeback:           0 kB
AnonPages:       65644 kB
Mapped:          14700 kB
Slab:           490316 kB
PageTables:       4640 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186768 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71616 MiB
End job on node137 at 2011-04-28 20:51:32