Trace number 3371263

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.45 1209.22

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUMce0d180356398dfbcfd2bbbb1cb3f9e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark375.866
Satisfiable
(Un)Satisfiability was proved
Number of variables1260306
Number of clauses6771840
Sum of the clauses size16095280
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 26714640
Number of clauses of size 3320
Number of clauses of size 41280
Number of clauses of size 53200
Number of clauses of size over 551680

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371263-1305420971/watcher-3371263-1305420971 -o /tmp/evaluation-result-3371263-1305420971/solver-3371263-1305420971 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371263-1305420971.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.68 8.03 7.93 2/363 7073
/proc/meminfo: memFree=17966660/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=18576 CPUtime=0 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 1988 1253 0 0 0 0 0 0 22 0 1 0 732328187 19021824 1919 33554432000 4194304 4417452 140735734635456 18446744073709551615 224284619869 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 4644 1932 139 55 0 2530 0

[startup+0.063054 s]
/proc/loadavg: 7.68 8.03 7.93 2/363 7073
/proc/meminfo: memFree=17966660/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=30772 CPUtime=0.05 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 5786 1253 0 0 5 0 0 0 22 0 1 0 732328187 31510528 5716 33554432000 4194304 4417452 140735734635456 18446744073709551615 224284925696 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 7693 5716 148 55 0 5579 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 30772

[startup+0.101045 s]
/proc/loadavg: 7.68 8.03 7.93 2/363 7073
/proc/meminfo: memFree=17966660/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=36228 CPUtime=0.09 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 7156 1253 0 0 9 0 0 0 22 0 1 0 732328187 37097472 7081 33554432000 4194304 4417452 140735734635456 18446744073709551615 4231387 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 9057 7081 149 55 0 6943 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 36228

[startup+0.301014 s]
/proc/loadavg: 7.68 8.03 7.93 2/363 7073
/proc/meminfo: memFree=17966660/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=68896 CPUtime=0.29 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 15323 1253 0 0 28 1 0 0 23 0 1 0 732328187 70549504 15248 33554432000 4194304 4417452 140735734635456 18446744073709551615 224284544574 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 17224 15248 149 55 0 15110 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 68896

[startup+0.700947 s]
/proc/loadavg: 7.68 8.03 7.93 2/363 7073
/proc/meminfo: memFree=17966660/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=126628 CPUtime=0.69 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 29793 1253 0 0 66 3 0 0 25 0 1 0 732328187 129667072 29681 33554432000 4194304 4417452 140735734635456 18446744073709551615 4260005 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 31657 29681 149 55 0 29543 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 126628

[startup+1.50081 s]
/proc/loadavg: 7.68 8.03 7.93 3/364 7079
/proc/meminfo: memFree=17793948/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=257640 CPUtime=1.49 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 62691 1253 0 0 142 7 0 0 25 0 1 0 732328187 263823360 62434 33554432000 4194304 4417452 140735734635456 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 64410 62434 149 55 0 62296 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 257640

[startup+3.10056 s]
/proc/loadavg: 7.68 8.03 7.93 3/364 7079
/proc/meminfo: memFree=17569888/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=480872 CPUtime=3.09 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 118499 1253 0 0 295 14 0 0 25 0 1 0 732328187 492412928 118242 33554432000 4194304 4417452 140735734635456 18446744073709551615 224284925696 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 120218 118242 149 55 0 118104 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 480872

[startup+6.30101 s]
/proc/loadavg: 7.30 7.95 7.90 3/367 7090
/proc/meminfo: memFree=17039268/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=927336 CPUtime=6.29 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) R 7071 7073 6932 0 -1 4202496 230115 1253 0 0 601 28 0 0 25 0 1 0 732328187 949592064 229858 33554432000 4194304 4417452 140735734635456 18446744073709551615 4264916 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7073/statm: 231834 229858 149 55 0 229720 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 927336

[startup+12.7009 s]
/proc/loadavg: 7.44 7.97 7.91 6/371 7094
/proc/meminfo: memFree=15923892/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=1242276 CPUtime=28.9 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 485353 1253 0 0 2823 67 0 0 25 0 5 0 732328187 1272090624 290510 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 310569 290510 176 55 0 308455 0
[pid=7073/tid=7091] ppid=7071 vsize=1242276 CPUtime=5.42 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 34663 1253 0 0 536 6 0 0 25 0 5 0 732328913 1272090624 290510 33554432000 4194304 4417452 140735734635456 18446744073709551615 4268074 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=1242276 CPUtime=5.4 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 34589 1253 0 0 532 8 0 0 25 0 5 0 732328913 1272090624 290510 33554432000 4194304 4417452 140735734635456 18446744073709551615 4265937 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=1242276 CPUtime=5.42 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 82707 1253 0 0 530 12 0 0 25 0 5 0 732328913 1272090624 290510 33554432000 4194304 4417452 140735734635456 18446744073709551615 4255662 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=1242276 CPUtime=5.37 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 29539 1253 0 0 532 5 0 0 25 0 5 0 732328913 1272090624 290510 33554432000 4194304 4417452 140735734635456 18446744073709551615 4356852 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 28.9
Current children cumulated vsize (KiB) 1242276

[startup+25.5008 s]
/proc/loadavg: 7.36 7.92 7.89 9/375 7098
/proc/meminfo: memFree=15392668/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=1248484 CPUtime=79.92 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 843401 1253 0 0 7873 119 0 0 25 0 5 0 732328187 1278447616 291168 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 312121 291168 178 55 0 310007 0
[pid=7073/tid=7091] ppid=7071 vsize=1248484 CPUtime=18.22 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 192529 1253 0 0 1792 30 0 0 25 0 5 0 732328913 1278447616 291168 33554432000 4194304 4417452 140735734635456 18446744073709551615 4254468 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=1248484 CPUtime=18.18 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 164166 1253 0 0 1792 26 0 0 25 0 5 0 732328913 1278447616 291168 33554432000 4194304 4417452 140735734635456 18446744073709551615 4254855 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=1248484 CPUtime=18.22 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 147698 1253 0 0 1801 21 0 0 25 0 5 0 732328913 1278447616 291168 33554432000 4194304 4417452 140735734635456 18446744073709551615 4254429 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=1248484 CPUtime=18.01 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 35153 1253 0 0 1796 5 0 0 25 0 5 0 732328913 1278447616 291168 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 79.92
Current children cumulated vsize (KiB) 1248484

[startup+51.1135 s]
/proc/loadavg: 6.68 7.72 7.83 9/375 7136
/proc/meminfo: memFree=16628388/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=1437836 CPUtime=182.06 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 906093 1253 0 0 18080 126 0 0 25 0 5 0 732328187 1472344064 338519 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 359459 338519 179 55 0 357345 0
[pid=7073/tid=7091] ppid=7071 vsize=1437836 CPUtime=43.83 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 194776 1253 0 0 4353 30 0 0 25 0 5 0 732328913 1472344064 338519 33554432000 4194304 4417452 140735734635456 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=1437836 CPUtime=43.8 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 166413 1253 0 0 4353 27 0 0 25 0 5 0 732328913 1472344064 338519 33554432000 4194304 4417452 140735734635456 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=1437836 CPUtime=43.83 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 172100 1253 0 0 4360 23 0 0 25 0 5 0 732328913 1472344064 338519 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=1437836 CPUtime=43.31 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 68949 1253 0 0 4323 8 0 0 25 0 5 0 732328913 1472344064 338519 33554432000 4194304 4417452 140735734635456 18446744073709551615 4250938 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 182.06
Current children cumulated vsize (KiB) 1437836

[startup+102.301 s]
/proc/loadavg: 7.42 7.76 7.83 9/375 7136
/proc/meminfo: memFree=16475428/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=1497872 CPUtime=386.16 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 1005689 1253 0 0 38478 138 0 0 25 0 5 0 732328187 1533820928 346602 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 374468 346602 179 55 0 372354 0
[pid=7073/tid=7091] ppid=7071 vsize=1497872 CPUtime=95.01 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 198616 1253 0 0 9470 31 0 0 25 0 5 0 732328913 1533820928 346602 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=1497872 CPUtime=94.94 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 170253 1253 0 0 9467 27 0 0 25 0 5 0 732328913 1533820928 346602 33554432000 4194304 4417452 140735734635456 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=1497872 CPUtime=95.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 177857 1253 0 0 9477 24 0 0 25 0 5 0 732328913 1533820928 346602 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232584 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=1497872 CPUtime=93.91 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 155108 1253 0 0 9372 19 0 0 25 0 5 0 732328913 1533820928 346602 33554432000 4194304 4417452 140735734635456 18446744073709551615 4355830 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 386.16
Current children cumulated vsize (KiB) 1497872

[startup+162.301 s]
/proc/loadavg: 7.90 7.83 7.85 9/375 7138
/proc/meminfo: memFree=16011972/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=1877744 CPUtime=625.45 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 1210008 1253 0 0 62381 164 0 0 25 0 5 0 732328187 1922809856 440848 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 469436 440848 179 55 0 467322 0
[pid=7073/tid=7091] ppid=7071 vsize=1877744 CPUtime=155.01 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 243620 1253 0 0 15465 36 0 0 25 0 5 0 732328913 1922809856 440848 33554432000 4194304 4417452 140735734635456 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=1877744 CPUtime=154.94 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 203764 1253 0 0 15462 32 0 0 25 0 5 0 732328913 1922809856 440848 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=1877744 CPUtime=155.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 219920 1253 0 0 15471 30 0 0 25 0 5 0 732328913 1922809856 440848 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=1877744 CPUtime=153.19 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 238849 1253 0 0 15290 29 0 0 25 0 5 0 732328913 1922809856 440848 33554432000 4194304 4417452 140735734635456 18446744073709551615 4236961 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 625.45
Current children cumulated vsize (KiB) 1877744

[startup+222.301 s]
/proc/loadavg: 7.96 7.86 7.85 9/375 7140
/proc/meminfo: memFree=16123408/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=1697380 CPUtime=864.74 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 1278555 1253 0 0 86301 173 0 0 25 0 5 0 732328187 1738117120 395721 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 424345 395721 180 55 0 422231 0
[pid=7073/tid=7091] ppid=7071 vsize=1697380 CPUtime=215.01 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 243621 1253 0 0 21465 36 0 0 25 0 5 0 732328913 1738117120 395721 33554432000 4194304 4417452 140735734635456 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=1697380 CPUtime=214.94 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 203764 1253 0 0 21462 32 0 0 25 0 5 0 732328913 1738117120 395721 33554432000 4194304 4417452 140735734635456 18446744073709551615 4254855 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=1697380 CPUtime=215.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 219945 1253 0 0 21471 30 0 0 25 0 5 0 732328913 1738117120 395721 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=1697380 CPUtime=212.49 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 307370 1253 0 0 21210 39 0 0 25 0 5 0 732328913 1738117120 395721 33554432000 4194304 4417452 140735734635456 18446744073709551615 4281857 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 864.74
Current children cumulated vsize (KiB) 1697380

[startup+282.301 s]
/proc/loadavg: 8.08 7.91 7.87 9/375 7142
/proc/meminfo: memFree=16026652/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=1733956 CPUtime=1104.02 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 1357643 1253 0 0 110220 182 0 0 25 0 5 0 732328187 1775570944 404868 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 433489 404868 180 55 0 431375 0
[pid=7073/tid=7091] ppid=7071 vsize=1733956 CPUtime=275.01 cores=1,3,5,7

################
# More data... #
################

[pid=7073/tid=7092] ppid=7071 vsize=1926580 CPUtime=694.94 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 284343 1253 0 0 69450 44 0 0 25 0 5 0 732328913 1972817920 453010 33554432000 4194304 4417452 140735734635456 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=1926580 CPUtime=695.02 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 264606 1253 0 0 69467 35 0 0 25 0 5 0 732328913 1972817920 453010 33554432000 4194304 4417452 140735734635456 18446744073709551615 4365612 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=1926580 CPUtime=686.81 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 883404 1253 0 0 68563 118 0 0 25 0 5 0 732328913 1972817920 453010 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2779.1
Current children cumulated vsize (KiB) 1926580

[startup+762.301 s]
/proc/loadavg: 8.10 8.10 7.97 9/375 7163
/proc/meminfo: memFree=14694120/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2312292 CPUtime=3018.35 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2145871 1253 0 0 301543 292 0 0 25 0 5 0 732328187 2367787008 549355 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 578073 549355 180 55 0 575959 0
[pid=7073/tid=7091] ppid=7071 vsize=2312292 CPUtime=755.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 313330 1253 0 0 75455 47 0 0 25 0 5 0 732328913 2367787008 549355 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2312292 CPUtime=754.93 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 284369 1253 0 0 75449 44 0 0 25 0 5 0 732328913 2367787008 549355 33554432000 4194304 4417452 140735734635456 18446744073709551615 4320859 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2312292 CPUtime=755.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 291768 1253 0 0 75463 38 0 0 25 0 5 0 732328913 2367787008 549355 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2312292 CPUtime=746.1 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 952549 1253 0 0 74484 126 0 0 25 0 5 0 732328913 2367787008 549355 33554432000 4194304 4417452 140735734635456 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3018.35
Current children cumulated vsize (KiB) 2312292

[startup+822.301 s]
/proc/loadavg: 8.12 8.11 7.98 9/375 7165
/proc/meminfo: memFree=15146564/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2305048 CPUtime=3257.64 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2231551 1253 0 0 325459 305 0 0 25 0 5 0 732328187 2360369152 547595 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 576262 547595 180 55 0 574148 0
[pid=7073/tid=7091] ppid=7071 vsize=2305048 CPUtime=815.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 313330 1253 0 0 81455 47 0 0 25 0 5 0 732328913 2360369152 547595 33554432000 4194304 4417452 140735734635456 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2305048 CPUtime=814.93 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 284369 1253 0 0 81449 44 0 0 25 0 5 0 732328913 2360369152 547595 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364453 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2305048 CPUtime=815.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 291788 1253 0 0 81463 38 0 0 25 0 5 0 732328913 2360369152 547595 33554432000 4194304 4417452 140735734635456 18446744073709551615 4331822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2305048 CPUtime=805.39 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1038209 1253 0 0 80400 139 0 0 25 0 5 0 732328913 2360369152 547595 33554432000 4194304 4417452 140735734635456 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3257.64
Current children cumulated vsize (KiB) 2305048

[startup+882.301 s]
/proc/loadavg: 8.15 8.11 7.99 9/375 7167
/proc/meminfo: memFree=14951464/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2422712 CPUtime=3496.94 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2416624 1253 0 0 349361 333 0 0 25 0 5 0 732328187 2480857088 576973 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 605678 576973 180 55 0 603564 0
[pid=7073/tid=7091] ppid=7071 vsize=2422712 CPUtime=875.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 352594 1253 0 0 87450 52 0 0 25 0 5 0 732328913 2480857088 576973 33554432000 4194304 4417452 140735734635456 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2422712 CPUtime=874.93 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 284420 1253 0 0 87449 44 0 0 25 0 5 0 732328913 2480857088 576973 33554432000 4194304 4417452 140735734635456 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2422712 CPUtime=875.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 354128 1253 0 0 87455 46 0 0 25 0 5 0 732328913 2480857088 576973 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2422712 CPUtime=864.68 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1121627 1253 0 0 86314 154 0 0 25 0 5 0 732328913 2480857088 576973 33554432000 4194304 4417452 140735734635456 18446744073709551615 4354515 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3496.94
Current children cumulated vsize (KiB) 2422712

[startup+942.301 s]
/proc/loadavg: 8.24 8.14 8.01 9/375 7169
/proc/meminfo: memFree=14681856/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2433748 CPUtime=3736.22 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2474160 1253 0 0 373279 343 0 0 25 0 5 0 732328187 2492157952 579732 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 608437 579732 180 55 0 606323 0
[pid=7073/tid=7091] ppid=7071 vsize=2433748 CPUtime=935.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 354442 1253 0 0 93450 52 0 0 25 0 5 0 732328913 2492157952 579732 33554432000 4194304 4417452 140735734635456 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2433748 CPUtime=934.93 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 284420 1253 0 0 93449 44 0 0 25 0 5 0 732328913 2492157952 579732 33554432000 4194304 4417452 140735734635456 18446744073709551615 4250006 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2433748 CPUtime=935.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 359998 1253 0 0 93453 48 0 0 25 0 5 0 732328913 2492157952 579732 33554432000 4194304 4417452 140735734635456 18446744073709551615 4236564 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2433748 CPUtime=923.97 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1171445 1253 0 0 92235 162 0 0 25 0 5 0 732328913 2492157952 579732 33554432000 4194304 4417452 140735734635456 18446744073709551615 4264994 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3736.22
Current children cumulated vsize (KiB) 2433748

[startup+1002.3 s]
/proc/loadavg: 8.09 8.11 8.00 9/375 7169
/proc/meminfo: memFree=14645968/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2347932 CPUtime=3975.53 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2560578 1253 0 0 397197 356 0 0 25 0 5 0 732328187 2404282368 558316 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 586983 558316 180 55 0 584869 0
[pid=7073/tid=7091] ppid=7071 vsize=2347932 CPUtime=995.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 361369 1253 0 0 99449 53 0 0 25 0 5 0 732328913 2404282368 558316 33554432000 4194304 4417452 140735734635456 18446744073709551615 4281855 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2347932 CPUtime=994.93 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 284420 1253 0 0 99449 44 0 0 25 0 5 0 732328913 2404282368 558316 33554432000 4194304 4417452 140735734635456 18446744073709551615 4236613 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2347932 CPUtime=995.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 400937 1253 0 0 99446 55 0 0 25 0 5 0 732328913 2404282368 558316 33554432000 4194304 4417452 140735734635456 18446744073709551615 4356852 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2347932 CPUtime=983.26 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1209997 1253 0 0 98160 166 0 0 25 0 5 0 732328913 2404282368 558316 33554432000 4194304 4417452 140735734635456 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3975.53
Current children cumulated vsize (KiB) 2347932

[startup+1062.3 s]
/proc/loadavg: 8.06 8.10 8.00 9/375 7171
/proc/meminfo: memFree=14198052/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2498744 CPUtime=4214.8 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2684485 1253 0 0 421107 373 0 0 25 0 5 0 732328187 2558713856 596058 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 624686 596058 180 55 0 622572 0
[pid=7073/tid=7091] ppid=7071 vsize=2498744 CPUtime=1055.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 400577 1253 0 0 105444 58 0 0 25 0 5 0 732328913 2558713856 596058 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232829 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2498744 CPUtime=1054.92 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 317795 1253 0 0 105444 48 0 0 25 0 5 0 732328913 2558713856 596058 33554432000 4194304 4417452 140735734635456 18446744073709551615 4251012 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2498744 CPUtime=1055.01 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 406377 1253 0 0 105445 56 0 0 25 0 5 0 732328913 2558713856 596058 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232580 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2498744 CPUtime=1042.56 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1255881 1253 0 0 104082 174 0 0 25 0 5 0 732328913 2558713856 596058 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4214.8
Current children cumulated vsize (KiB) 2498744

[startup+1122.3 s]
/proc/loadavg: 8.13 8.11 8.01 10/375 7173
/proc/meminfo: memFree=13283252/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=3412356 CPUtime=4454.1 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2912888 1253 0 0 445004 406 0 0 25 0 5 0 732328187 3494252544 824461 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 853089 824461 180 55 0 850975 0
[pid=7073/tid=7091] ppid=7071 vsize=3412356 CPUtime=1115.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 475169 1253 0 0 111435 67 0 0 25 0 5 0 732328913 3494252544 824461 33554432000 4194304 4417452 140735734635456 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=3412356 CPUtime=1114.92 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 317795 1253 0 0 111444 48 0 0 25 0 5 0 732328913 3494252544 824461 33554432000 4194304 4417452 140735734635456 18446744073709551615 4236603 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=3412356 CPUtime=1115.02 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 469749 1253 0 0 111437 65 0 0 25 0 5 0 732328913 3494252544 824461 33554432000 4194304 4417452 140735734635456 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=3412356 CPUtime=1101.85 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1346320 1253 0 0 109996 189 0 0 25 0 5 0 732328913 3494252544 824461 33554432000 4194304 4417452 140735734635456 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4454.1
Current children cumulated vsize (KiB) 3412356

[startup+1182.3 s]
/proc/loadavg: 8.12 8.11 8.01 9/375 7175
/proc/meminfo: memFree=14324820/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2372792 CPUtime=4693.39 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 2983737 1253 0 0 468920 419 0 0 25 0 5 0 732328187 2429739008 564570 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 593198 564570 180 55 0 591084 0
[pid=7073/tid=7091] ppid=7071 vsize=2372792 CPUtime=1175.02 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 491534 1253 0 0 117432 70 0 0 25 0 5 0 732328913 2429739008 564570 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2372792 CPUtime=1174.92 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 317795 1253 0 0 117444 48 0 0 25 0 5 0 732328913 2429739008 564570 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2372792 CPUtime=1175.02 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 489190 1253 0 0 117433 69 0 0 25 0 5 0 732328913 2429739008 564570 33554432000 4194304 4417452 140735734635456 18446744073709551615 4358082 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2372792 CPUtime=1161.14 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1381363 1253 0 0 115919 195 0 0 25 0 5 0 732328913 2429739008 564570 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4693.39
Current children cumulated vsize (KiB) 2372792



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1209.1 s]
/proc/loadavg: 8.07 8.09 8.00 9/375 7175
/proc/meminfo: memFree=14710564/32951124 swapFree=45193364/67111528
[pid=7073] ppid=7071 vsize=2666748 CPUtime=4800.3 cores=1,3,5,7
/proc/7073/stat : 7073 (plingeling) S 7071 7073 6932 0 -1 4202496 3057226 1253 0 0 479603 427 0 0 25 0 5 0 732328187 2730749952 638059 33554432000 4194304 4417452 140735734635456 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7073/statm: 666687 638059 180 55 0 664573 0
[pid=7073/tid=7091] ppid=7071 vsize=2666748 CPUtime=1201.84 cores=1,3,5,7
/proc/7073/task/7091/stat : 7091 (plingeling) R 7071 7073 6932 0 -1 4202560 514644 1253 0 0 120111 73 0 0 25 0 5 0 732328913 2730749952 638059 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7073/tid=7092] ppid=7071 vsize=2666748 CPUtime=1201.74 cores=1,3,5,7
/proc/7073/task/7092/stat : 7092 (plingeling) R 7071 7073 6932 0 -1 4202560 317795 1253 0 0 120126 48 0 0 25 0 5 0 732328913 2730749952 638059 33554432000 4194304 4417452 140735734635456 18446744073709551615 4357970 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7073/tid=7093] ppid=7071 vsize=2666748 CPUtime=1201.83 cores=1,3,5,7
/proc/7073/task/7093/stat : 7093 (plingeling) R 7071 7073 6932 0 -1 4202560 497238 1253 0 0 120113 70 0 0 25 0 5 0 732328913 2730749952 638059 33554432000 4194304 4417452 140735734635456 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7073/tid=7094] ppid=7071 vsize=2666748 CPUtime=1187.62 cores=1,3,5,7
/proc/7073/task/7094/stat : 7094 (plingeling) R 7071 7073 6932 0 -1 4202560 1423694 1253 0 0 118563 199 0 0 25 0 5 0 732328913 2730749952 638059 33554432000 4194304 4417452 140735734635456 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 2666748

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1209.22
CPU time (s): 4800.45
CPU user time (s): 4796.08
CPU system time (s): 4.37433
CPU usage (%): 396.988
Max. virtual memory (cumulated for all children) (KiB): 3468596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.08
system time used= 4.37434
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3058479
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 168
involuntary context switches= 33321

runsolver used 3.90941 second user time and 10.3874 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-15 02:56:15
IDJOB=3371263
IDBENCH=82374
IDSOLVER=1848
FILE ID=node118/3371263-1305420971
RUNJOBID= node118-1305419765-6951
PBS_JOBID= 13324586
Free space on /tmp= 72776 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371263-1305420971/watcher-3371263-1305420971 -o /tmp/evaluation-result-3371263-1305420971/solver-3371263-1305420971 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371263-1305420971.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ce0d180356398dfbcfd2bbbb1cb3f9e5
RANDOM SEED=1585618688

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17967196 kB
Buffers:        280344 kB
Cached:        4690424 kB
SwapCached:      22084 kB
Active:       11935720 kB
Inactive:      2733880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17967196 kB
SwapTotal:    67111528 kB
SwapFree:     45193364 kB
Dirty:          280992 kB
Writeback:           0 kB
AnonPages:     9689512 kB
Mapped:          14668 kB
Slab:           159952 kB
PageTables:      89864 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 88633716 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72896 MiB
End job on node118 at 2011-05-15 03:16:26