Trace number 3371260

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.4 1204.66

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf
MD5SUMe44b288003a3eaf34673a2c0fb8c6f3e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1226.02
Satisfiable
(Un)Satisfiability was proved
Number of variables131484
Number of clauses2120376
Sum of the clauses size4841016
Maximum clause length78
Minimum clause length1
Number of clauses of size 1696
Number of clauses of size 22046240
Number of clauses of size 35760
Number of clauses of size 426640
Number of clauses of size 511520
Number of clauses of size over 529520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371260-1305420821/watcher-3371260-1305420821 -o /tmp/evaluation-result-3371260-1305420821/solver-3371260-1305420821 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371260-1305420821.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.15 8.11 8.01 2/321 25682
/proc/meminfo: memFree=25188020/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=11916 CPUtime=0 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) R 25680 25682 25544 0 -1 4202496 1040 1253 0 0 0 0 0 0 23 0 1 0 653682700 12201984 969 33554432000 4194304 4417452 140734643180832 18446744073709551615 244446945024 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25682/statm: 2979 969 147 55 0 865 0

[startup+0.028723 s]
/proc/loadavg: 8.15 8.11 8.01 2/321 25682
/proc/meminfo: memFree=25188020/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=13484 CPUtime=0.02 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) R 25680 25682 25544 0 -1 4202496 1466 1253 0 0 2 0 0 0 23 0 1 0 653682700 13807616 1395 33554432000 4194304 4417452 140734643180832 18446744073709551615 244446563909 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25682/statm: 3371 1395 149 55 0 1257 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13484

[startup+0.100737 s]
/proc/loadavg: 8.15 8.11 8.01 2/321 25682
/proc/meminfo: memFree=25188020/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=16716 CPUtime=0.09 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) R 25680 25682 25544 0 -1 4202496 2270 1253 0 0 9 0 0 0 23 0 1 0 653682700 17117184 2187 33554432000 4194304 4417452 140734643180832 18446744073709551615 4227912 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25682/statm: 4179 2187 149 55 0 2065 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 16716

[startup+0.300697 s]
/proc/loadavg: 8.15 8.11 8.01 2/321 25682
/proc/meminfo: memFree=25188020/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=41460 CPUtime=0.29 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) R 25680 25682 25544 0 -1 4202496 8480 1253 0 0 28 1 0 0 25 0 1 0 653682700 42455040 8389 33554432000 4194304 4417452 140734643180832 18446744073709551615 244446945024 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25682/statm: 10365 8389 149 55 0 8251 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 41460

[startup+0.70063 s]
/proc/loadavg: 8.15 8.11 8.01 2/321 25682
/proc/meminfo: memFree=25188020/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=69108 CPUtime=0.69 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) R 25680 25682 25544 0 -1 4202496 15392 1253 0 0 66 3 0 0 25 0 1 0 653682700 70766592 15301 33554432000 4194304 4417452 140734643180832 18446744073709551615 244446945024 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25682/statm: 17277 15301 149 55 0 15163 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 69108

[startup+1.50049 s]
/proc/loadavg: 8.15 8.11 8.01 3/322 25688
/proc/meminfo: memFree=25028924/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=198392 CPUtime=1.48 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) R 25680 25682 25544 0 -1 4202496 47713 1253 0 0 141 7 0 0 25 0 1 0 653682700 203153408 47622 33554432000 4194304 4417452 140734643180832 18446744073709551615 4227882 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25682/statm: 49598 47622 149 55 0 47484 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 198392

[startup+3.10112 s]
/proc/loadavg: 7.65 8.01 7.97 6/329 25703
/proc/meminfo: memFree=24878364/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=245828 CPUtime=7.14 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 72621 1253 0 0 701 13 0 0 25 0 5 0 653682700 251727872 49271 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 61457 49271 175 55 0 59343 0
[pid=25682/tid=25689] ppid=25680 vsize=245828 CPUtime=1.35 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 4204 1253 0 0 135 0 0 0 25 0 5 0 653682874 251727872 49271 33554432000 4194304 4417452 140734643180832 18446744073709551615 4275748 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=245828 CPUtime=1.35 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 4911 1253 0 0 135 0 0 0 25 0 5 0 653682874 251727872 49271 33554432000 4194304 4417452 140734643180832 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=245828 CPUtime=1.34 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 4362 1253 0 0 132 2 0 0 25 0 5 0 653682874 251727872 49271 33554432000 4194304 4417452 140734643180832 18446744073709551615 4270905 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=245828 CPUtime=1.34 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 2073 1253 0 0 134 0 0 0 25 0 5 0 653682874 251727872 49271 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364399 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7.14
Current children cumulated vsize (KiB) 245828

[startup+6.30052 s]
/proc/loadavg: 7.65 8.01 7.97 6/329 25703
/proc/meminfo: memFree=24445076/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=257560 CPUtime=19.89 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 99639 1253 0 0 1973 16 0 0 25 0 5 0 653682700 263741440 52183 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 64390 52183 180 55 0 62276 0
[pid=25682/tid=25689] ppid=25680 vsize=257560 CPUtime=4.55 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 14466 1253 0 0 453 2 0 0 25 0 5 0 653682874 263741440 52183 33554432000 4194304 4417452 140734643180832 18446744073709551615 4248952 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=257560 CPUtime=4.54 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 11779 1253 0 0 454 0 0 0 25 0 5 0 653682874 263741440 52183 33554432000 4194304 4417452 140734643180832 18446744073709551615 4253925 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=257560 CPUtime=4.54 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 13578 1253 0 0 450 4 0 0 25 0 5 0 653682874 263741440 52183 33554432000 4194304 4417452 140734643180832 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=257560 CPUtime=4.51 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 2745 1253 0 0 451 0 0 0 25 0 5 0 653682874 263741440 52183 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 19.89
Current children cumulated vsize (KiB) 257560

[startup+12.7003 s]
/proc/loadavg: 7.56 7.98 7.96 9/333 25708
/proc/meminfo: memFree=24076008/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=332272 CPUtime=45.42 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 102184 1253 0 0 4525 17 0 0 25 0 5 0 653682700 340246528 54516 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 83068 54516 180 55 0 80954 0
[pid=25682/tid=25689] ppid=25680 vsize=332272 CPUtime=10.95 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 14466 1253 0 0 1093 2 0 0 25 0 5 0 653682874 340246528 54516 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364597 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=332272 CPUtime=10.94 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 11785 1253 0 0 1094 0 0 0 25 0 5 0 653682874 340246528 54516 33554432000 4194304 4417452 140734643180832 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=332272 CPUtime=10.93 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 14143 1253 0 0 1089 4 0 0 25 0 5 0 653682874 340246528 54516 33554432000 4194304 4417452 140734643180832 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=332272 CPUtime=10.84 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 4719 1253 0 0 1084 0 0 0 25 0 5 0 653682874 340246528 54516 33554432000 4194304 4417452 140734643180832 18446744073709551615 4281863 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 45.42
Current children cumulated vsize (KiB) 332272

[startup+25.5009 s]
/proc/loadavg: 7.63 7.98 7.96 9/333 25708
/proc/meminfo: memFree=24146540/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=354712 CPUtime=96.48 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 108850 1253 0 0 9631 17 0 0 25 0 5 0 653682700 363225088 60126 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 88678 60126 180 55 0 86564 0
[pid=25682/tid=25689] ppid=25680 vsize=354712 CPUtime=23.75 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 15145 1253 0 0 2373 2 0 0 25 0 5 0 653682874 363225088 60126 33554432000 4194304 4417452 140734643180832 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=354712 CPUtime=23.74 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 12062 1253 0 0 2374 0 0 0 25 0 5 0 653682874 363225088 60126 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=354712 CPUtime=23.73 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 14246 1253 0 0 2369 4 0 0 25 0 5 0 653682874 363225088 60126 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=354712 CPUtime=23.5 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 10326 1253 0 0 2349 1 0 0 25 0 5 0 653682874 363225088 60126 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 96.48
Current children cumulated vsize (KiB) 354712

[startup+51.1011 s]
/proc/loadavg: 7.82 7.99 7.97 9/333 25708
/proc/meminfo: memFree=23971564/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=394300 CPUtime=198.58 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 117120 1253 0 0 19840 18 0 0 25 0 5 0 653682700 403763200 68158 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 98575 68158 180 55 0 96461 0
[pid=25682/tid=25689] ppid=25680 vsize=394300 CPUtime=49.32 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 15403 1253 0 0 4930 2 0 0 25 0 5 0 653682874 403763200 68158 33554432000 4194304 4417452 140734643180832 18446744073709551615 4357204 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=394300 CPUtime=49.34 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 12129 1253 0 0 4934 0 0 0 25 0 5 0 653682874 403763200 68158 33554432000 4194304 4417452 140734643180832 18446744073709551615 4366149 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=394300 CPUtime=49.32 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 18118 1253 0 0 4928 4 0 0 25 0 5 0 653682874 403763200 68158 33554432000 4194304 4417452 140734643180832 18446744073709551615 4250975 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=394300 CPUtime=48.83 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 14399 1253 0 0 4882 1 0 0 25 0 5 0 653682874 403763200 68158 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236675 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 198.58
Current children cumulated vsize (KiB) 394300

[startup+102.313 s]
/proc/loadavg: 8.03 8.02 7.98 9/333 25710
/proc/meminfo: memFree=23745492/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=461776 CPUtime=402.88 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 134277 1253 0 0 40267 21 0 0 25 0 5 0 653682700 472858624 84845 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 115444 84845 180 55 0 113330 0
[pid=25682/tid=25689] ppid=25680 vsize=461776 CPUtime=100.53 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 15476 1253 0 0 10051 2 0 0 25 0 5 0 653682874 472858624 84845 33554432000 4194304 4417452 140734643180832 18446744073709551615 244446639167 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=461776 CPUtime=100.56 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 12770 1253 0 0 10055 1 0 0 25 0 5 0 653682874 472858624 84845 33554432000 4194304 4417452 140734643180832 18446744073709551615 4278727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=461776 CPUtime=100.53 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 22526 1253 0 0 10048 5 0 0 25 0 5 0 653682874 472858624 84845 33554432000 4194304 4417452 140734643180832 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=461776 CPUtime=99.5 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 26434 1253 0 0 9947 3 0 0 25 0 5 0 653682874 472858624 84845 33554432000 4194304 4417452 140734643180832 18446744073709551615 4354159 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 402.88
Current children cumulated vsize (KiB) 461776

[startup+162.3 s]
/proc/loadavg: 8.07 8.03 7.99 9/333 25712
/proc/meminfo: memFree=23653204/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=506920 CPUtime=642.19 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 147710 1253 0 0 64197 22 0 0 25 0 5 0 653682700 519086080 98184 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 126730 98184 180 55 0 124616 0
[pid=25682/tid=25689] ppid=25680 vsize=506920 CPUtime=160.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 16528 1253 0 0 16050 2 0 0 25 0 5 0 653682874 519086080 98184 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=506920 CPUtime=160.55 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 14791 1253 0 0 16054 1 0 0 25 0 5 0 653682874 519086080 98184 33554432000 4194304 4417452 140734643180832 18446744073709551615 4365162 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=506920 CPUtime=160.51 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 22532 1253 0 0 16046 5 0 0 25 0 5 0 653682874 519086080 98184 33554432000 4194304 4417452 140734643180832 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=506920 CPUtime=158.85 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 36788 1253 0 0 15881 4 0 0 25 0 5 0 653682874 519086080 98184 33554432000 4194304 4417452 140734643180832 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 642.19
Current children cumulated vsize (KiB) 506920

[startup+222.301 s]
/proc/loadavg: 8.08 8.04 7.99 9/333 25713
/proc/meminfo: memFree=23561296/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=567468 CPUtime=881.55 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 172679 1253 0 0 88130 25 0 0 25 0 5 0 653682700 581087232 113321 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 141867 113321 180 55 0 139753 0
[pid=25682/tid=25689] ppid=25680 vsize=567468 CPUtime=220.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 20657 1253 0 0 22049 3 0 0 25 0 5 0 653682874 581087232 113321 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=25682/tid=25690] ppid=25680 vsize=817340 CPUtime=700.56 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 47615 1253 0 0 70050 6 0 0 25 0 5 0 653682874 836956160 175789 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=817340 CPUtime=697.08 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 46553 1253 0 0 69701 7 0 0 25 0 5 0 653682874 836956160 175789 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=817340 CPUtime=696.51 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 196152 1253 0 0 69626 25 0 0 25 0 5 0 653682874 836956160 175789 33554432000 4194304 4417452 140734643180832 18446744073709551615 4358008 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2796.42
Current children cumulated vsize (KiB) 817340

[startup+762.313 s]
/proc/loadavg: 8.12 8.15 8.05 9/333 25740
/proc/meminfo: memFree=22601580/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=979840 CPUtime=3035.84 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 459666 1253 0 0 303522 62 0 0 25 0 5 0 653682700 1003356160 216414 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 244960 216414 180 55 0 242846 0
[pid=25682/tid=25689] ppid=25680 vsize=979840 CPUtime=760.53 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 28616 1253 0 0 76050 3 0 0 25 0 5 0 653682874 1003356160 216414 33554432000 4194304 4417452 140734643180832 18446744073709551615 4199435 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=979840 CPUtime=760.57 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 67893 1253 0 0 76048 9 0 0 25 0 5 0 653682874 1003356160 216414 33554432000 4194304 4417452 140734643180832 18446744073709551615 4366646 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=979840 CPUtime=756.47 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 77294 1253 0 0 75636 11 0 0 25 0 5 0 653682874 1003356160 216414 33554432000 4194304 4417452 140734643180832 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=979840 CPUtime=756.51 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 228792 1253 0 0 75623 28 0 0 25 0 5 0 653682874 1003356160 216414 33554432000 4194304 4417452 140734643180832 18446744073709551615 4250432 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3035.84
Current children cumulated vsize (KiB) 979840

[startup+822.3 s]
/proc/loadavg: 8.12 8.15 8.05 9/333 25741
/proc/meminfo: memFree=22079256/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=1350456 CPUtime=3275.16 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 624963 1253 0 0 327432 84 0 0 25 0 5 0 653682700 1382866944 305666 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 337614 305666 180 55 0 335500 0
[pid=25682/tid=25689] ppid=25680 vsize=1350456 CPUtime=820.51 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 49264 1253 0 0 82046 5 0 0 25 0 5 0 653682874 1382866944 305666 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=1350456 CPUtime=820.56 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 110223 1253 0 0 82042 14 0 0 25 0 5 0 653682874 1382866944 305666 33554432000 4194304 4417452 140734643180832 18446744073709551615 4278071 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=1350456 CPUtime=815.84 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 140862 1253 0 0 81564 20 0 0 25 0 5 0 653682874 1382866944 305666 33554432000 4194304 4417452 140734643180832 18446744073709551615 244446639187 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=1350456 CPUtime=816.48 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 267543 1253 0 0 81614 34 0 0 25 0 5 0 653682874 1382866944 305666 33554432000 4194304 4417452 140734643180832 18446744073709551615 4357862 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3275.16
Current children cumulated vsize (KiB) 1350456

[startup+882.301 s]
/proc/loadavg: 8.08 8.13 8.05 9/333 25743
/proc/meminfo: memFree=22357220/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=967576 CPUtime=3514.52 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 767273 1253 0 0 351344 108 0 0 25 0 5 0 653682700 990797824 213348 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 241894 213348 180 55 0 239780 0
[pid=25682/tid=25689] ppid=25680 vsize=967576 CPUtime=880.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 55098 1253 0 0 88045 7 0 0 25 0 5 0 653682874 990797824 213348 33554432000 4194304 4417452 140734643180832 18446744073709551615 4232770 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=967576 CPUtime=880.56 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 121179 1253 0 0 88041 15 0 0 25 0 5 0 653682874 990797824 213348 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=967576 CPUtime=875.2 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 206309 1253 0 0 87488 32 0 0 25 0 5 0 653682874 990797824 213348 33554432000 4194304 4417452 140734643180832 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=967576 CPUtime=876.49 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 327616 1253 0 0 87605 44 0 0 25 0 5 0 653682874 990797824 213348 33554432000 4194304 4417452 140734643180832 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3514.52
Current children cumulated vsize (KiB) 967576

[startup+942.301 s]
/proc/loadavg: 8.03 8.11 8.05 9/333 25744
/proc/meminfo: memFree=22317372/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=923468 CPUtime=3753.89 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 811703 1253 0 0 375275 114 0 0 25 0 5 0 653682700 945631232 203315 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 230867 203315 180 55 0 228753 0
[pid=25682/tid=25689] ppid=25680 vsize=923468 CPUtime=940.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 55439 1253 0 0 94045 7 0 0 25 0 5 0 653682874 945631232 203315 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=923468 CPUtime=940.57 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 134007 1253 0 0 94040 17 0 0 25 0 5 0 653682874 945631232 203315 33554432000 4194304 4417452 140734643180832 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=923468 CPUtime=934.57 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 214136 1253 0 0 93424 33 0 0 25 0 5 0 653682874 945631232 203315 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=923468 CPUtime=936.48 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 351050 1253 0 0 93601 47 0 0 25 0 5 0 653682874 945631232 203315 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3753.89
Current children cumulated vsize (KiB) 923468

[startup+1002.3 s]
/proc/loadavg: 8.05 8.10 8.05 9/333 25746
/proc/meminfo: memFree=22292040/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=933552 CPUtime=3993.25 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 862228 1253 0 0 399204 121 0 0 25 0 5 0 653682700 955957248 205836 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 233388 205836 180 55 0 231274 0
[pid=25682/tid=25689] ppid=25680 vsize=933552 CPUtime=1000.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 64555 1253 0 0 100044 8 0 0 25 0 5 0 653682874 955957248 205836 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=933552 CPUtime=1000.56 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 144221 1253 0 0 100038 18 0 0 25 0 5 0 653682874 955957248 205836 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=933552 CPUtime=993.94 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 219567 1253 0 0 99360 34 0 0 25 0 5 0 653682874 955957248 205836 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236750 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=933552 CPUtime=996.47 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 376814 1253 0 0 99596 51 0 0 25 0 5 0 653682874 955957248 205836 33554432000 4194304 4417452 140734643180832 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3993.25
Current children cumulated vsize (KiB) 933552

[startup+1062.3 s]
/proc/loadavg: 8.02 8.08 8.04 9/333 25748
/proc/meminfo: memFree=21901264/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=941396 CPUtime=4232.62 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 873672 1253 0 0 423139 123 0 0 25 0 5 0 653682700 963989504 206803 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 235349 206803 180 55 0 233235 0
[pid=25682/tid=25689] ppid=25680 vsize=941396 CPUtime=1060.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 64555 1253 0 0 106044 8 0 0 25 0 5 0 653682874 963989504 206803 33554432000 4194304 4417452 140734643180832 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=941396 CPUtime=1060.56 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 148947 1253 0 0 106037 19 0 0 25 0 5 0 653682874 963989504 206803 33554432000 4194304 4417452 140734643180832 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=941396 CPUtime=1053.31 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 223020 1253 0 0 105297 34 0 0 25 0 5 0 653682874 963989504 206803 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236830 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=941396 CPUtime=1056.46 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 380079 1253 0 0 105595 51 0 0 25 0 5 0 653682874 963989504 206803 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4232.62
Current children cumulated vsize (KiB) 941396

[startup+1122.3 s]
/proc/loadavg: 8.00 8.06 8.03 9/333 25749
/proc/meminfo: memFree=22067888/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=991328 CPUtime=4471.96 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 900115 1253 0 0 447071 125 0 0 25 0 5 0 653682700 1015119872 221987 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 247832 221987 180 55 0 245718 0
[pid=25682/tid=25689] ppid=25680 vsize=991328 CPUtime=1120.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 64555 1253 0 0 112044 8 0 0 25 0 5 0 653682874 1015119872 221987 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=991328 CPUtime=1120.57 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 157702 1253 0 0 112037 20 0 0 25 0 5 0 653682874 1015119872 221987 33554432000 4194304 4417452 140734643180832 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=991328 CPUtime=1112.66 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 227808 1253 0 0 111231 35 0 0 25 0 5 0 653682874 1015119872 221987 33554432000 4194304 4417452 140734643180832 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=991328 CPUtime=1116.46 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 392979 1253 0 0 111594 52 0 0 25 0 5 0 653682874 1015119872 221987 33554432000 4194304 4417452 140734643180832 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4471.96
Current children cumulated vsize (KiB) 991328

[startup+1182.3 s]
/proc/loadavg: 8.04 8.06 8.03 9/333 25751
/proc/meminfo: memFree=22106656/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=1011408 CPUtime=4711.34 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 955304 1253 0 0 471001 133 0 0 25 0 5 0 653682700 1035681792 234777 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 252852 234777 180 55 0 250738 0
[pid=25682/tid=25689] ppid=25680 vsize=1011408 CPUtime=1180.52 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 64555 1253 0 0 118044 8 0 0 25 0 5 0 653682874 1035681792 234777 33554432000 4194304 4417452 140734643180832 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=1011408 CPUtime=1180.57 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 174906 1253 0 0 118035 22 0 0 25 0 5 0 653682874 1035681792 234777 33554432000 4194304 4417452 140734643180832 18446744073709551615 4357238 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=1011408 CPUtime=1172.04 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 232318 1253 0 0 117169 35 0 0 25 0 5 0 653682874 1035681792 234777 33554432000 4194304 4417452 140734643180832 18446744073709551615 4307376 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=1011408 CPUtime=1176.44 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 426454 1253 0 0 117588 56 0 0 25 0 5 0 653682874 1035681792 234777 33554432000 4194304 4417452 140734643180832 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4711.34
Current children cumulated vsize (KiB) 1011408



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.6 s]
/proc/loadavg: 8.08 8.07 8.04 9/333 25751
/proc/meminfo: memFree=21977928/32951124 swapFree=44485764/67111528
[pid=25682] ppid=25680 vsize=1134532 CPUtime=4800.33 cores=0,2,4,6
/proc/25682/stat : 25682 (plingeling) S 25680 25682 25544 0 -1 4202496 994906 1253 0 0 479896 137 0 0 25 0 5 0 653682700 1161760768 255087 33554432000 4194304 4417452 140734643180832 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25682/statm: 283633 255087 180 55 0 281519 0
[pid=25682/tid=25689] ppid=25680 vsize=1134532 CPUtime=1202.83 cores=0,2,4,6
/proc/25682/task/25689/stat : 25689 (plingeling) R 25680 25682 25544 0 -1 4202560 72532 1253 0 0 120274 9 0 0 25 0 5 0 653682874 1161760768 255087 33554432000 4194304 4417452 140734643180832 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25682/tid=25690] ppid=25680 vsize=1134532 CPUtime=1202.88 cores=0,2,4,6
/proc/25682/task/25690/stat : 25690 (plingeling) R 25680 25682 25544 0 -1 4202560 189676 1253 0 0 120265 23 0 0 25 0 5 0 653682874 1161760768 255087 33554432000 4194304 4417452 140734643180832 18446744073709551615 4302940 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25682/tid=25691] ppid=25680 vsize=1134532 CPUtime=1194.11 cores=0,2,4,6
/proc/25682/task/25691/stat : 25691 (plingeling) R 25680 25682 25544 0 -1 4202560 234272 1253 0 0 119375 36 0 0 25 0 5 0 653682874 1161760768 255087 33554432000 4194304 4417452 140734643180832 18446744073709551615 4365178 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25682/tid=25692] ppid=25680 vsize=1134532 CPUtime=1198.75 cores=0,2,4,6
/proc/25682/task/25692/stat : 25692 (plingeling) R 25680 25682 25544 0 -1 4202560 441355 1253 0 0 119817 58 0 0 25 0 5 0 653682874 1161760768 255087 33554432000 4194304 4417452 140734643180832 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 1134532

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.66
CPU time (s): 4800.4
CPU user time (s): 4798.99
CPU system time (s): 1.41678
CPU usage (%): 398.488
Max. virtual memory (cumulated for all children) (KiB): 1576804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.99
system time used= 1.41678
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 996159
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 95
involuntary context switches= 23464

runsolver used 3.69144 second user time and 9.03962 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-15 02:53:43
IDJOB=3371260
IDBENCH=82366
IDSOLVER=1848
FILE ID=node105/3371260-1305420821
RUNJOBID= node105-1305419616-25562
PBS_JOBID= 13324579
Free space on /tmp= 73516 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371260-1305420821/watcher-3371260-1305420821 -o /tmp/evaluation-result-3371260-1305420821/solver-3371260-1305420821 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371260-1305420821.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e44b288003a3eaf34673a2c0fb8c6f3e
RANDOM SEED=412631759

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25188432 kB
Buffers:        282180 kB
Cached:        6005724 kB
SwapCached:      39656 kB
Active:         608116 kB
Inactive:      6892400 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25188432 kB
SwapTotal:    67111528 kB
SwapFree:     44485764 kB
Dirty:           76460 kB
Writeback:           8 kB
AnonPages:     1180152 kB
Mapped:          10200 kB
Slab:           130896 kB
PageTables:      66140 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 65324580 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73460 MiB
End job on node105 at 2011-05-15 03:13:49