Trace number 3371422

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.3 1203.55

General information on the benchmark

NameSAT03/industrial/kukula/addm_bench/
am_7_7.shuffled-as.sat03-363.cnf
MD5SUMc7f51e1ee7556440ab29e1c4bfe29538
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4264
Number of clauses14751
Sum of the clauses size40035
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 24214
Number of clauses of size 310535
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371422-1305430710/watcher-3371422-1305430710 -o /tmp/evaluation-result-3371422-1305430710/solver-3371422-1305430710 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371422-1305430710.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.18 7.93 7.89 2/349 21783
/proc/meminfo: memFree=21266024/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=10500 CPUtime=0 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) R 21781 21783 21414 0 -1 4202496 718 1251 0 0 0 0 0 0 22 0 1 0 654668684 10752000 648 33554432000 4194304 4417452 140733215648992 18446744073709551615 218905730816 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/21783/statm: 2625 648 148 55 0 511 0

[startup+0.0464109 s]
/proc/loadavg: 7.18 7.93 7.89 2/349 21783
/proc/meminfo: memFree=21266024/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=56252 CPUtime=0.09 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 2379 1251 0 0 9 0 0 0 22 0 5 0 654668684 57602048 1865 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 14063 1865 172 55 0 11949 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 56252

[startup+0.100403 s]
/proc/loadavg: 7.18 7.93 7.89 2/349 21783
/proc/meminfo: memFree=21266024/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=56252 CPUtime=0.31 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 2380 1251 0 0 31 0 0 0 22 0 5 0 654668684 57602048 1866 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 14063 1866 173 55 0 11949 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 56252

[startup+0.300365 s]
/proc/loadavg: 7.18 7.93 7.89 2/349 21783
/proc/meminfo: memFree=21266024/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=122352 CPUtime=1.11 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 2630 1251 0 0 111 0 0 0 22 0 5 0 654668684 125288448 2037 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 30588 2037 179 55 0 28474 0
Current children cumulated CPU time (s) 1.11
Current children cumulated vsize (KiB) 122352

[startup+0.700295 s]
/proc/loadavg: 7.18 7.93 7.89 2/349 21783
/proc/meminfo: memFree=21266024/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=123604 CPUtime=2.71 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 4843 1251 0 0 270 1 0 0 22 0 5 0 654668684 126570496 2345 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 30901 2345 179 55 0 28787 0
Current children cumulated CPU time (s) 2.71
Current children cumulated vsize (KiB) 123604

[startup+1.50115 s]
/proc/loadavg: 7.18 7.93 7.89 6/356 21796
/proc/meminfo: memFree=21233792/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=130500 CPUtime=5.89 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 10289 1251 0 0 588 1 0 0 22 0 5 0 654668684 133632000 4055 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 32625 4055 180 55 0 30511 0
[pid=21783/tid=21792] ppid=21781 vsize=130500 CPUtime=1.46 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 2175 1251 0 0 146 0 0 0 25 0 5 0 654668687 133632000 4055 33554432000 4194304 4417452 140733215648992 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=130500 CPUtime=1.45 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 1767 1251 0 0 145 0 0 0 25 0 5 0 654668687 133632000 4055 33554432000 4194304 4417452 140733215648992 18446744073709551615 4252491 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=130500 CPUtime=1.46 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 2243 1251 0 0 146 0 0 0 25 0 5 0 654668687 133632000 4055 33554432000 4194304 4417452 140733215648992 18446744073709551615 4250929 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=130500 CPUtime=1.46 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 2103 1251 0 0 146 0 0 0 25 0 5 0 654668687 133632000 4055 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.89
Current children cumulated vsize (KiB) 130500

[startup+3.10087 s]
/proc/loadavg: 7.01 7.88 7.88 6/356 21796
/proc/meminfo: memFree=21210472/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=135260 CPUtime=12.27 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 17841 1251 0 0 1224 3 0 0 22 0 5 0 654668684 138506240 5245 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 33815 5245 180 55 0 31701 0
[pid=21783/tid=21792] ppid=21781 vsize=135260 CPUtime=3.06 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 3591 1251 0 0 305 1 0 0 25 0 5 0 654668687 138506240 5245 33554432000 4194304 4417452 140733215648992 18446744073709551615 4311579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=135260 CPUtime=3.04 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 3986 1251 0 0 304 0 0 0 25 0 5 0 654668687 138506240 5245 33554432000 4194304 4417452 140733215648992 18446744073709551615 4356852 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=135260 CPUtime=3.07 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 4952 1251 0 0 306 1 0 0 25 0 5 0 654668687 138506240 5245 33554432000 4194304 4417452 140733215648992 18446744073709551615 4358100 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=135260 CPUtime=3.06 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 3311 1251 0 0 306 0 0 0 25 0 5 0 654668687 138506240 5245 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.27
Current children cumulated vsize (KiB) 135260

[startup+6.30029 s]
/proc/loadavg: 7.01 7.88 7.88 6/359 21807
/proc/meminfo: memFree=20821088/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=144620 CPUtime=25.04 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 32370 1251 0 0 2498 6 0 0 22 0 5 0 654668684 148090880 7585 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 36155 7585 180 55 0 34041 0
[pid=21783/tid=21792] ppid=21781 vsize=144620 CPUtime=6.26 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 6951 1251 0 0 625 1 0 0 25 0 5 0 654668687 148090880 7585 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=144620 CPUtime=6.2 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 8600 1251 0 0 619 1 0 0 25 0 5 0 654668687 148090880 7585 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=144620 CPUtime=6.26 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 8515 1251 0 0 625 1 0 0 25 0 5 0 654668687 148090880 7585 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=144620 CPUtime=6.27 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 6303 1251 0 0 626 1 0 0 25 0 5 0 654668687 148090880 7585 33554432000 4194304 4417452 140733215648992 18446744073709551615 4236689 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.04
Current children cumulated vsize (KiB) 144620

[startup+12.7011 s]
/proc/loadavg: 6.70 7.78 7.85 6/359 21807
/proc/meminfo: memFree=20576996/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=148000 CPUtime=50.57 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 57765 1251 0 0 5046 11 0 0 22 0 5 0 654668684 151552000 8430 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 37000 8430 180 55 0 34886 0
[pid=21783/tid=21792] ppid=21781 vsize=148000 CPUtime=12.65 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 13635 1251 0 0 1262 3 0 0 25 0 5 0 654668687 151552000 8430 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=148000 CPUtime=12.53 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 15006 1251 0 0 1251 2 0 0 25 0 5 0 654668687 151552000 8430 33554432000 4194304 4417452 140733215648992 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=148000 CPUtime=12.66 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 15342 1251 0 0 1264 2 0 0 25 0 5 0 654668687 151552000 8430 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=148000 CPUtime=12.67 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 11781 1251 0 0 1265 2 0 0 25 0 5 0 654668687 151552000 8430 33554432000 4194304 4417452 140733215648992 18446744073709551615 4357566 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.57
Current children cumulated vsize (KiB) 148000

[startup+25.5008 s]
/proc/loadavg: 6.90 7.79 7.85 9/363 21811
/proc/meminfo: memFree=20125000/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=165920 CPUtime=101.62 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 106870 1251 0 0 10142 20 0 0 22 0 5 0 654668684 169902080 12913 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 41480 12913 180 55 0 39366 0
[pid=21783/tid=21792] ppid=21781 vsize=165920 CPUtime=25.45 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 26073 1251 0 0 2539 6 0 0 25 0 5 0 654668687 169902080 12913 33554432000 4194304 4417452 140733215648992 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=165920 CPUtime=25.18 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 27593 1251 0 0 2514 4 0 0 25 0 5 0 654668687 169902080 12913 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=165920 CPUtime=25.46 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 28143 1251 0 0 2542 4 0 0 25 0 5 0 654668687 169902080 12913 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=165920 CPUtime=25.47 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 23060 1251 0 0 2543 4 0 0 25 0 5 0 654668687 169902080 12913 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.62
Current children cumulated vsize (KiB) 165920

[startup+51.1012 s]
/proc/loadavg: 7.35 7.82 7.85 9/363 21812
/proc/meminfo: memFree=19996492/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=198840 CPUtime=203.72 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 184997 1251 0 0 20340 32 0 0 22 0 5 0 654668684 203612160 21156 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 49710 21156 180 55 0 47596 0
[pid=21783/tid=21792] ppid=21781 vsize=198840 CPUtime=51.05 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 45017 1251 0 0 5096 9 0 0 25 0 5 0 654668687 203612160 21156 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=198840 CPUtime=50.5 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 46402 1251 0 0 5043 7 0 0 25 0 5 0 654668687 203612160 21156 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=198840 CPUtime=51.05 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 45880 1251 0 0 5098 7 0 0 25 0 5 0 654668687 203612160 21156 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=198840 CPUtime=51.07 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 45697 1251 0 0 5100 7 0 0 25 0 5 0 654668687 203612160 21156 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.72
Current children cumulated vsize (KiB) 198840

[startup+102.313 s]
/proc/loadavg: 7.81 7.86 7.87 9/363 21813
/proc/meminfo: memFree=19999496/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=211884 CPUtime=408 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 309829 1251 0 0 40748 52 0 0 22 0 5 0 654668684 216969216 24407 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 52971 24407 180 55 0 50857 0
[pid=21783/tid=21792] ppid=21781 vsize=211884 CPUtime=102.25 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 81252 1251 0 0 10211 14 0 0 25 0 5 0 654668687 216969216 24407 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=211884 CPUtime=101.15 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 73190 1251 0 0 10103 12 0 0 25 0 5 0 654668687 216969216 24407 33554432000 4194304 4417452 140733215648992 18446744073709551615 4199435 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=211884 CPUtime=102.26 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 79649 1251 0 0 10213 13 0 0 25 0 5 0 654668687 216969216 24407 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=211884 CPUtime=102.28 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 73737 1251 0 0 10216 12 0 0 25 0 5 0 654668687 216969216 24407 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408
Current children cumulated vsize (KiB) 211884

[startup+162.301 s]
/proc/loadavg: 8.08 7.92 7.88 9/363 21815
/proc/meminfo: memFree=20126196/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=242712 CPUtime=647.29 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 422695 1251 0 0 64660 69 0 0 22 0 5 0 654668684 248537088 32114 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 60678 32114 180 55 0 58564 0
[pid=21783/tid=21792] ppid=21781 vsize=242712 CPUtime=162.23 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 115105 1251 0 0 16203 20 0 0 25 0 5 0 654668687 248537088 32114 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=242712 CPUtime=160.49 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 99027 1251 0 0 16033 16 0 0 25 0 5 0 654668687 248537088 32114 33554432000 4194304 4417452 140733215648992 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=242712 CPUtime=162.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 107506 1251 0 0 16208 17 0 0 25 0 5 0 654668687 248537088 32114 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=242712 CPUtime=162.27 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 99056 1251 0 0 16212 15 0 0 25 0 5 0 654668687 248537088 32114 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.29
Current children cumulated vsize (KiB) 242712


################
# More data... #
################

[pid=21783/tid=21793] ppid=21781 vsize=606112 CPUtime=753.83 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 277932 1251 0 0 75336 47 0 0 25 0 5 0 654668687 620658688 122996 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=606112 CPUtime=762.26 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 286059 1251 0 0 76183 43 0 0 25 0 5 0 654668687 620658688 122996 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=606112 CPUtime=762.3 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 213025 1251 0 0 76198 32 0 0 25 0 5 0 654668687 620658688 122996 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3040.59
Current children cumulated vsize (KiB) 606112

[startup+822.301 s]
/proc/loadavg: 8.07 8.08 7.98 9/363 21832
/proc/meminfo: memFree=19706800/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=705160 CPUtime=3279.85 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1174541 1251 0 0 327800 185 0 0 22 0 5 0 654668684 722083840 147726 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 176290 147726 180 55 0 174176 0
[pid=21783/tid=21792] ppid=21781 vsize=705160 CPUtime=822.12 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 362360 1251 0 0 82154 58 0 0 25 0 5 0 654668687 722083840 147726 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=705160 CPUtime=813.14 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 285057 1251 0 0 81267 47 0 0 25 0 5 0 654668687 722083840 147726 33554432000 4194304 4417452 140733215648992 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=705160 CPUtime=822.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 312098 1251 0 0 82179 46 0 0 25 0 5 0 654668687 722083840 147726 33554432000 4194304 4417452 140733215648992 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=705160 CPUtime=822.29 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 213025 1251 0 0 82197 32 0 0 25 0 5 0 654668687 722083840 147726 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3279.85
Current children cumulated vsize (KiB) 705160

[startup+882.301 s]
/proc/loadavg: 8.16 8.11 8.00 9/363 21834
/proc/meminfo: memFree=19734296/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=682096 CPUtime=3519.14 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1200755 1251 0 0 351724 190 0 0 22 0 5 0 654668684 698466304 141960 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 170524 141960 180 55 0 168410 0
[pid=21783/tid=21792] ppid=21781 vsize=682096 CPUtime=882.11 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 367276 1251 0 0 88152 59 0 0 25 0 5 0 654668687 698466304 141960 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=682096 CPUtime=872.44 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 285057 1251 0 0 87197 47 0 0 25 0 5 0 654668687 698466304 141960 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=682096 CPUtime=882.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 333396 1251 0 0 88175 50 0 0 25 0 5 0 654668687 698466304 141960 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364703 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=682096 CPUtime=882.29 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 213025 1251 0 0 88197 32 0 0 25 0 5 0 654668687 698466304 141960 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3519.14
Current children cumulated vsize (KiB) 682096

[startup+942.301 s]
/proc/loadavg: 8.13 8.10 8.00 9/363 21836
/proc/meminfo: memFree=19783620/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=628748 CPUtime=3758.46 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1264739 1251 0 0 375646 200 0 0 22 0 5 0 654668684 643837952 128623 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 157187 128623 180 55 0 155073 0
[pid=21783/tid=21792] ppid=21781 vsize=628748 CPUtime=942.1 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 367276 1251 0 0 94151 59 0 0 25 0 5 0 654668687 643837952 128623 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=628748 CPUtime=931.76 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 312364 1251 0 0 93124 52 0 0 25 0 5 0 654668687 643837952 128623 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=628748 CPUtime=942.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 354043 1251 0 0 94173 52 0 0 25 0 5 0 654668687 643837952 128623 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=628748 CPUtime=942.3 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 229055 1251 0 0 94195 35 0 0 25 0 5 0 654668687 643837952 128623 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3758.46
Current children cumulated vsize (KiB) 628748

[startup+1002.3 s]
/proc/loadavg: 8.19 8.11 8.01 9/363 21837
/proc/meminfo: memFree=19786692/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=629452 CPUtime=3997.77 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1334207 1251 0 0 399567 210 0 0 22 0 5 0 654668684 644558848 128799 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 157363 128799 180 55 0 155249 0
[pid=21783/tid=21792] ppid=21781 vsize=629452 CPUtime=1002.1 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 402371 1251 0 0 100144 66 0 0 25 0 5 0 654668687 644558848 128799 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=629452 CPUtime=991.08 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 323611 1251 0 0 99054 54 0 0 25 0 5 0 654668687 644558848 128799 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364861 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=629452 CPUtime=1002.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 372708 1251 0 0 100171 54 0 0 25 0 5 0 654668687 644558848 128799 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=629452 CPUtime=1002.29 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 233516 1251 0 0 100194 35 0 0 25 0 5 0 654668687 644558848 128799 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3997.77
Current children cumulated vsize (KiB) 629452

[startup+1062.3 s]
/proc/loadavg: 8.07 8.09 8.00 9/363 21839
/proc/meminfo: memFree=19766208/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=650404 CPUtime=4237.07 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1372271 1251 0 0 423492 215 0 0 22 0 5 0 654668684 666013696 134037 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 162601 134037 180 55 0 160487 0
[pid=21783/tid=21792] ppid=21781 vsize=650404 CPUtime=1062.08 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 410979 1251 0 0 106142 66 0 0 25 0 5 0 654668687 666013696 134037 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=650404 CPUtime=1050.39 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 331509 1251 0 0 104984 55 0 0 25 0 5 0 654668687 666013696 134037 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=650404 CPUtime=1062.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 389998 1251 0 0 106169 56 0 0 25 0 5 0 654668687 666013696 134037 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=650404 CPUtime=1062.3 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 237784 1251 0 0 106194 36 0 0 25 0 5 0 654668687 666013696 134037 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4237.07
Current children cumulated vsize (KiB) 650404

[startup+1122.3 s]
/proc/loadavg: 8.14 8.10 8.01 9/363 21840
/proc/meminfo: memFree=19695500/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=720936 CPUtime=4476.36 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1407035 1251 0 0 447418 218 0 0 22 0 5 0 654668684 738238464 151670 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 180234 151670 180 55 0 178120 0
[pid=21783/tid=21792] ppid=21781 vsize=720936 CPUtime=1122.07 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 417097 1251 0 0 112140 67 0 0 25 0 5 0 654668687 738238464 151670 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=720936 CPUtime=1109.7 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 338008 1251 0 0 110914 56 0 0 25 0 5 0 654668687 738238464 151670 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=720936 CPUtime=1122.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 408843 1251 0 0 112167 58 0 0 25 0 5 0 654668687 738238464 151670 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=720936 CPUtime=1122.29 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 241086 1251 0 0 112193 36 0 0 25 0 5 0 654668687 738238464 151670 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4476.36
Current children cumulated vsize (KiB) 720936

[startup+1182.3 s]
/proc/loadavg: 8.12 8.10 8.01 9/363 21842
/proc/meminfo: memFree=19697208/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=735656 CPUtime=4715.67 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1431341 1251 0 0 471345 222 0 0 22 0 5 0 654668684 753311744 155350 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 183914 155350 180 55 0 181800 0
[pid=21783/tid=21792] ppid=21781 vsize=735656 CPUtime=1182.06 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 419194 1251 0 0 118139 67 0 0 25 0 5 0 654668687 753311744 155350 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=735656 CPUtime=1169.01 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 343050 1251 0 0 116844 57 0 0 25 0 5 0 654668687 753311744 155350 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=735656 CPUtime=1182.25 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 425899 1251 0 0 118165 60 0 0 25 0 5 0 654668687 753311744 155350 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=735656 CPUtime=1182.3 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 241197 1251 0 0 118193 37 0 0 25 0 5 0 654668687 753311744 155350 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4715.67
Current children cumulated vsize (KiB) 735656



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.5 s]
/proc/loadavg: 8.14 8.10 8.01 9/363 21843
/proc/meminfo: memFree=19677240/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=747328 CPUtime=4800.21 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1471149 1251 0 0 479795 226 0 0 22 0 5 0 654668684 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 186832 158267 180 55 0 184718 0
[pid=21783/tid=21792] ppid=21781 vsize=747328 CPUtime=1203.27 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 436411 1251 0 0 120258 69 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=747328 CPUtime=1189.95 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 351110 1251 0 0 118937 58 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=747328 CPUtime=1203.46 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 440430 1251 0 0 120285 61 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=747328 CPUtime=1203.52 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 241197 1251 0 0 120315 37 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 747328

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.5 s]
/proc/loadavg: 8.14 8.10 8.01 9/363 21843
/proc/meminfo: memFree=19677240/32951124 swapFree=65581052/67111528
[pid=21783] ppid=21781 vsize=747328 CPUtime=4800.21 cores=0,2,4,6
/proc/21783/stat : 21783 (plingeling) S 21781 21783 21414 0 -1 4202496 1471149 1251 0 0 479795 226 0 0 22 0 5 0 654668684 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/21783/statm: 186832 158267 180 55 0 184718 0
[pid=21783/tid=21792] ppid=21781 vsize=747328 CPUtime=1203.27 cores=0,2,4,6
/proc/21783/task/21792/stat : 21792 (plingeling) R 21781 21783 21414 0 -1 4202560 436411 1251 0 0 120258 69 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21783/tid=21793] ppid=21781 vsize=747328 CPUtime=1189.95 cores=0,2,4,6
/proc/21783/task/21793/stat : 21793 (plingeling) R 21781 21783 21414 0 -1 4202560 351110 1251 0 0 118937 58 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21783/tid=21794] ppid=21781 vsize=747328 CPUtime=1203.46 cores=0,2,4,6
/proc/21783/task/21794/stat : 21794 (plingeling) R 21781 21783 21414 0 -1 4202560 440430 1251 0 0 120285 61 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=21783/tid=21795] ppid=21781 vsize=747328 CPUtime=1203.52 cores=0,2,4,6
/proc/21783/task/21795/stat : 21795 (plingeling) R 21781 21783 21414 0 -1 4202560 241197 1251 0 0 120315 37 0 0 25 0 5 0 654668687 765263872 158267 33554432000 4194304 4417452 140733215648992 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 747328

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.55
CPU time (s): 4800.3
CPU user time (s): 4798
CPU system time (s): 2.29565
CPU usage (%): 398.846
Max. virtual memory (cumulated for all children) (KiB): 801776

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798
system time used= 2.29565
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1472400
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 209
involuntary context switches= 21544

runsolver used 3.84941 second user time and 9.72452 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-15 05:38:30
IDJOB=3371422
IDBENCH=84237
IDSOLVER=1848
FILE ID=node137/3371422-1305430710
RUNJOBID= node137-1305430710-21771
PBS_JOBID= 13324606
Free space on /tmp= 73800 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT03/industrial/kukula/addm_bench/am_7_7.shuffled-as.sat03-363.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371422-1305430710/watcher-3371422-1305430710 -o /tmp/evaluation-result-3371422-1305430710/solver-3371422-1305430710 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371422-1305430710.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c7f51e1ee7556440ab29e1c4bfe29538
RANDOM SEED=632570162

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21266304 kB
Buffers:        291880 kB
Cached:        3729196 kB
SwapCached:      36328 kB
Active:        1632448 kB
Inactive:      9827928 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21266304 kB
SwapTotal:    67111528 kB
SwapFree:     65581052 kB
Dirty:             568 kB
Writeback:           0 kB
AnonPages:     7412368 kB
Mapped:          18724 kB
Slab:           121284 kB
PageTables:      38388 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 75893948 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73736 MiB
End job on node137 at 2011-05-15 05:58:35