Trace number 3281111

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.1 1201.83

General information on the benchmark

Nameindustrial/IBM_FV_2002_13_rule_1/
SAT_dat.k45.cnf
MD5SUM8a76c8add64173ae39149aae572a02d9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark185.162
Satisfiable
(Un)Satisfiability was proved
Number of variables37432
Number of clauses147345
Sum of the clauses size401667
Maximum clause length37
Minimum clause length1
Number of clauses of size 1603
Number of clauses of size 269621
Number of clauses of size 371450
Number of clauses of size 4266
Number of clauses of size 5505
Number of clauses of size over 54900

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3281111-1304038770/watcher-3281111-1304038770 -o /tmp/evaluation-result-3281111-1304038770/solver-3281111-1304038770 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3281111-1304038770.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.39 5.85 5.96 5/181 5255
/proc/meminfo: memFree=19443448/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) R 5253 5255 3973 0 -1 4202496 243 1253 0 0 0 0 0 0 25 0 1 0 496293184 8937472 173 33554432000 4194304 4417332 140737357781248 18446744073709551615 255106768640 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5255/statm: 2182 173 137 55 0 68 0

[startup+0.105375 s]
/proc/loadavg: 7.39 5.85 5.96 5/181 5255
/proc/meminfo: memFree=19443448/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=28096 CPUtime=0.09 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) R 5253 5255 3973 0 -1 4202496 5117 1253 0 0 9 0 0 0 25 0 1 0 496293184 28770304 5047 33554432000 4194304 4417332 140737357781248 18446744073709551615 4227841 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5255/statm: 7024 5047 148 55 0 4910 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 28096

[startup+0.298296 s]
/proc/loadavg: 7.39 5.85 5.96 5/181 5255
/proc/meminfo: memFree=19443448/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=87368 CPUtime=0.49 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 12452 1253 0 0 48 1 0 0 25 0 5 0 496293184 89464832 9402 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 21609 9389 173 55 0 19495 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 87368

[startup+0.300296 s]
/proc/loadavg: 7.39 5.85 5.96 5/181 5255
/proc/meminfo: memFree=19443448/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=86436 CPUtime=0.49 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 12452 1253 0 0 48 1 0 0 25 0 5 0 496293184 88510464 9389 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 21609 9389 173 55 0 19495 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 86436

[startup+0.700227 s]
/proc/loadavg: 7.39 5.85 5.96 5/181 5255
/proc/meminfo: memFree=19443448/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=88556 CPUtime=2.05 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 14835 1253 0 0 204 1 0 0 25 0 5 0 496293184 90681344 9920 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 22139 9920 174 55 0 20025 0
Current children cumulated CPU time (s) 2.05
Current children cumulated vsize (KiB) 88556

[startup+1.50109 s]
/proc/loadavg: 7.39 5.85 5.96 9/186 5265
/proc/meminfo: memFree=19395468/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=152416 CPUtime=5.26 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 21539 1253 0 0 523 3 0 0 25 0 5 0 496293184 156073984 9675 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 38104 9675 176 55 0 35990 0
[pid=5255/tid=5262] ppid=5253 vsize=152416 CPUtime=1.3 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 5106 1253 0 0 130 0 0 0 19 0 5 0 496293203 156073984 9675 33554432000 4194304 4417332 140737357781248 18446744073709551615 4346390 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=152416 CPUtime=1.29 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 4647 1253 0 0 129 0 0 0 19 0 5 0 496293203 156073984 9675 33554432000 4194304 4417332 140737357781248 18446744073709551615 4346375 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=152416 CPUtime=1.15 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 1512 1253 0 0 115 0 0 0 25 0 5 0 496293203 156073984 9675 33554432000 4194304 4417332 140737357781248 18446744073709551615 4269264 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=152416 CPUtime=1.3 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 693 1253 0 0 130 0 0 0 25 0 5 0 496293203 156073984 9675 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.26
Current children cumulated vsize (KiB) 152416

[startup+3.1008 s]
/proc/loadavg: 7.39 5.85 5.96 9/186 5265
/proc/meminfo: memFree=19379100/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=168300 CPUtime=11.65 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 25792 1253 0 0 1162 3 0 0 25 0 5 0 496293184 172339200 13523 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 42075 13523 180 55 0 39961 0
[pid=5255/tid=5262] ppid=5253 vsize=168300 CPUtime=2.9 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 6540 1253 0 0 289 1 0 0 24 0 5 0 496293203 172339200 13523 33554432000 4194304 4417332 140737357781248 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=168300 CPUtime=2.88 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 6284 1253 0 0 288 0 0 0 24 0 5 0 496293203 172339200 13523 33554432000 4194304 4417332 140737357781248 18446744073709551615 4342901 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=168300 CPUtime=2.75 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 2694 1253 0 0 275 0 0 0 25 0 5 0 496293203 172339200 13523 33554432000 4194304 4417332 140737357781248 18446744073709551615 4250975 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=168300 CPUtime=2.9 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 693 1253 0 0 290 0 0 0 25 0 5 0 496293203 172339200 13523 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.65
Current children cumulated vsize (KiB) 168300

[startup+6.30024 s]
/proc/loadavg: 7.52 5.90 5.97 9/186 5265
/proc/meminfo: memFree=19370788/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=183420 CPUtime=24.42 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 29586 1253 0 0 2439 3 0 0 25 0 5 0 496293184 187822080 17304 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 45855 17304 181 55 0 43741 0
[pid=5255/tid=5262] ppid=5253 vsize=183420 CPUtime=6.1 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 6703 1253 0 0 609 1 0 0 25 0 5 0 496293203 187822080 17304 33554432000 4194304 4417332 140737357781248 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=183420 CPUtime=6.06 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 7384 1253 0 0 606 0 0 0 25 0 5 0 496293203 187822080 17304 33554432000 4194304 4417332 140737357781248 18446744073709551615 4357978 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=183420 CPUtime=5.95 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 3233 1253 0 0 595 0 0 0 25 0 5 0 496293203 187822080 17304 33554432000 4194304 4417332 140737357781248 18446744073709551615 4353502 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=183420 CPUtime=6.09 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 2685 1253 0 0 609 0 0 0 25 0 5 0 496293203 187822080 17304 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.42
Current children cumulated vsize (KiB) 183420

[startup+12.7011 s]
/proc/loadavg: 7.56 5.94 5.98 9/186 5265
/proc/meminfo: memFree=19341436/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=205036 CPUtime=49.99 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 36707 1253 0 0 4995 4 0 0 25 0 5 0 496293184 209956864 22708 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 51259 22708 181 55 0 49145 0
[pid=5255/tid=5262] ppid=5253 vsize=205036 CPUtime=12.5 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 7513 1253 0 0 1249 1 0 0 25 0 5 0 496293203 209956864 22708 33554432000 4194304 4417332 140737357781248 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=205036 CPUtime=12.43 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 7665 1253 0 0 1243 0 0 0 25 0 5 0 496293203 209956864 22708 33554432000 4194304 4417332 140737357781248 18446744073709551615 4245664 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=205036 CPUtime=12.35 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 6448 1253 0 0 1235 0 0 0 25 0 5 0 496293203 209956864 22708 33554432000 4194304 4417332 140737357781248 18446744073709551615 4353435 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=205036 CPUtime=12.49 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 5500 1253 0 0 1249 0 0 0 25 0 5 0 496293203 209956864 22708 33554432000 4194304 4417332 140737357781248 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.99
Current children cumulated vsize (KiB) 205036

[startup+25.5009 s]
/proc/loadavg: 7.65 6.04 6.01 9/186 5265
/proc/meminfo: memFree=19356428/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=206156 CPUtime=101.12 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 50851 1253 0 0 10106 6 0 0 25 0 5 0 496293184 211103744 22614 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 51539 22614 181 55 0 49425 0
[pid=5255/tid=5262] ppid=5253 vsize=206156 CPUtime=25.3 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 10756 1253 0 0 2529 1 0 0 25 0 5 0 496293203 211103744 22614 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=206156 CPUtime=25.16 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 11995 1253 0 0 2515 1 0 0 25 0 5 0 496293203 211103744 22614 33554432000 4194304 4417332 140737357781248 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=206156 CPUtime=25.15 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 10476 1253 0 0 2514 1 0 0 25 0 5 0 496293203 211103744 22614 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=206156 CPUtime=25.29 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 8043 1253 0 0 2529 0 0 0 25 0 5 0 496293203 211103744 22614 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364370 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.12
Current children cumulated vsize (KiB) 206156

[startup+51.1004 s]
/proc/loadavg: 7.77 6.19 6.07 9/186 5266
/proc/meminfo: memFree=19314432/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=229328 CPUtime=203.39 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 97637 1253 0 0 20326 13 0 0 25 0 5 0 496293184 234831872 28787 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 57332 28787 181 55 0 55218 0
[pid=5255/tid=5262] ppid=5253 vsize=229328 CPUtime=50.9 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 30320 1253 0 0 5086 4 0 0 25 0 5 0 496293203 234831872 28787 33554432000 4194304 4417332 140737357781248 18446744073709551615 4236930 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=229328 CPUtime=50.62 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 23896 1253 0 0 5059 3 0 0 25 0 5 0 496293203 234831872 28787 33554432000 4194304 4417332 140737357781248 18446744073709551615 4358010 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=229328 CPUtime=50.75 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 17211 1253 0 0 5073 2 0 0 25 0 5 0 496293203 234831872 28787 33554432000 4194304 4417332 140737357781248 18446744073709551615 4253152 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=229328 CPUtime=50.89 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 16629 1253 0 0 5088 1 0 0 25 0 5 0 496293203 234831872 28787 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.39
Current children cumulated vsize (KiB) 229328

[startup+102.3 s]
/proc/loadavg: 7.98 6.52 6.18 9/186 5276
/proc/meminfo: memFree=19147864/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=273184 CPUtime=407.91 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 158822 1253 0 0 40768 23 0 0 25 0 5 0 496293184 279740416 39759 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 68296 39759 181 55 0 66182 0
[pid=5255/tid=5262] ppid=5253 vsize=273184 CPUtime=102.1 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 37927 1253 0 0 10205 5 0 0 25 0 5 0 496293203 279740416 39759 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=273184 CPUtime=101.55 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 54215 1253 0 0 10146 9 0 0 25 0 5 0 496293203 279740416 39759 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364329 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=273184 CPUtime=101.95 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 21579 1253 0 0 10192 3 0 0 25 0 5 0 496293203 279740416 39759 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=273184 CPUtime=102.1 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 35520 1253 0 0 10207 3 0 0 25 0 5 0 496293203 279740416 39759 33554432000 4194304 4417332 140737357781248 18446744073709551615 4356760 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.91
Current children cumulated vsize (KiB) 273184

[startup+162.301 s]
/proc/loadavg: 8.07 6.80 6.30 9/186 5278
/proc/meminfo: memFree=19055384/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=323368 CPUtime=647.57 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 262397 1253 0 0 64719 38 0 0 25 0 5 0 496293184 331128832 52297 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 80842 52297 181 55 0 78728 0
[pid=5255/tid=5262] ppid=5253 vsize=323368 CPUtime=162.1 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 66831 1253 0 0 16200 10 0 0 25 0 5 0 496293203 331128832 52297 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=323368 CPUtime=161.22 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 81917 1253 0 0 16109 13 0 0 25 0 5 0 496293203 331128832 52297 33554432000 4194304 4417332 140737357781248 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=323368 CPUtime=161.94 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 37161 1253 0 0 16188 6 0 0 25 0 5 0 496293203 331128832 52297 33554432000 4194304 4417332 140737357781248 18446744073709551615 4251272 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=323368 CPUtime=162.1 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 66907 1253 0 0 16203 7 0 0 25 0 5 0 496293203 331128832 52297 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.57
Current children cumulated vsize (KiB) 323368


################
# More data... #
################

[pid=5255/tid=5263] ppid=5253 vsize=610156 CPUtime=757.93 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 305790 1253 0 0 75748 45 0 0 25 0 5 0 496293203 624799744 123994 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=610156 CPUtime=761.96 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 69428 1253 0 0 76186 10 0 0 25 0 5 0 496293203 624799744 123994 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=610156 CPUtime=762.11 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 292758 1253 0 0 76173 38 0 0 25 0 5 0 496293203 624799744 123994 33554432000 4194304 4417332 140737357781248 18446744073709551615 4353472 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3044.34
Current children cumulated vsize (KiB) 610156

[startup+822.301 s]
/proc/loadavg: 8.13 7.98 7.21 9/186 5295
/proc/meminfo: memFree=18636596/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=514772 CPUtime=3284 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 990969 1253 0 0 328260 140 0 0 25 0 5 0 496293184 527126528 100148 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 128693 100148 181 55 0 126579 0
[pid=5255/tid=5262] ppid=5253 vsize=514772 CPUtime=822.11 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 234388 1253 0 0 82178 33 0 0 25 0 5 0 496293203 527126528 100148 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=514772 CPUtime=817.6 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 320100 1253 0 0 81713 47 0 0 25 0 5 0 496293203 527126528 100148 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=514772 CPUtime=821.96 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 90592 1253 0 0 82183 13 0 0 25 0 5 0 496293203 527126528 100148 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=514772 CPUtime=822.11 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 336308 1253 0 0 82167 44 0 0 25 0 5 0 496293203 527126528 100148 33554432000 4194304 4417332 140737357781248 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3284
Current children cumulated vsize (KiB) 514772

[startup+882.306 s]
/proc/loadavg: 8.08 7.99 7.27 9/186 5297
/proc/meminfo: memFree=18626900/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=559968 CPUtime=3523.7 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1048415 1253 0 0 352222 148 0 0 25 0 5 0 496293184 573407232 111447 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 139992 111447 181 55 0 137878 0
[pid=5255/tid=5262] ppid=5253 vsize=559968 CPUtime=882.11 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 250628 1253 0 0 88176 35 0 0 25 0 5 0 496293203 573407232 111447 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=559968 CPUtime=877.28 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 324607 1253 0 0 87681 47 0 0 25 0 5 0 496293203 573407232 111447 33554432000 4194304 4417332 140737357781248 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=559968 CPUtime=881.96 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 97693 1253 0 0 88182 14 0 0 25 0 5 0 496293203 573407232 111447 33554432000 4194304 4417332 140737357781248 18446744073709551615 4232623 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=559968 CPUtime=882.12 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 365906 1253 0 0 88164 48 0 0 25 0 5 0 496293203 573407232 111447 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3523.7
Current children cumulated vsize (KiB) 559968

[startup+942.301 s]
/proc/loadavg: 8.07 8.00 7.31 9/186 5299
/proc/meminfo: memFree=18725596/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=513720 CPUtime=3763.36 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1097898 1253 0 0 376181 155 0 0 25 0 5 0 496293184 526049280 99917 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 128430 99917 181 55 0 126316 0
[pid=5255/tid=5262] ppid=5253 vsize=513720 CPUtime=942.11 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 277855 1253 0 0 94171 40 0 0 25 0 5 0 496293203 526049280 99917 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=513720 CPUtime=936.96 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 324607 1253 0 0 93648 48 0 0 25 0 5 0 496293203 526049280 99917 33554432000 4194304 4417332 140737357781248 18446744073709551615 4365007 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=513720 CPUtime=941.96 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 101789 1253 0 0 94181 15 0 0 25 0 5 0 496293203 526049280 99917 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=513720 CPUtime=942.12 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 384066 1253 0 0 94162 50 0 0 25 0 5 0 496293203 526049280 99917 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3763.36
Current children cumulated vsize (KiB) 513720

[startup+1002.3 s]
/proc/loadavg: 8.06 8.02 7.36 9/186 5300
/proc/meminfo: memFree=18668052/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=498512 CPUtime=4003.04 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1150638 1253 0 0 400141 163 0 0 25 0 5 0 496293184 510476288 96083 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 124628 96083 181 55 0 122514 0
[pid=5255/tid=5262] ppid=5253 vsize=498512 CPUtime=1002.12 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 294802 1253 0 0 100169 43 0 0 25 0 5 0 496293203 510476288 96083 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=498512 CPUtime=996.63 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 333385 1253 0 0 99614 49 0 0 25 0 5 0 496293203 510476288 96083 33554432000 4194304 4417332 140737357781248 18446744073709551615 4251091 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=498512 CPUtime=1001.96 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 104304 1253 0 0 100180 16 0 0 25 0 5 0 496293203 510476288 96083 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=498512 CPUtime=1002.11 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 408566 1253 0 0 100158 53 0 0 25 0 5 0 496293203 510476288 96083 33554432000 4194304 4417332 140737357781248 18446744073709551615 4250599 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4003.04
Current children cumulated vsize (KiB) 498512

[startup+1062.3 s]
/proc/loadavg: 8.13 8.04 7.40 9/186 5302
/proc/meminfo: memFree=18543044/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=504480 CPUtime=4242.72 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1200091 1253 0 0 424103 169 0 0 25 0 5 0 496293184 516587520 97575 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 126120 97575 181 55 0 124006 0
[pid=5255/tid=5262] ppid=5253 vsize=504480 CPUtime=1062.11 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 297299 1253 0 0 106168 43 0 0 25 0 5 0 496293203 516587520 97575 33554432000 4194304 4417332 140737357781248 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=504480 CPUtime=1056.31 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 346202 1253 0 0 105581 50 0 0 25 0 5 0 496293203 516587520 97575 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=504480 CPUtime=1061.97 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 104304 1253 0 0 106181 16 0 0 25 0 5 0 496293203 516587520 97575 33554432000 4194304 4417332 140737357781248 18446744073709551615 4365862 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=504480 CPUtime=1062.11 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 442705 1253 0 0 106154 57 0 0 25 0 5 0 496293203 516587520 97575 33554432000 4194304 4417332 140737357781248 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4242.72
Current children cumulated vsize (KiB) 504480

[startup+1122.3 s]
/proc/loadavg: 8.08 8.05 7.44 9/186 5303
/proc/meminfo: memFree=18689232/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=511540 CPUtime=4482.4 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1275550 1253 0 0 448061 179 0 0 25 0 5 0 496293184 523816960 99340 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 127885 99340 181 55 0 125771 0
[pid=5255/tid=5262] ppid=5253 vsize=511540 CPUtime=1122.11 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 316572 1253 0 0 112166 45 0 0 25 0 5 0 496293203 523816960 99340 33554432000 4194304 4417332 140737357781248 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=511540 CPUtime=1115.98 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 372594 1253 0 0 111544 54 0 0 25 0 5 0 496293203 523816960 99340 33554432000 4194304 4417332 140737357781248 18446744073709551615 4365994 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=511540 CPUtime=1121.97 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 104304 1253 0 0 112181 16 0 0 25 0 5 0 496293203 523816960 99340 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=511540 CPUtime=1122.12 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 472499 1253 0 0 112151 61 0 0 25 0 5 0 496293203 523816960 99340 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 511540

[startup+1182.3 s]
/proc/loadavg: 6.03 7.51 7.30 5/176 5323
/proc/meminfo: memFree=19047188/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=655268 CPUtime=4722.12 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1347532 1253 0 0 472022 190 0 0 25 0 5 0 496293184 670994432 135272 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 163817 135272 181 55 0 161703 0
[pid=5255/tid=5262] ppid=5253 vsize=655268 CPUtime=1182.12 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 337517 1253 0 0 118164 48 0 0 25 0 5 0 496293203 670994432 135272 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=655268 CPUtime=1175.7 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 395121 1253 0 0 117512 58 0 0 25 0 5 0 496293203 670994432 135272 33554432000 4194304 4417332 140737357781248 18446744073709551615 4365065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=655268 CPUtime=1181.97 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 108400 1253 0 0 118180 17 0 0 25 0 5 0 496293203 670994432 135272 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=655268 CPUtime=1182.11 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 496913 1253 0 0 118147 64 0 0 25 0 5 0 496293203 670994432 135272 33554432000 4194304 4417332 140737357781248 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4722.12
Current children cumulated vsize (KiB) 655268



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 5.45 7.28 7.23 5/176 5324
/proc/meminfo: memFree=19172784/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=545352 CPUtime=4800.05 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1349700 1253 0 0 479814 191 0 0 25 0 5 0 496293184 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 136338 103810 181 55 0 134224 0
[pid=5255/tid=5262] ppid=5253 vsize=545352 CPUtime=1201.62 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 337517 1253 0 0 120114 48 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4250476 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=545352 CPUtime=1195.1 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 397240 1253 0 0 119452 58 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=545352 CPUtime=1201.47 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 108400 1253 0 0 120130 17 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=545352 CPUtime=1201.63 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 496962 1253 0 0 120098 65 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4356756 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 545352

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.8 s]
/proc/loadavg: 5.45 7.28 7.23 5/176 5324
/proc/meminfo: memFree=19172784/32951124 swapFree=67111524/67111528
[pid=5255] ppid=5253 vsize=545352 CPUtime=4800.05 cores=0,2,4,6
/proc/5255/stat : 5255 (plingeling) S 5253 5255 3973 0 -1 4202496 1349700 1253 0 0 479814 191 0 0 25 0 5 0 496293184 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5255/statm: 136338 103810 181 55 0 134224 0
[pid=5255/tid=5262] ppid=5253 vsize=545352 CPUtime=1201.62 cores=0,2,4,6
/proc/5255/task/5262/stat : 5262 (plingeling) R 5253 5255 3973 0 -1 4202560 337517 1253 0 0 120114 48 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4250476 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5255/tid=5263] ppid=5253 vsize=545352 CPUtime=1195.1 cores=0,2,4,6
/proc/5255/task/5263/stat : 5263 (plingeling) R 5253 5255 3973 0 -1 4202560 397240 1253 0 0 119452 58 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5255/tid=5264] ppid=5253 vsize=545352 CPUtime=1201.47 cores=0,2,4,6
/proc/5255/task/5264/stat : 5264 (plingeling) R 5253 5255 3973 0 -1 4202560 108400 1253 0 0 120130 17 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5255/tid=5265] ppid=5253 vsize=545352 CPUtime=1201.63 cores=0,2,4,6
/proc/5255/task/5265/stat : 5265 (plingeling) R 5253 5255 3973 0 -1 4202560 496962 1253 0 0 120098 65 0 0 25 0 5 0 496293203 558440448 103810 33554432000 4194304 4417332 140737357781248 18446744073709551615 4356756 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 545352

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.83
CPU time (s): 4800.1
CPU user time (s): 4798.17
CPU system time (s): 1.93271
CPU usage (%): 399.399
Max. virtual memory (cumulated for all children) (KiB): 671396

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.17
system time used= 1.93271
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1350953
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 90
involuntary context switches= 23843

runsolver used 1.85972 second user time and 4.55031 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-29 02:59:31
IDJOB=3281111
IDBENCH=20523
IDSOLVER=1605
FILE ID=node144/3281111-1304038770
RUNJOBID= node144-1304038663-5151
PBS_JOBID= 13170308
Free space on /tmp= 72404 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT07/industrial/IBM_FV_2002_13_rule_1/SAT_dat.k45.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3281111-1304038770/watcher-3281111-1304038770 -o /tmp/evaluation-result-3281111-1304038770/solver-3281111-1304038770 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3281111-1304038770.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8a76c8add64173ae39149aae572a02d9
RANDOM SEED=64688254

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19443736 kB
Buffers:       2204072 kB
Cached:       10534668 kB
SwapCached:          4 kB
Active:        4744524 kB
Inactive:      8199472 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19443736 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            3692 kB
Writeback:           0 kB
AnonPages:      204576 kB
Mapped:          15312 kB
Slab:           499092 kB
PageTables:       4788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   388932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72408 MiB
End job on node144 at 2011-04-29 03:19:34