Trace number 3728839

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.02MSAT (TO) 1800.46 900.381

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900670234--soft-0-100-0.wbo
MD5SUM68083219a398085883a8cf7e46688b9f
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark140.925
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 134314
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 134313
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 641
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3728839-1338674721.wbo.
0.00/0.00	c Instance file HOME/instance-3728839-1338674721.wbo
0.00/0.00	c File size is 96731 bytes.
0.00/0.01	c Highest Coefficient sum: 641
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      2938                                                |
0.00/0.01	c |  Number Clauses:        2684                                                |
0.00/0.01	c |  Number Cardinality:    0                                                   |
0.00/0.01	c |  Number PB Constraints: 23                                                  |
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    PB Constraint                                       |
0.00/0.01	c |                                                                             |
0.00/0.01	c ===============================================================================
1800.03/900.31	o 980
1800.03/900.31	o 947
1800.03/900.31	o 881
1800.03/900.31	o 501
1800.03/900.31	o 455
1800.03/900.31	o 383
1800.03/900.31	o 365
1800.03/900.31	o 358
1800.03/900.31	o 346
1800.03/900.31	o 339
1800.03/900.31	o 336
1800.03/900.31	o 332
1800.03/900.31	o 323
1800.03/900.31	o 309
1800.03/900.31	o 263
1800.03/900.31	o 258
1800.03/900.31	o 252
1800.03/900.31	o 243
1800.03/900.31	o 219
1800.03/900.31	o 216
1800.03/900.31	o 215
1800.03/900.31	o 211
1800.03/900.31	o 190
1800.03/900.31	o 173
1800.03/900.31	o 168
1800.03/900.31	o 167
1800.03/900.31	o 132
1800.03/900.31	o 130
1800.03/900.31	o 129
1800.03/900.31	o 107
1800.03/900.31	o 105
1800.03/900.31	o 86
1800.03/900.31	o 83
1800.03/900.31	o 82
1800.03/900.31	o 66
1800.03/900.31	o 65
1800.03/900.31	o 60
1800.03/900.31	o 50
1800.03/900.31	o 49
1800.03/900.31	o 48
1800.03/900.31	o 46
1800.03/900.31	o 44
1800.03/900.31	o 41
1800.03/900.31	o 32
1800.03/900.31	o 31
1800.03/900.31	o 29
1800.03/900.31	o 25
1800.03/900.31	o 18
1800.03/900.31	o 17
1800.03/900.31	o 16
1800.03/900.31	o 14
1800.03/900.31	o 13
1800.03/900.31	o 12
1800.03/900.31	o 9
1800.03/900.31	o 8
1800.03/900.31	o 7
1800.03/900.31	o 5
1800.03/900.31	o 4
1800.03/900.31	o 2
1800.03/900.31	o 1
1800.03/900.31	c ===============================================================================
1800.03/900.31	c Wall Clock Time: 900.31 s
1800.03/900.31	c Best Solution: 1
1800.03/900.31	s SATISFIABLE
1800.03/900.31	v -x1 -x2 -x3 x4 -x5 -x6 -x7 -x8 x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 x118 -x119 -x120 -x121 -x122 x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 x168 -x169 -x170 -x171 x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 x201 -x202 -x203 -x204 -x205 -x206 -x207 x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 x231

Verifier Data 

OK	1

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3728839-1338674721/watcher-3728839-1338674721 -o /tmp/evaluation-result-3728839-1338674721/solver-3728839-1338674721 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728839-1338674721.wbo 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.69 2.17 2.05 4/178 29225
/proc/meminfo: memFree=31417212/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=4572 CPUtime=0 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) R 29223 29225 28198 0 -1 4202496 436 0 0 0 0 0 0 0 20 0 1 0 333599026 4681728 389 33554432000 4194304 5964478 140735564644160 140735309706056 4395529 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 1143 389 168 433 0 683 0

[startup+0.0894351 s]
/proc/loadavg: 2.69 2.17 2.05 4/178 29225
/proc/meminfo: memFree=31417212/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164272 CPUtime=0.15 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 2888 0 0 0 15 0 0 0 20 0 3 0 333599026 168214528 2369 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41068 2369 198 433 0 40632 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 164272

[startup+0.100188 s]
/proc/loadavg: 2.69 2.17 2.05 4/178 29225
/proc/meminfo: memFree=31417212/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164272 CPUtime=0.17 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 2922 0 0 0 17 0 0 0 20 0 3 0 333599026 168214528 2403 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41068 2403 198 433 0 40632 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 164272

[startup+0.300133 s]
/proc/loadavg: 2.69 2.17 2.05 4/178 29225
/proc/meminfo: memFree=31417212/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164272 CPUtime=0.57 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 5367 0 0 0 56 1 0 0 20 0 3 0 333599026 168214528 3461 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41068 3461 198 433 0 40632 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 164272

[startup+0.700134 s]
/proc/loadavg: 2.69 2.17 2.05 4/178 29225
/proc/meminfo: memFree=31417212/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164272 CPUtime=1.37 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 7573 0 0 0 135 2 0 0 20 0 3 0 333599026 168214528 4770 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41068 4770 198 433 0 40632 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 164272

[startup+1.50028 s]
/proc/loadavg: 2.69 2.17 2.05 5/181 29228
/proc/meminfo: memFree=31396364/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164272 CPUtime=2.97 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 10066 0 0 0 294 3 0 0 20 0 3 0 333599026 168214528 6670 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41068 6670 198 433 0 40632 0
[pid=29225/tid=29227] ppid=29223 vsize=164272 CPUtime=1.47 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 3453 0 0 0 145 2 0 0 20 0 3 0 333599027 168214528 6670 33554432000 4194304 5964478 140735564644160 140196655618040 4399920 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=164272 CPUtime=1.47 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 5521 0 0 0 145 2 0 0 20 0 3 0 333599027 168214528 6670 33554432000 4194304 5964478 140735564644160 140196645128856 4390878 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 164272

[startup+3.10026 s]
/proc/loadavg: 2.79 2.20 2.06 5/181 29228
/proc/meminfo: memFree=31388924/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164272 CPUtime=6.16 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 11836 0 0 0 613 3 0 0 20 0 3 0 333599026 168214528 8119 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41068 8119 198 433 0 40632 0
[pid=29225/tid=29227] ppid=29223 vsize=164272 CPUtime=3.07 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 4462 0 0 0 305 2 0 0 20 0 3 0 333599027 168214528 8119 33554432000 4194304 5964478 140735564644160 140196655618040 4399920 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=164272 CPUtime=3.07 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 6282 0 0 0 305 2 0 0 20 0 3 0 333599027 168214528 8119 33554432000 4194304 5964478 140735564644160 140196645128416 4403721 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.16
Current children cumulated vsize (KiB) 164272

[startup+6.30029 s]
/proc/loadavg: 2.79 2.20 2.06 5/181 29228
/proc/meminfo: memFree=31375656/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164272 CPUtime=12.56 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 15648 0 0 0 1252 4 0 0 20 0 3 0 333599026 168214528 11669 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41068 11669 198 433 0 40632 0
[pid=29225/tid=29227] ppid=29223 vsize=164272 CPUtime=6.27 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 7551 0 0 0 624 3 0 0 20 0 3 0 333599027 168214528 11669 33554432000 4194304 5964478 140735564644160 140196655617848 4400033 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=164272 CPUtime=6.27 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 7005 0 0 0 625 2 0 0 20 0 3 0 333599027 168214528 11669 33554432000 4194304 5964478 140735564644160 140196645128552 4403717 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 164272

[startup+12.7003 s]
/proc/loadavg: 2.98 2.26 2.08 5/181 29268
/proc/meminfo: memFree=31367292/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=164676 CPUtime=25.36 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 24398 0 0 0 2524 12 0 0 20 0 3 0 333599026 168628224 20005 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 41169 20005 198 433 0 40733 0
[pid=29225/tid=29227] ppid=29223 vsize=164676 CPUtime=12.66 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 13450 0 0 0 1261 5 0 0 20 0 3 0 333599027 168628224 20005 33554432000 4194304 5964478 140735564644160 140196655618040 4399920 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=164676 CPUtime=12.67 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 9856 0 0 0 1260 7 0 0 20 0 3 0 333599027 168628224 20005 33554432000 4194304 5964478 140735564644160 140196645128856 4403721 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 164676

[startup+25.5004 s]
/proc/loadavg: 3.14 2.31 2.10 5/181 29268
/proc/meminfo: memFree=31169352/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=296852 CPUtime=50.95 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 54108 0 0 0 5073 22 0 0 20 0 3 0 333599026 303976448 49963 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 74213 49963 198 433 0 73777 0
[pid=29225/tid=29227] ppid=29223 vsize=296852 CPUtime=25.45 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 31349 0 0 0 2534 11 0 0 20 0 3 0 333599027 303976448 49963 33554432000 4194304 5964478 140735564644160 140196655618040 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=296852 CPUtime=25.47 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 21667 0 0 0 2536 11 0 0 20 0 3 0 333599027 303976448 49963 33554432000 4194304 5964478 140735564644160 140196645128504 4222464 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 296852

[startup+51.1004 s]
/proc/loadavg: 3.50 2.46 2.16 5/181 29268
/proc/meminfo: memFree=30794576/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=495224 CPUtime=102.11 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 99613 0 0 0 10176 35 0 0 20 0 3 0 333599026 507109376 95452 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 123806 95452 198 433 0 123370 0
[pid=29225/tid=29227] ppid=29223 vsize=495224 CPUtime=51.03 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 59293 0 0 0 5084 19 0 0 20 0 3 0 333599027 507109376 95452 33554432000 4194304 5964478 140735564644160 140196655618040 4400103 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=495224 CPUtime=51.07 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 39228 0 0 0 5090 17 0 0 20 0 3 0 333599027 507109376 95452 33554432000 4194304 5964478 140735564644160 140196645128504 4400087 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.11
Current children cumulated vsize (KiB) 495224

[startup+102.307 s]
/proc/loadavg: 3.80 2.72 2.26 5/181 29268
/proc/meminfo: memFree=30290816/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=759480 CPUtime=204.47 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 168985 0 0 0 20393 54 0 0 20 0 3 0 333599026 777707520 164791 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 189870 164791 198 433 0 189434 0
[pid=29225/tid=29227] ppid=29223 vsize=759480 CPUtime=102.23 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 88857 0 0 0 10194 29 0 0 20 0 3 0 333599027 777707520 164791 33554432000 4194304 5964478 140735564644160 140196655618040 4400067 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=759480 CPUtime=102.25 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 79036 0 0 0 10196 29 0 0 20 0 3 0 333599027 777707520 164791 33554432000 4194304 5964478 140735564644160 140196645128504 4400103 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.47
Current children cumulated vsize (KiB) 759480

[startup+162.3 s]
/proc/loadavg: 3.92 2.93 2.36 5/181 29269
/proc/meminfo: memFree=30040992/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=826168 CPUtime=324.44 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 181518 0 0 0 32385 59 0 0 20 0 3 0 333599026 845996032 178528 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 206542 178528 198 433 0 206106 0
[pid=29225/tid=29227] ppid=29223 vsize=826168 CPUtime=162.23 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 98900 0 0 0 16189 34 0 0 20 0 3 0 333599027 845996032 178528 33554432000 4194304 5964478 140735564644160 140196655618072 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=826168 CPUtime=162.24 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 81526 0 0 0 16193 31 0 0 20 0 3 0 333599027 845996032 178528 33554432000 4194304 5964478 140735564644160 140196645128536 4400056 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.44
Current children cumulated vsize (KiB) 826168

[startup+222.3 s]
/proc/loadavg: 3.97 3.14 2.47 5/181 29269
/proc/meminfo: memFree=29553020/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1089588 CPUtime=444.41 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 256150 0 0 0 44353 88 0 0 20 0 3 0 333599026 1115738112 253160 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 272397 253160 198 433 0 271961 0
[pid=29225/tid=29227] ppid=29223 vsize=1089588 CPUtime=222.23 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 136906 0 0 0 22174 49 0 0 20 0 3 0 333599027 1115738112 253160 33554432000 4194304 5964478 140735564644160 140196655618040 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1089588 CPUtime=222.25 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 118152 0 0 0 22179 46 0 0 20 0 3 0 333599027 1115738112 253160 33554432000 4194304 5964478 140735564644160 140196645128608 4399912 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.41
Current children cumulated vsize (KiB) 1089588

[startup+282.3 s]
/proc/loadavg: 3.99 3.28 2.55 5/182 29272
/proc/meminfo: memFree=29325368/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1090564 CPUtime=564.41 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 266270 0 0 0 56347 94 0 0 20 0 3 0 333599026 1116737536 263102 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 272641 263102 198 433 0 272205 0
[pid=29225/tid=29227] ppid=29223 vsize=1090564 CPUtime=282.24 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 146796 0 0 0 28169 55 0 0 20 0 3 0 333599027 1116737536 263102 33554432000 4194304 5964478 140735564644160 140196655617952 4400401 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1090564 CPUtime=282.25 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 118382 0 0 0 28177 48 0 0 20 0 3 0 333599027 1116737536 263102 33554432000 4194304 5964478 140735564644160 140196645128536 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.41
Current children cumulated vsize (KiB) 1090564

[startup+342.3 s]
/proc/loadavg: 3.99 3.42 2.65 5/181 29272
/proc/meminfo: memFree=29150076/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1222616 CPUtime=684.38 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 285658 0 0 0 68337 101 0 0 20 0 3 0 333599026 1251958784 282490 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 305654 282490 198 433 0 305218 0
[pid=29225/tid=29227] ppid=29223 vsize=1222616 CPUtime=342.24 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 146806 0 0 0 34168 56 0 0 20 0 3 0 333599027 1251958784 282490 33554432000 4194304 5964478 140735564644160 140196655617952 4400091 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1222616 CPUtime=342.25 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 137760 0 0 0 34169 56 0 0 20 0 3 0 333599027 1251958784 282490 33554432000 4194304 5964478 140735564644160 140196645128264 4391160 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.38
Current children cumulated vsize (KiB) 1222616

[startup+402.3 s]
/proc/loadavg: 3.99 3.51 2.72 5/181 29272
/proc/meminfo: memFree=29096908/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1222920 CPUtime=804.37 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 300049 0 0 0 80329 108 0 0 20 0 3 0 333599026 1252270080 296666 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 305730 296666 198 433 0 305294 0
[pid=29225/tid=29227] ppid=29223 vsize=1222920 CPUtime=402.24 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 161121 0 0 0 40161 63 0 0 20 0 3 0 333599027 1252270080 296666 33554432000 4194304 5964478 140735564644160 140196655618040 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1222920 CPUtime=402.26 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 137836 0 0 0 40168 58 0 0 20 0 3 0 333599027 1252270080 296666 33554432000 4194304 5964478 140735564644160 140196645128264 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.37
Current children cumulated vsize (KiB) 1222920

[startup+462.3 s]
/proc/loadavg: 3.99 3.60 2.80 5/181 29273
/proc/meminfo: memFree=28908208/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1355280 CPUtime=924.35 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 336247 0 0 0 92308 127 0 0 20 0 3 0 333599026 1387806720 332837 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 338820 332837 198 433 0 338384 0
[pid=29225/tid=29227] ppid=29223 vsize=1355280 CPUtime=462.25 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 197160 0 0 0 46142 83 0 0 20 0 3 0 333599027 1387806720 332837 33554432000 4194304 5964478 140735564644160 140196655618040 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1355280 CPUtime=462.26 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 137995 0 0 0 46167 59 0 0 20 0 3 0 333599027 1387806720 332837 33554432000 4194304 5964478 140735564644160 140196645128264 4399986 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.35
Current children cumulated vsize (KiB) 1355280

[startup+522.3 s]
/proc/loadavg: 4.03 3.68 2.88 5/181 29273
/proc/meminfo: memFree=28574012/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1618444 CPUtime=1044.3 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 397435 0 0 0 104279 151 0 0 20 0 3 0 333599026 1657286656 394263 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 404611 394263 198 433 0 404175 0
[pid=29225/tid=29227] ppid=29223 vsize=1618444 CPUtime=522.24 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 228055 0 0 0 52126 98 0 0 20 0 3 0 333599027 1657286656 394263 33554432000 4194304 5964478 140735564644160 140196655618040 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1618444 CPUtime=522.25 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 168288 0 0 0 52156 69 0 0 20 0 3 0 333599027 1657286656 394263 33554432000 4194304 5964478 140735564644160 140196645128264 4388309 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.3
Current children cumulated vsize (KiB) 1618444

[startup+582.3 s]
/proc/loadavg: 4.01 3.74 2.94 5/181 29273
/proc/meminfo: memFree=28295288/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1750180 CPUtime=1164.26 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 426889 0 0 0 116260 166 0 0 20 0 3 0 333599026 1792184320 422887 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 437545 422887 198 433 0 437109 0
[pid=29225/tid=29227] ppid=29223 vsize=1750180 CPUtime=582.22 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 257349 0 0 0 58109 113 0 0 20 0 3 0 333599027 1792184320 422887 33554432000 4194304 5964478 140735564644160 140196655618040 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1750180 CPUtime=582.24 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 168448 0 0 0 58154 70 0 0 20 0 3 0 333599027 1792184320 422887 33554432000 4194304 5964478 140735564644160 140196645128536 4399938 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.26
Current children cumulated vsize (KiB) 1750180

[startup+642.3 s]
/proc/loadavg: 4.00 3.79 3.01 5/181 29273
/proc/meminfo: memFree=28076084/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1883740 CPUtime=1284.24 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 452914 0 0 0 128242 182 0 0 20 0 3 0 333599026 1928949760 448906 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 470935 448906 198 433 0 470499 0
[pid=29225/tid=29227] ppid=29223 vsize=1883740 CPUtime=642.2 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 283091 0 0 0 64090 130 0 0 20 0 3 0 333599027 1928949760 448906 33554432000 4194304 5964478 140735564644160 140196655618040 4400103 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1883740 CPUtime=642.25 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 168731 0 0 0 64154 71 0 0 20 0 3 0 333599027 1928949760 448906 33554432000 4194304 5964478 140735564644160 140196645128264 4400097 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.24
Current children cumulated vsize (KiB) 1883740

[startup+702.3 s]
/proc/loadavg: 4.04 3.83 3.07 5/181 29273
/proc/meminfo: memFree=27796616/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1950604 CPUtime=1404.18 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 474076 0 0 0 140226 192 0 0 20 0 3 0 333599026 1997418496 470044 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 487651 470044 198 433 0 487215 0
[pid=29225/tid=29227] ppid=29223 vsize=1950604 CPUtime=702.18 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 303928 0 0 0 70077 141 0 0 20 0 3 0 333599027 1997418496 470044 33554432000 4194304 5964478 140735564644160 140196655618040 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1950604 CPUtime=702.24 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 169056 0 0 0 70152 72 0 0 20 0 3 0 333599027 1997418496 470044 33554432000 4194304 5964478 140735564644160 140196645128264 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.18
Current children cumulated vsize (KiB) 1950604

[startup+762.307 s]
/proc/loadavg: 4.01 3.86 3.13 5/181 29274
/proc/meminfo: memFree=27691556/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1951172 CPUtime=1524.14 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 474251 0 0 0 152222 192 0 0 20 0 3 0 333599026 1998000128 470202 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 487793 470202 198 433 0 487357 0
[pid=29225/tid=29227] ppid=29223 vsize=1951172 CPUtime=762.16 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 303972 0 0 0 76074 142 0 0 20 0 3 0 333599027 1998000128 470202 33554432000 4194304 5964478 140735564644160 140196655618040 4400078 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1951172 CPUtime=762.24 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 169187 0 0 0 76151 73 0 0 20 0 3 0 333599027 1998000128 470202 33554432000 4194304 5964478 140735564644160 140196645128264 18446744073699066224 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.14
Current children cumulated vsize (KiB) 1951172

[startup+822.3 s]
/proc/loadavg: 4.00 3.89 3.18 5/181 29274
/proc/meminfo: memFree=27591144/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1951952 CPUtime=1644.08 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 474466 0 0 0 164216 192 0 0 20 0 3 0 333599026 1998798848 470395 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 487988 470395 198 433 0 487552 0
[pid=29225/tid=29227] ppid=29223 vsize=1951952 CPUtime=822.14 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 304009 0 0 0 82071 143 0 0 20 0 3 0 333599027 1998798848 470395 33554432000 4194304 5964478 140735564644160 140196655618040 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1951952 CPUtime=822.23 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 169365 0 0 0 82149 74 0 0 20 0 3 0 333599027 1998798848 470395 33554432000 4194304 5964478 140735564644160 140196645128264 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.08
Current children cumulated vsize (KiB) 1951952

[startup+882.3 s]
/proc/loadavg: 4.00 3.90 3.23 5/182 29277
/proc/meminfo: memFree=27374032/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1952240 CPUtime=1764.03 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 474595 0 0 0 176211 192 0 0 20 0 3 0 333599026 1999093760 470479 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 488060 470479 198 433 0 487624 0
[pid=29225/tid=29227] ppid=29223 vsize=1952240 CPUtime=882.14 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 304028 0 0 0 88070 144 0 0 20 0 3 0 333599027 1999093760 470479 33554432000 4194304 5964478 140735564644160 140196655617952 4410814 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1952240 CPUtime=882.2 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 169475 0 0 0 88145 75 0 0 20 0 3 0 333599027 1999093760 470479 33554432000 4194304 5964478 140735564644160 140196645128264 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.03
Current children cumulated vsize (KiB) 1952240



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.91 3.24 5/182 29277
/proc/meminfo: memFree=27340528/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1952452 CPUtime=1800.03 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 474654 0 0 0 179811 192 0 0 20 0 3 0 333599026 1999310848 470525 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 488113 470525 198 433 0 487677 0
[pid=29225/tid=29227] ppid=29223 vsize=1952452 CPUtime=900.13 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 304043 0 0 0 89869 144 0 0 20 0 3 0 333599027 1999310848 470525 33554432000 4194304 5964478 140735564644160 140196655617952 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1952452 CPUtime=900.21 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 169519 0 0 0 89946 75 0 0 20 0 3 0 333599027 1999310848 470525 33554432000 4194304 5964478 140735564644160 140196645128264 4400091 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 1952452

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.91 3.24 5/182 29277
/proc/meminfo: memFree=27340528/32873844 swapFree=7116/7116
[pid=29225] ppid=29223 vsize=1952452 CPUtime=1800.03 cores=0,2,4,6
/proc/29225/stat : 29225 (pwbo2.02) S 29223 29225 28198 0 -1 4202496 474654 0 0 0 179811 192 0 0 20 0 3 0 333599026 1999310848 470525 33554432000 4194304 5964478 140735564644160 140735564643680 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29225/statm: 488113 470525 198 433 0 487677 0
[pid=29225/tid=29227] ppid=29223 vsize=1952452 CPUtime=900.13 cores=0,2,4,6
/proc/29225/task/29227/stat : 29227 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 304043 0 0 0 89869 144 0 0 20 0 3 0 333599027 1999310848 470525 33554432000 4194304 5964478 140735564644160 140196655617952 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=29225/tid=29228] ppid=29223 vsize=1952452 CPUtime=900.21 cores=0,2,4,6
/proc/29225/task/29228/stat : 29228 (pwbo2.02) R 29223 29225 28198 0 -1 4202560 169519 0 0 0 89946 75 0 0 20 0 3 0 333599027 1999310848 470525 33554432000 4194304 5964478 140735564644160 140196645128264 4400091 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 1952452

Child status: 0
Real time (s): 900.381
CPU time (s): 1800.46
CPU user time (s): 1798.17
CPU system time (s): 2.28165
CPU usage (%): 199.966
Max. virtual memory (cumulated for all children) (KiB): 1952452

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.17
system time used= 2.28165
maximum resident set size= 1882104
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 474655
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1062
involuntary context switches= 1963

runsolver used 1.87172 second user time and 5.17321 second system time

The end

Launcher Data 

Begin job on node111 at 2012-06-03 00:05:21
IDJOB=3728839
IDBENCH=79269
IDSOLVER=2316
FILE ID=node111/3728839-1338674721
RUNJOBID= node111-1338674690-29115
PBS_JOBID= 14636481
Free space on /tmp= 67392 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900670234--soft-0-100-0.wbo
COMMAND LINE= pwbo2.02 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3728839-1338674721/watcher-3728839-1338674721 -o /tmp/evaluation-result-3728839-1338674721/solver-3728839-1338674721 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728839-1338674721.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 68083219a398085883a8cf7e46688b9f
RANDOM SEED=525533983

node111.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.30
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31417864 kB
Buffers:          160584 kB
Cached:           457356 kB
SwapCached:         1352 kB
Active:           189060 kB
Inactive:         482848 kB
Active(anon):      55244 kB
Inactive(anon):     1120 kB
Active(file):     133816 kB
Inactive(file):   481728 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67100048 kB
Dirty:             11492 kB
Writeback:             0 kB
AnonPages:         60120 kB
Mapped:             9524 kB
Shmem:                 0 kB
Slab:             645276 kB
SReclaimable:      87200 kB
SUnreclaim:       558076 kB
KernelStack:        1504 kB
PageTables:         4224 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     156692 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     16384 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 67384 MiB
End job on node111 at 2012-06-03 00:20:23