Trace number 3728822

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.02MSAT (TO) 1800.14 900.511

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900558739--soft-0-100-0.wbo
MD5SUM96d1f19cba40c7363abd0128bfda9b7c
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark53.1659
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 137973
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 137972
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 649
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3728822-1338674713.wbo.
0.00/0.00	c Instance file HOME/instance-3728822-1338674713.wbo
0.00/0.00	c File size is 96802 bytes.
0.00/0.01	c Highest Coefficient sum: 649
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      2938                                                |
0.00/0.01	c |  Number Clauses:        2684                                                |
0.00/0.01	c |  Number Cardinality:    0                                                   |
0.00/0.01	c |  Number PB Constraints: 23                                                  |
0.00/0.01	c |                                                                             |
0.00/0.02	c |  Problem Type:          Optimization                                        |
0.00/0.02	c |  Objective Function:    PB Constraint                                       |
0.00/0.02	c |                                                                             |
0.00/0.02	c ===============================================================================
1800.14/900.41	o 431
1800.14/900.41	o 399
1800.14/900.41	o 391
1800.14/900.41	o 389
1800.14/900.41	o 381
1800.14/900.41	o 378
1800.14/900.41	o 342
1800.14/900.41	o 337
1800.14/900.41	o 313
1800.14/900.41	o 305
1800.14/900.41	o 304
1800.14/900.41	o 302
1800.14/900.41	o 293
1800.14/900.41	o 287
1800.14/900.41	o 282
1800.14/900.41	o 273
1800.14/900.41	o 260
1800.14/900.41	o 257
1800.14/900.41	o 255
1800.14/900.41	o 231
1800.14/900.41	o 225
1800.14/900.41	o 222
1800.14/900.41	o 217
1800.14/900.41	o 212
1800.14/900.41	o 209
1800.14/900.41	o 190
1800.14/900.41	o 187
1800.14/900.41	o 181
1800.14/900.41	o 177
1800.14/900.41	o 172
1800.14/900.41	o 159
1800.14/900.41	o 158
1800.14/900.41	o 156
1800.14/900.41	o 149
1800.14/900.41	o 146
1800.14/900.41	o 140
1800.14/900.41	o 137
1800.14/900.41	o 131
1800.14/900.41	o 118
1800.14/900.41	o 112
1800.14/900.41	o 102
1800.14/900.41	o 96
1800.14/900.41	o 94
1800.14/900.41	o 93
1800.14/900.41	o 79
1800.14/900.41	o 68
1800.14/900.41	o 66
1800.14/900.41	o 62
1800.14/900.41	o 61
1800.14/900.41	o 57
1800.14/900.41	o 39
1800.14/900.41	o 38
1800.14/900.41	o 32
1800.14/900.41	o 31
1800.14/900.41	o 30
1800.14/900.41	o 14
1800.14/900.41	o 11
1800.14/900.41	o 6
1800.14/900.41	o 1
1800.14/900.41	c ===============================================================================
1800.14/900.41	c Wall Clock Time: 900.41 s
1800.14/900.41	c Best Solution: 1
1800.14/900.41	s SATISFIABLE
1800.14/900.41	v x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 x75 -x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 x110 -x111 -x112 -x113 x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 x161 -x162 -x163 -x164 -x165 x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 x177 -x178 -x179 -x180 -x181 x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 x229 -x230 -x231

Verifier Data 

OK	1

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3728822-1338674713/watcher-3728822-1338674713 -o /tmp/evaluation-result-3728822-1338674713/solver-3728822-1338674713 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728822-1338674713.wbo 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 2/174 6223
/proc/meminfo: memFree=29210572/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=4432 CPUtime=0 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) R 6220 6223 5748 0 -1 4202496 405 0 0 0 0 0 0 0 20 0 1 0 333596082 4538368 357 33554432000 4194304 5964478 140733653450976 140736257171496 4395199 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 1108 357 164 433 0 648 0

[startup+0.04229 s]
/proc/loadavg: 2.02 2.01 2.00 2/174 6223
/proc/meminfo: memFree=29210572/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=164272 CPUtime=0.05 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 2088 0 0 0 5 0 0 0 20 0 3 0 333596082 168214528 1882 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 41068 1882 198 433 0 40632 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 164272

[startup+0.100233 s]
/proc/loadavg: 2.02 2.01 2.00 2/174 6223
/proc/meminfo: memFree=29210572/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=164272 CPUtime=0.16 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 2890 0 0 0 16 0 0 0 20 0 3 0 333596082 168214528 2374 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 41068 2374 198 433 0 40632 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 164272

[startup+0.300126 s]
/proc/loadavg: 2.02 2.01 2.00 2/174 6223
/proc/meminfo: memFree=29210572/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=164272 CPUtime=0.56 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 4324 0 0 0 56 0 0 0 20 0 3 0 333596082 168214528 3296 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 41068 3296 198 433 0 40632 0
Current children cumulated CPU time (s) 0.56
Current children cumulated vsize (KiB) 164272

[startup+0.700133 s]
/proc/loadavg: 2.02 2.01 2.00 2/174 6223
/proc/meminfo: memFree=29210572/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=164272 CPUtime=1.36 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 6854 0 0 0 135 1 0 0 20 0 3 0 333596082 168214528 4698 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 41068 4698 198 433 0 40632 0
Current children cumulated CPU time (s) 1.36
Current children cumulated vsize (KiB) 164272

[startup+1.50025 s]
/proc/loadavg: 2.02 2.01 2.00 5/182 6231
/proc/meminfo: memFree=29170132/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=164272 CPUtime=2.96 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 9444 0 0 0 294 2 0 0 20 0 3 0 333596082 168214528 6159 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 41068 6159 198 433 0 40632 0
[pid=6223/tid=6230] ppid=6220 vsize=164272 CPUtime=1.46 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 3057 0 0 0 146 0 0 0 20 0 3 0 333596084 168214528 6159 33554432000 4194304 5964478 140733653450976 140724958308392 4409624 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=164272 CPUtime=1.46 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 5295 0 0 0 146 0 0 0 20 0 3 0 333596084 168214528 6159 33554432000 4194304 5964478 140733653450976 140724947819160 4403717 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 164272

[startup+3.10023 s]
/proc/loadavg: 2.18 2.04 2.01 5/182 6231
/proc/meminfo: memFree=29155112/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=164272 CPUtime=6.16 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 12259 0 0 0 613 3 0 0 20 0 3 0 333596082 168214528 8048 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 41068 8048 198 433 0 40632 0
[pid=6223/tid=6230] ppid=6220 vsize=164272 CPUtime=3.06 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 4467 0 0 0 305 1 0 0 20 0 3 0 333596084 168214528 8048 33554432000 4194304 5964478 140733653450976 140724958308344 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=164272 CPUtime=3.05 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 6700 0 0 0 305 0 0 0 20 0 3 0 333596084 168214528 8048 33554432000 4194304 5964478 140733653450976 140724947819160 4222416 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 6.16
Current children cumulated vsize (KiB) 164272

[startup+6.30029 s]
/proc/loadavg: 2.18 2.04 2.01 5/182 6231
/proc/meminfo: memFree=29103164/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=164408 CPUtime=12.56 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 19347 0 0 0 1251 5 0 0 20 0 3 0 333596082 168353792 15132 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 41102 15132 198 433 0 40666 0
[pid=6223/tid=6230] ppid=6220 vsize=164408 CPUtime=6.25 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 9974 0 0 0 622 3 0 0 20 0 3 0 333596084 168353792 15132 33554432000 4194304 5964478 140733653450976 140724958308392 4400115 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=164408 CPUtime=6.24 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 8281 0 0 0 623 1 0 0 20 0 3 0 333596084 168353792 15132 33554432000 4194304 5964478 140733653450976 140724947818808 5136420 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 164408

[startup+12.7003 s]
/proc/loadavg: 2.46 2.10 2.03 5/182 6231
/proc/meminfo: memFree=28938828/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=231036 CPUtime=25.36 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 41773 0 0 0 2525 11 0 0 20 0 3 0 333596082 236580864 37558 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 57759 37560 198 433 0 57323 0
[pid=6223/tid=6230] ppid=6220 vsize=231036 CPUtime=12.64 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 22321 0 0 0 1258 6 0 0 20 0 3 0 333596084 236580864 37560 33554432000 4194304 5964478 140733653450976 140724958308344 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=231036 CPUtime=12.63 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 18363 0 0 0 1259 4 0 0 20 0 3 0 333596084 236580864 37561 33554432000 4194304 5964478 140733653450976 140724947818808 5136420 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 231036

[startup+25.5003 s]
/proc/loadavg: 2.69 2.17 2.05 5/183 6232
/proc/meminfo: memFree=28645800/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=363124 CPUtime=50.95 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 84770 0 0 0 5072 23 0 0 20 0 3 0 333596082 371838976 80555 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 90781 80555 198 433 0 90345 0
[pid=6223/tid=6230] ppid=6220 vsize=363124 CPUtime=25.4 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 46894 0 0 0 2527 13 0 0 20 0 3 0 333596084 371838976 80555 33554432000 4194304 5964478 140733653450976 140724958308344 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=363124 CPUtime=25.39 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 36784 0 0 0 2530 9 0 0 20 0 3 0 333596084 371838976 80555 33554432000 4194304 5964478 140733653450976 140724947818808 4400067 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 363124

[startup+51.1003 s]
/proc/loadavg: 3.14 2.31 2.10 5/183 6232
/proc/meminfo: memFree=28356972/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=561652 CPUtime=102.14 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 115887 0 0 0 10181 33 0 0 20 0 3 0 333596082 575131648 111672 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 140413 111672 198 433 0 139977 0
[pid=6223/tid=6230] ppid=6220 vsize=561652 CPUtime=50.94 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 60166 0 0 0 5078 16 0 0 20 0 3 0 333596084 575131648 111672 33554432000 4194304 5964478 140733653450976 140724958308256 4381601 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=561652 CPUtime=50.92 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 54629 0 0 0 5076 16 0 0 20 0 3 0 333596084 575131648 111672 33554432000 4194304 5964478 140733653450976 140724947818568 4221120 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 561652

[startup+102.307 s]
/proc/loadavg: 3.65 2.59 2.20 5/183 6232
/proc/meminfo: memFree=28011304/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=694624 CPUtime=204.53 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 152609 0 0 0 20397 56 0 0 20 0 3 0 333596082 711294976 148375 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 173656 148375 198 433 0 173220 0
[pid=6223/tid=6230] ppid=6220 vsize=694624 CPUtime=102.01 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 70545 0 0 0 10180 21 0 0 20 0 3 0 333596084 711294976 148375 33554432000 4194304 5964478 140733653450976 140724958308344 4400067 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=694624 CPUtime=101.99 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 80972 0 0 0 10163 36 0 0 20 0 3 0 333596084 711294976 148375 33554432000 4194304 5964478 140733653450976 140724947818840 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.53
Current children cumulated vsize (KiB) 694624

[startup+162.3 s]
/proc/loadavg: 3.87 2.85 2.31 5/183 6233
/proc/meminfo: memFree=27581324/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=957972 CPUtime=324.47 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 220497 0 0 0 32360 87 0 0 20 0 3 0 333596082 980963328 216696 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 239493 216696 198 433 0 239057 0
[pid=6223/tid=6230] ppid=6220 vsize=957972 CPUtime=161.85 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 108055 0 0 0 16149 36 0 0 20 0 3 0 333596084 980963328 216696 33554432000 4194304 5964478 140733653450976 140724958308344 4400103 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=957972 CPUtime=161.81 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 111350 0 0 0 16127 54 0 0 20 0 3 0 333596084 980963328 216696 33554432000 4194304 5964478 140733653450976 140724947818568 4221120 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 324.47
Current children cumulated vsize (KiB) 957972

[startup+222.3 s]
/proc/loadavg: 3.95 3.05 2.42 5/183 6233
/proc/meminfo: memFree=27229628/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1089380 CPUtime=444.43 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 252677 0 0 0 44339 104 0 0 20 0 3 0 333596082 1115525120 248895 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 272345 248895 198 433 0 271909 0
[pid=6223/tid=6230] ppid=6220 vsize=1089380 CPUtime=221.66 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 132768 0 0 0 22117 49 0 0 20 0 3 0 333596084 1115525120 248895 33554432000 4194304 5964478 140733653450976 140724958308344 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1089380 CPUtime=221.65 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 118817 0 0 0 22105 60 0 0 20 0 3 0 333596084 1115525120 248895 33554432000 4194304 5964478 140733653450976 140724947818568 4400087 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.43
Current children cumulated vsize (KiB) 1089380

[startup+282.3 s]
/proc/loadavg: 3.98 3.22 2.51 5/183 6233
/proc/meminfo: memFree=26968636/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1155644 CPUtime=564.38 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 267689 0 0 0 56317 121 0 0 20 0 3 0 333596082 1183379456 263832 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 288911 263832 198 433 0 288475 0
[pid=6223/tid=6230] ppid=6220 vsize=1155644 CPUtime=281.51 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 132781 0 0 0 28101 50 0 0 20 0 3 0 333596084 1183379456 263832 33554432000 4194304 5964478 140733653450976 140724958308376 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1155644 CPUtime=281.46 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 133816 0 0 0 28068 78 0 0 20 0 3 0 333596084 1183379456 263832 33554432000 4194304 5964478 140733653450976 140724947818808 4400089 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.38
Current children cumulated vsize (KiB) 1155644

[startup+342.3 s]
/proc/loadavg: 4.07 3.39 2.61 5/184 6236
/proc/meminfo: memFree=26737520/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1222060 CPUtime=684.33 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 287473 0 0 0 68300 133 0 0 20 0 3 0 333596082 1251389440 283587 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 305515 283587 198 433 0 305079 0
[pid=6223/tid=6230] ppid=6220 vsize=1222060 CPUtime=341.33 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 152444 0 0 0 34069 64 0 0 20 0 3 0 333596084 1251389440 283587 33554432000 4194304 5964478 140733653450976 140724958308344 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1222060 CPUtime=341.29 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 133937 0 0 0 34050 79 0 0 20 0 3 0 333596084 1251389440 283587 33554432000 4194304 5964478 140733653450976 140724947818568 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.33
Current children cumulated vsize (KiB) 1222060

[startup+402.3 s]
/proc/loadavg: 4.02 3.50 2.70 5/183 6236
/proc/meminfo: memFree=26386016/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1550624 CPUtime=804.26 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 362608 0 0 0 80240 186 0 0 20 0 3 0 333596082 1587838976 358379 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 387656 358379 198 433 0 387220 0
[pid=6223/tid=6230] ppid=6220 vsize=1550624 CPUtime=401.17 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 190885 0 0 0 40031 86 0 0 20 0 3 0 333596084 1587838976 358379 33554432000 4194304 5964478 140733653450976 140724958308344 4399952 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1550624 CPUtime=401.1 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 170631 0 0 0 39998 112 0 0 20 0 3 0 333596084 1587838976 358379 33554432000 4194304 5964478 140733653450976 140724947818840 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.26
Current children cumulated vsize (KiB) 1550624

[startup+462.3 s]
/proc/loadavg: 4.01 3.59 2.78 5/183 6237
/proc/meminfo: memFree=26233152/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1616488 CPUtime=924.23 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 379182 0 0 0 92225 198 0 0 20 0 3 0 333596082 1655283712 374945 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 404122 374945 198 433 0 403686 0
[pid=6223/tid=6230] ppid=6220 vsize=1616488 CPUtime=461 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 207378 0 0 0 46003 97 0 0 20 0 3 0 333596084 1655283712 374945 33554432000 4194304 5964478 140733653450976 140724958308344 4400115 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1616488 CPUtime=460.92 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 170712 0 0 0 45980 112 0 0 20 0 3 0 333596084 1655283712 374945 33554432000 4194304 5964478 140733653450976 140724947818568 4400078 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.23
Current children cumulated vsize (KiB) 1616488

[startup+522.3 s]
/proc/loadavg: 4.00 3.65 2.84 5/183 6237
/proc/meminfo: memFree=26232808/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1616680 CPUtime=1044.18 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 379267 0 0 0 104220 198 0 0 20 0 3 0 333596082 1655480320 374922 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 404170 374922 198 433 0 403734 0
[pid=6223/tid=6230] ppid=6220 vsize=1616680 CPUtime=520.82 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 207426 0 0 0 51984 98 0 0 20 0 3 0 333596084 1655480320 374922 33554432000 4194304 5964478 140733653450976 140724958308376 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1616680 CPUtime=520.77 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 170749 0 0 0 51964 113 0 0 20 0 3 0 333596084 1655480320 374922 33554432000 4194304 5964478 140733653450976 140724947818840 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.18
Current children cumulated vsize (KiB) 1616680

[startup+582.3 s]
/proc/loadavg: 4.00 3.72 2.92 5/183 6237
/proc/meminfo: memFree=26135000/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1617296 CPUtime=1164.13 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 379454 0 0 0 116215 198 0 0 20 0 3 0 333596082 1656111104 375068 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 404324 375068 198 433 0 403888 0
[pid=6223/tid=6230] ppid=6220 vsize=1617296 CPUtime=580.63 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 207472 0 0 0 57964 99 0 0 20 0 3 0 333596084 1656111104 375068 33554432000 4194304 5964478 140733653450976 140724958308376 4400091 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1617296 CPUtime=580.61 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 170890 0 0 0 57947 114 0 0 20 0 3 0 333596084 1656111104 375068 33554432000 4194304 5964478 140733653450976 140724947818568 4400091 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.13
Current children cumulated vsize (KiB) 1617296

[startup+642.3 s]
/proc/loadavg: 4.00 3.77 2.98 5/183 6237
/proc/meminfo: memFree=26028884/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1617936 CPUtime=1284.08 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 379672 0 0 0 128210 198 0 0 20 0 3 0 333596082 1656766464 375227 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 404484 375227 198 433 0 404048 0
[pid=6223/tid=6230] ppid=6220 vsize=1617936 CPUtime=640.47 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 207488 0 0 0 63947 100 0 0 20 0 3 0 333596084 1656766464 375227 33554432000 4194304 5964478 140733653450976 140724958308376 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1617936 CPUtime=640.43 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 171092 0 0 0 63928 115 0 0 20 0 3 0 333596084 1656766464 375227 33554432000 4194304 5964478 140733653450976 140724947818568 4409635 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.08
Current children cumulated vsize (KiB) 1617936

[startup+702.3 s]
/proc/loadavg: 4.00 3.81 3.04 5/183 6237
/proc/meminfo: memFree=25904168/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1684040 CPUtime=1404.02 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 389356 0 0 0 140199 203 0 0 20 0 3 0 333596082 1724456960 384867 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 421010 384867 198 433 0 420574 0
[pid=6223/tid=6230] ppid=6220 vsize=1684040 CPUtime=700.3 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 217017 0 0 0 69924 106 0 0 20 0 3 0 333596084 1724456960 384867 33554432000 4194304 5964478 140733653450976 140724958308344 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1684040 CPUtime=700.25 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 171247 0 0 0 69908 117 0 0 20 0 3 0 333596084 1724456960 384867 33554432000 4194304 5964478 140733653450976 140724947818568 4400097 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.02
Current children cumulated vsize (KiB) 1684040

[startup+762.307 s]
/proc/loadavg: 4.00 3.84 3.10 5/183 6238
/proc/meminfo: memFree=25499608/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=1881472 CPUtime=1523.99 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 447789 0 0 0 152155 244 0 0 20 0 3 0 333596082 1926627328 444408 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 470368 444408 198 433 0 469932 0
[pid=6223/tid=6230] ppid=6220 vsize=1881472 CPUtime=760.14 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 252424 0 0 0 75888 126 0 0 20 0 3 0 333596084 1926627328 444408 33554432000 4194304 5964478 140733653450976 140724958308344 4400067 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=1881472 CPUtime=760.07 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 194273 0 0 0 75868 139 0 0 20 0 3 0 333596084 1926627328 444408 33554432000 4194304 5964478 140733653450976 140724947818808 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1523.99
Current children cumulated vsize (KiB) 1881472

[startup+822.3 s]
/proc/loadavg: 4.00 3.87 3.15 5/183 6238
/proc/meminfo: memFree=25156564/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=2013096 CPUtime=1643.95 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 481289 0 0 0 164128 267 0 0 20 0 3 0 333596082 2061410304 477908 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 503274 477908 198 433 0 502838 0
[pid=6223/tid=6230] ppid=6220 vsize=2013096 CPUtime=819.98 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 285824 0 0 0 81848 150 0 0 20 0 3 0 333596084 2061410304 477908 33554432000 4194304 5964478 140733653450976 140724958308344 4400097 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=2013096 CPUtime=819.91 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 194373 0 0 0 81851 140 0 0 20 0 3 0 333596084 2061410304 477908 33554432000 4194304 5964478 140733653450976 140724947818568 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1643.95
Current children cumulated vsize (KiB) 2013096

[startup+882.3 s]
/proc/loadavg: 4.00 3.89 3.20 5/183 6238
/proc/meminfo: memFree=24930292/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=2144640 CPUtime=1763.94 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 519067 0 0 0 176100 294 0 0 20 0 3 0 333596082 2196111360 515625 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 536160 515625 198 433 0 535724 0
[pid=6223/tid=6230] ppid=6220 vsize=2144640 CPUtime=879.83 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 323494 0 0 0 87805 178 0 0 20 0 3 0 333596084 2196111360 515625 33554432000 4194304 5964478 140733653450976 140724958308344 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=2144640 CPUtime=879.75 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 194481 0 0 0 87834 141 0 0 20 0 3 0 333596084 2196111360 515625 33554432000 4194304 5964478 140733653450976 140724947818840 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1763.94
Current children cumulated vsize (KiB) 2144640



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.4 s]
/proc/loadavg: 4.00 3.89 3.22 4/184 6242
/proc/meminfo: memFree=26274600/32873844 swapFree=7620/7620
[pid=6223] ppid=6220 vsize=2210984 CPUtime=1800.14 cores=0,2,4,6
/proc/6223/stat : 6223 (pwbo2.02) S 6220 6223 5748 0 -1 4202496 529217 0 0 0 179713 301 0 0 20 0 3 0 333596082 2264047616 525775 33554432000 4194304 5964478 140733653450976 140733653450496 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6223/statm: 552746 525775 198 433 0 552310 0
[pid=6223/tid=6230] ppid=6220 vsize=2210984 CPUtime=897.89 cores=0,2,4,6
/proc/6223/task/6230/stat : 6230 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 333612 0 0 0 89604 185 0 0 20 0 3 0 333596084 2264047616 525775 33554432000 4194304 5964478 140733653450976 140724958308344 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6223/tid=6231] ppid=6220 vsize=2210984 CPUtime=897.81 cores=0,2,4,6
/proc/6223/task/6231/stat : 6231 (pwbo2.02) R 6220 6223 5748 0 -1 4202560 194513 0 0 0 89640 141 0 0 20 0 3 0 333596084 2264047616 525775 33554432000 4194304 5964478 140733653450976 140724947818912 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.14
Current children cumulated vsize (KiB) 2210984

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6223 and gives
#  childrusage.ru_utime.tv_sec=1792
#  childrusage.ru_utime.tv_usec=467503
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=380486
# CPU time returned by wait4() is 1795.85
# while last known CPU time is 1800.14
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.511
CPU time (s): 1800.14
CPU user time (s): 1797.13
CPU system time (s): 3.01
CPU usage (%): 199.902
Max. virtual memory (cumulated for all children) (KiB): 2210984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.47
system time used= 3.38049
maximum resident set size= 2103124
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 529223
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1211
involuntary context switches= 2125

runsolver used 2.17067 second user time and 5.11522 second system time

The end

Launcher Data 

Begin job on node135 at 2012-06-03 00:05:13
IDJOB=3728822
IDBENCH=79260
IDSOLVER=2316
FILE ID=node135/3728822-1338674713
RUNJOBID= node135-1338674713-6198
PBS_JOBID= 14636508
Free space on /tmp= 70980 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900558739--soft-0-100-0.wbo
COMMAND LINE= pwbo2.02 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3728822-1338674713/watcher-3728822-1338674713 -o /tmp/evaluation-result-3728822-1338674713/solver-3728822-1338674713 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728822-1338674713.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 96d1f19cba40c7363abd0128bfda9b7c
RANDOM SEED=2146858080

node135.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5238.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29212264 kB
Buffers:          345264 kB
Cached:          2465032 kB
SwapCached:         1676 kB
Active:          1129744 kB
Inactive:        1692040 kB
Active(anon):       1568 kB
Inactive(anon):    12048 kB
Active(file):    1128176 kB
Inactive(file):  1679992 kB
Unevictable:        7620 kB
Mlocked:            7620 kB
SwapTotal:      67108856 kB
SwapFree:       67105796 kB
Dirty:             10848 kB
Writeback:             0 kB
AnonPages:         17280 kB
Mapped:             9620 kB
Shmem:               132 kB
Slab:             699772 kB
SReclaimable:     141256 kB
SUnreclaim:       558516 kB
KernelStack:        1416 kB
PageTables:         4188 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     103060 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70976 MiB
End job on node135 at 2012-06-03 00:20:15