Trace number 3728875

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.02MSAT (TO) 1800.47 900.323

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/roussel/
normalized-pigeon-cardinality-25-20--soft-0-100-0.wbo
MD5SUM3ef623ad54bc9b8a55f5198a1c4abc02
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark4
Best CPU time to get the best result obtained on this benchmark0.024996
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables500
Total number of constraints45
Number of soft constraints45
Number of constraints which are clauses25
Number of constraints which are cardinality constraints (but not clauses)20
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint20
Maximum length of a constraint25
Top cost 1950
Min constraint cost 1
Max constraint cost 99
Sum of constraints costs 1949
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 26
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3728875-1338674487.wbo.
0.00/0.00	c Instance file HOME/instance-3728875-1338674487.wbo
0.00/0.00	c File size is 8595 bytes.
0.00/0.00	c Highest Coefficient sum: 26
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      545                                                 |
0.00/0.00	c |  Number Clauses:        25                                                  |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 20                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.14/900.31	o 173
1800.14/900.31	o 113
1800.14/900.31	o 112
1800.14/900.31	o 29
1800.14/900.31	o 25
1800.14/900.31	o 17
1800.14/900.31	o 4
1800.14/900.31	c ===============================================================================
1800.14/900.31	c Wall Clock Time: 900.31 s
1800.14/900.31	c Best Solution: 4
1800.14/900.31	s SATISFIABLE
1800.14/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 x40 -x41 x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 x199 -x200 -x201 -x202 -x203 -x204 -x205 x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231 -x232 x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 x248 -x249 -x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267 -x268 x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 -x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 x313 -x314 -x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 -x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 x338 -x339 -x340 x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 -x354 -x355 -x356 -x357 -x358 -x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 -x373 -x374 -x375 x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 -x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 x433 -x434 -x435 -x436 -x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 x453 -x454 -x455 -x456 -x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 -x494 -x495 -x496 -x497 -x498 -x499 -x500

Verifier Data 

OK	4

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3728875-1338674487/watcher-3728875-1338674487 -o /tmp/evaluation-result-3728875-1338674487/solver-3728875-1338674487 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728875-1338674487.wbo 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.00 3.92 1/177 6645
/proc/meminfo: memFree=28919972/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=163084 CPUtime=0 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 1173 0 0 0 0 0 0 0 20 0 3 0 333573468 166998016 1123 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 40771 1125 204 433 0 40335 0
[pid=6645/tid=6646] ppid=6643 vsize=163084 CPUtime=0 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 95 0 0 0 0 0 0 0 20 0 3 0 333573469 166998016 1129 33554432000 4194304 5964478 140735330289984 139898651531304 4382286 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=163084 CPUtime=0 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 278 0 0 0 0 0 0 0 20 0 3 0 333573469 166998016 1131 33554432000 4194304 5964478 140735330289984 139898641041192 5136490 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0

[startup+0.098287 s]
/proc/loadavg: 4.00 4.00 3.92 1/177 6645
/proc/meminfo: memFree=28919972/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=181368 CPUtime=0.18 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 8259 0 0 0 15 3 0 0 20 0 3 0 333573468 185720832 8200 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45342 8200 206 433 0 44906 0
[pid=6645/tid=6646] ppid=6643 vsize=181368 CPUtime=0.08 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 352 0 0 0 8 0 0 0 20 0 3 0 333573469 185720832 8200 33554432000 4194304 5964478 140735330289984 139898651531304 4400401 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=181368 CPUtime=0.08 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 7099 0 0 0 5 3 0 0 20 0 3 0 333573469 185720832 8200 33554432000 4194304 5964478 140735330289984 139898641041400 4400760 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 181368

[startup+0.100283 s]
/proc/loadavg: 4.00 4.00 3.92 1/177 6645
/proc/meminfo: memFree=28919972/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=181368 CPUtime=0.18 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 8270 0 0 0 15 3 0 0 20 0 3 0 333573468 185720832 8211 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45342 8213 206 433 0 44906 0
[pid=6645/tid=6646] ppid=6643 vsize=181368 CPUtime=0.08 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 356 0 0 0 8 0 0 0 20 0 3 0 333573469 185720832 8213 33554432000 4194304 5964478 140735330289984 139898651531304 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=181368 CPUtime=0.08 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 7108 0 0 0 5 3 0 0 20 0 3 0 333573469 185720832 8213 33554432000 4194304 5964478 140735330289984 139898641041400 4400760 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 181368

[startup+0.300264 s]
/proc/loadavg: 4.00 4.00 3.92 1/177 6645
/proc/meminfo: memFree=28919972/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=181704 CPUtime=0.58 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 8874 0 0 0 53 5 0 0 20 0 3 0 333573468 186064896 9439 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45426 9439 206 433 0 44990 0
[pid=6645/tid=6646] ppid=6643 vsize=181704 CPUtime=0.28 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 780 0 0 0 26 2 0 0 20 0 3 0 333573469 186064896 9439 33554432000 4194304 5964478 140735330289984 139898651531256 4400056 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=181704 CPUtime=0.28 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 7286 0 0 0 25 3 0 0 20 0 3 0 333573469 186064896 9439 33554432000 4194304 5964478 140735330289984 139898641041720 4409285 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 181704

[startup+0.700222 s]
/proc/loadavg: 4.00 4.00 3.92 1/177 6645
/proc/meminfo: memFree=28919972/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=181704 CPUtime=1.37 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 10102 0 0 0 132 5 0 0 20 0 3 0 333573468 186064896 10667 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45426 10667 206 433 0 44990 0
[pid=6645/tid=6646] ppid=6643 vsize=181704 CPUtime=0.68 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 1415 0 0 0 65 3 0 0 20 0 3 0 333573469 186064896 10667 33554432000 4194304 5964478 140735330289984 139898651531304 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=181704 CPUtime=0.67 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 7879 0 0 0 64 3 0 0 20 0 3 0 333573469 186064896 10667 33554432000 4194304 5964478 140735330289984 139898641041768 4400115 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 181704

[startup+1.50024 s]
/proc/loadavg: 4.00 4.00 3.92 5/184 6688
/proc/meminfo: memFree=28868044/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=181704 CPUtime=2.98 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 11846 0 0 0 292 6 0 0 20 0 3 0 333573468 186064896 12411 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45426 12411 206 433 0 44990 0
[pid=6645/tid=6646] ppid=6643 vsize=181704 CPUtime=1.48 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 2389 0 0 0 145 3 0 0 20 0 3 0 333573469 186064896 12411 33554432000 4194304 5964478 140735330289984 139898651531064 4400115 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=181704 CPUtime=1.47 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 8649 0 0 0 144 3 0 0 20 0 3 0 333573469 186064896 12411 33554432000 4194304 5964478 140735330289984 139898641041720 18446744073699066235 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 181704

[startup+3.10029 s]
/proc/loadavg: 4.00 4.00 3.92 5/184 6688
/proc/meminfo: memFree=28857016/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=181848 CPUtime=6.18 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 13475 0 0 0 611 7 0 0 20 0 3 0 333573468 186212352 14040 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45462 14040 206 433 0 45026 0
[pid=6645/tid=6646] ppid=6643 vsize=181848 CPUtime=3.08 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 3149 0 0 0 304 4 0 0 20 0 3 0 333573469 186212352 14040 33554432000 4194304 5964478 140735330289984 139898651531256 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=181848 CPUtime=3.07 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 9518 0 0 0 304 3 0 0 20 0 3 0 333573469 186212352 14040 33554432000 4194304 5964478 140735330289984 139898641041528 4400087 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 181848

[startup+6.30026 s]
/proc/loadavg: 4.00 4.00 3.92 5/184 6688
/proc/meminfo: memFree=28838548/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=181920 CPUtime=12.57 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 15696 0 0 0 1249 8 0 0 20 0 3 0 333573468 186286080 16261 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45480 16261 206 433 0 45044 0
[pid=6645/tid=6646] ppid=6643 vsize=181920 CPUtime=6.28 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 4749 0 0 0 624 4 0 0 20 0 3 0 333573469 186286080 16261 33554432000 4194304 5964478 140735330289984 139898651531256 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=181920 CPUtime=6.27 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 10139 0 0 0 623 4 0 0 20 0 3 0 333573469 186286080 16261 33554432000 4194304 5964478 140735330289984 139898641041720 4400091 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 181920

[startup+12.7003 s]
/proc/loadavg: 4.00 4.00 3.92 5/184 6688
/proc/meminfo: memFree=28808488/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=182064 CPUtime=25.36 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 18858 0 0 0 2527 9 0 0 20 0 3 0 333573468 186433536 19418 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45516 19418 206 433 0 45080 0
[pid=6645/tid=6646] ppid=6643 vsize=182064 CPUtime=12.68 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 6524 0 0 0 1263 5 0 0 20 0 3 0 333573469 186433536 19418 33554432000 4194304 5964478 140735330289984 139898651531256 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=182064 CPUtime=12.67 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 11526 0 0 0 1262 5 0 0 20 0 3 0 333573469 186433536 19418 33554432000 4194304 5964478 140735330289984 139898641041528 4400103 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 182064

[startup+25.5003 s]
/proc/loadavg: 4.00 4.00 3.92 4/179 6698
/proc/meminfo: memFree=28819040/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=182244 CPUtime=50.94 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 25750 0 0 0 5083 11 0 0 20 0 3 0 333573468 186617856 26348 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 45561 26348 206 433 0 45125 0
[pid=6645/tid=6646] ppid=6643 vsize=182244 CPUtime=25.48 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 9984 0 0 0 2542 6 0 0 20 0 3 0 333573469 186617856 26348 33554432000 4194304 5964478 140735330289984 139898651531064 4400056 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=182244 CPUtime=25.46 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 14958 0 0 0 2540 6 0 0 20 0 3 0 333573469 186617856 26348 33554432000 4194304 5964478 140735330289984 139898641041528 4400115 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 182244

[startup+51.1003 s]
/proc/loadavg: 4.00 4.00 3.92 5/183 6728
/proc/meminfo: memFree=28708392/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=251884 CPUtime=102.14 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 40203 0 0 0 10195 19 0 0 20 0 3 0 333573468 257929216 41993 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 62971 41993 206 433 0 62535 0
[pid=6645/tid=6646] ppid=6643 vsize=251884 CPUtime=51.08 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 13466 0 0 0 5099 9 0 0 20 0 3 0 333573469 257929216 41993 33554432000 4194304 5964478 140735330289984 139898651531256 4400067 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=251884 CPUtime=51.06 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 25929 0 0 0 5095 11 0 0 20 0 3 0 333573469 257929216 41993 33554432000 4194304 5964478 140735330289984 139898641041720 4400087 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 251884

[startup+102.307 s]
/proc/loadavg: 4.00 4.00 3.92 5/183 6768
/proc/meminfo: memFree=28639696/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=320312 CPUtime=204.51 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 53127 0 0 0 20421 30 0 0 20 0 3 0 333573468 327999488 54988 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 80078 54988 206 433 0 79642 0
[pid=6645/tid=6646] ppid=6643 vsize=320312 CPUtime=102.28 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 16748 0 0 0 10216 12 0 0 20 0 3 0 333573469 327999488 54988 33554432000 4194304 5964478 140735330289984 139898651531256 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=320312 CPUtime=102.25 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 35571 0 0 0 10204 21 0 0 20 0 3 0 333573469 327999488 54988 33554432000 4194304 5964478 140735330289984 139898641041720 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.51
Current children cumulated vsize (KiB) 320312

[startup+162.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/183 6848
/proc/meminfo: memFree=28648784/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=389064 CPUtime=324.43 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 60192 0 0 0 32402 41 0 0 20 0 3 0 333573468 398401536 62163 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 97266 62163 206 433 0 96830 0
[pid=6645/tid=6646] ppid=6643 vsize=389064 CPUtime=162.25 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 18264 0 0 0 16209 16 0 0 20 0 3 0 333573469 398401536 62163 33554432000 4194304 5964478 140735330289984 139898651531256 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=389064 CPUtime=162.21 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 41120 0 0 0 16191 30 0 0 20 0 3 0 333573469 398401536 62163 33554432000 4194304 5964478 140735330289984 139898641041720 4400087 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.43
Current children cumulated vsize (KiB) 389064

[startup+222.3 s]
/proc/loadavg: 3.91 3.97 3.91 5/183 6849
/proc/meminfo: memFree=28533012/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=458192 CPUtime=444.39 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 74590 0 0 0 44369 70 0 0 20 0 3 0 333573468 469188608 76630 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 114548 76630 206 433 0 114112 0
[pid=6645/tid=6646] ppid=6643 vsize=458192 CPUtime=222.25 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 18267 0 0 0 22208 17 0 0 20 0 3 0 333573469 469188608 76630 33554432000 4194304 5964478 140735330289984 139898651531256 4400103 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=458192 CPUtime=222.2 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 55515 0 0 0 22159 61 0 0 20 0 3 0 333573469 469188608 76630 33554432000 4194304 5964478 140735330289984 139898641041528 4400115 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.39
Current children cumulated vsize (KiB) 458192

################
# More data... #
################

/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 19853 0 0 0 28205 20 0 0 20 0 3 0 333573469 471986176 90142 33554432000 4194304 5964478 140735330289984 139898651531256 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=460924 CPUtime=282.2 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 67441 0 0 0 28133 87 0 0 20 0 3 0 333573469 471986176 90142 33554432000 4194304 5964478 140735330289984 139898641041720 4400087 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.37
Current children cumulated vsize (KiB) 460924

[startup+342.3 s]
/proc/loadavg: 3.98 3.97 3.91 5/183 6889
/proc/meminfo: memFree=28011604/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=461932 CPUtime=684.35 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 95693 0 0 0 68325 110 0 0 20 0 3 0 333573468 473018368 97733 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 115483 97733 206 433 0 115047 0
[pid=6645/tid=6646] ppid=6643 vsize=461932 CPUtime=342.26 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 22798 0 0 0 34201 25 0 0 20 0 3 0 333573469 473018368 97733 33554432000 4194304 5964478 140735330289984 139898651531256 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=461932 CPUtime=342.2 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 72087 0 0 0 34123 97 0 0 20 0 3 0 333573469 473018368 97733 33554432000 4194304 5964478 140735330289984 139898641041528 4400087 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.35
Current children cumulated vsize (KiB) 461932

[startup+402.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/183 6889
/proc/meminfo: memFree=27836668/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=529068 CPUtime=804.34 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 98864 0 0 0 80319 115 0 0 20 0 3 0 333573468 541765632 100904 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 132267 100904 206 433 0 131831 0
[pid=6645/tid=6646] ppid=6643 vsize=529068 CPUtime=402.26 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 22807 0 0 0 40200 26 0 0 20 0 3 0 333573469 541765632 100904 33554432000 4194304 5964478 140735330289984 139898651531256 4400091 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=529068 CPUtime=402.2 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 75249 0 0 0 40118 102 0 0 20 0 3 0 333573469 541765632 100904 33554432000 4194304 5964478 140735330289984 139898641041720 4400056 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.34
Current children cumulated vsize (KiB) 529068

[startup+462.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/183 6889
/proc/meminfo: memFree=27741668/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=529644 CPUtime=924.31 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 102254 0 0 0 92310 121 0 0 20 0 3 0 333573468 542355456 104354 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 132411 104354 206 433 0 131975 0
[pid=6645/tid=6646] ppid=6643 vsize=529644 CPUtime=462.26 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 22809 0 0 0 46199 27 0 0 20 0 3 0 333573469 542355456 104354 33554432000 4194304 5964478 140735330289984 139898651531256 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=529644 CPUtime=462.19 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 78637 0 0 0 46109 110 0 0 20 0 3 0 333573469 542355456 104354 33554432000 4194304 5964478 140735330289984 139898641041528 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.31
Current children cumulated vsize (KiB) 529644

[startup+522.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/184 6893
/proc/meminfo: memFree=27489784/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=531120 CPUtime=1044.24 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 105401 0 0 0 104298 126 0 0 20 0 3 0 333573468 543866880 107570 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 132780 107570 206 433 0 132344 0
[pid=6645/tid=6646] ppid=6643 vsize=531120 CPUtime=522.25 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 22825 0 0 0 52198 27 0 0 20 0 3 0 333573469 543866880 107570 33554432000 4194304 5964478 140735330289984 139898651531256 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=531120 CPUtime=522.15 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 81768 0 0 0 52100 115 0 0 20 0 3 0 333573469 543866880 107570 33554432000 4194304 5964478 140735330289984 139898641041720 4400091 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.24
Current children cumulated vsize (KiB) 531120

[startup+582.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/183 6893
/proc/meminfo: memFree=27266344/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=533260 CPUtime=1164.22 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 109862 0 0 0 116289 133 0 0 20 0 3 0 333573468 546058240 112090 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 133315 112090 206 433 0 132879 0
[pid=6645/tid=6646] ppid=6643 vsize=533260 CPUtime=582.26 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 22828 0 0 0 58198 28 0 0 20 0 3 0 333573469 546058240 112090 33554432000 4194304 5964478 140735330289984 139898651531256 4400089 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=533260 CPUtime=582.14 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 86226 0 0 0 58091 123 0 0 20 0 3 0 333573469 546058240 112090 33554432000 4194304 5964478 140735330289984 139898641041768 4400056 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.22
Current children cumulated vsize (KiB) 533260

[startup+642.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/183 6893
/proc/meminfo: memFree=27118660/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=536308 CPUtime=1284.21 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 114196 0 0 0 128284 137 0 0 20 0 3 0 333573468 549179392 116424 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 134077 116424 206 433 0 133641 0
[pid=6645/tid=6646] ppid=6643 vsize=536308 CPUtime=642.27 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 25378 0 0 0 64196 31 0 0 20 0 3 0 333573469 549179392 116424 33554432000 4194304 5964478 140735330289984 139898651531256 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=536308 CPUtime=642.15 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 88010 0 0 0 64089 126 0 0 20 0 3 0 333573469 549179392 116424 33554432000 4194304 5964478 140735330289984 139898641041720 4400087 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.21
Current children cumulated vsize (KiB) 536308

[startup+702.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/183 6893
/proc/meminfo: memFree=26971844/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=604704 CPUtime=1404.18 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 118952 0 0 0 140276 142 0 0 20 0 3 0 333573468 619216896 121176 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 151176 121176 206 433 0 150740 0
[pid=6645/tid=6646] ppid=6643 vsize=604704 CPUtime=702.26 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 27484 0 0 0 70193 33 0 0 20 0 3 0 333573469 619216896 121176 33554432000 4194304 5964478 140735330289984 139898651531064 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=604704 CPUtime=702.14 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 90660 0 0 0 70084 130 0 0 20 0 3 0 333573469 619216896 121176 33554432000 4194304 5964478 140735330289984 139898641041720 4400056 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.18
Current children cumulated vsize (KiB) 604704

[startup+762.307 s]
/proc/loadavg: 3.99 3.97 3.91 5/183 6893
/proc/meminfo: memFree=26822276/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=608300 CPUtime=1524.18 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 126656 0 0 0 152266 152 0 0 20 0 3 0 333573468 622899200 128880 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 152075 128880 206 433 0 151639 0
[pid=6645/tid=6646] ppid=6643 vsize=608300 CPUtime=762.27 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 28051 0 0 0 76193 34 0 0 20 0 3 0 333573469 622899200 128880 33554432000 4194304 5964478 140735330289984 139898651531064 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=608300 CPUtime=762.14 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 97797 0 0 0 76073 141 0 0 20 0 3 0 333573469 622899200 128880 33554432000 4194304 5964478 140735330289984 139898641041720 4400078 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.18
Current children cumulated vsize (KiB) 608300

[startup+822.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/183 6894
/proc/meminfo: memFree=26802592/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=609812 CPUtime=1644.14 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 131679 0 0 0 164255 159 0 0 20 0 3 0 333573468 624447488 133903 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 152453 133903 206 433 0 152017 0
[pid=6645/tid=6646] ppid=6643 vsize=609812 CPUtime=822.27 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 28343 0 0 0 82192 35 0 0 20 0 3 0 333573469 624447488 133903 33554432000 4194304 5964478 140735330289984 139898651531064 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=609812 CPUtime=822.14 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 102528 0 0 0 82065 149 0 0 20 0 3 0 333573469 624447488 133903 33554432000 4194304 5964478 140735330289984 139898641041720 4399932 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.14
Current children cumulated vsize (KiB) 609812

[startup+882.3 s]
/proc/loadavg: 4.04 3.99 3.91 5/183 6894
/proc/meminfo: memFree=26783464/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=612152 CPUtime=1764.13 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 136331 0 0 0 176247 166 0 0 20 0 3 0 333573468 626843648 138555 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 153038 138555 206 433 0 152602 0
[pid=6645/tid=6646] ppid=6643 vsize=612152 CPUtime=882.27 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 30691 0 0 0 88187 40 0 0 20 0 3 0 333573469 626843648 138555 33554432000 4194304 5964478 140735330289984 139898651531256 4400115 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=612152 CPUtime=882.13 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 104832 0 0 0 88060 153 0 0 20 0 3 0 333573469 626843648 138555 33554432000 4194304 5964478 140735330289984 139898641041720 4400091 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.13
Current children cumulated vsize (KiB) 612152



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.03 3.99 3.91 5/183 6894
/proc/meminfo: memFree=26777932/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=612260 CPUtime=1800.14 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 137662 0 0 0 179846 168 0 0 20 0 3 0 333573468 626954240 139886 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 153065 139886 206 433 0 152629 0
[pid=6645/tid=6646] ppid=6643 vsize=612260 CPUtime=900.28 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 31434 0 0 0 89987 41 0 0 20 0 3 0 333573469 626954240 139886 33554432000 4194304 5964478 140735330289984 139898651531304 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=612260 CPUtime=900.14 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 105420 0 0 0 89860 154 0 0 20 0 3 0 333573469 626954240 139886 33554432000 4194304 5964478 140735330289984 139898641041720 4400056 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.14
Current children cumulated vsize (KiB) 612260

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.03 3.99 3.91 5/183 6894
/proc/meminfo: memFree=26777932/32873844 swapFree=7380/7380
[pid=6645] ppid=6643 vsize=612260 CPUtime=1800.14 cores=0,2,4,6
/proc/6645/stat : 6645 (pwbo2.02) S 6643 6645 5745 0 -1 4202496 137662 0 0 0 179846 168 0 0 20 0 3 0 333573468 626954240 139886 33554432000 4194304 5964478 140735330289984 140735330289504 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6645/statm: 153065 139886 206 433 0 152629 0
[pid=6645/tid=6646] ppid=6643 vsize=612260 CPUtime=900.28 cores=0,2,4,6
/proc/6645/task/6646/stat : 6646 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 31434 0 0 0 89987 41 0 0 20 0 3 0 333573469 626954240 139886 33554432000 4194304 5964478 140735330289984 139898651531304 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=6645/tid=6647] ppid=6643 vsize=612260 CPUtime=900.14 cores=0,2,4,6
/proc/6645/task/6647/stat : 6647 (pwbo2.02) R 6643 6645 5745 0 -1 4202560 105420 0 0 0 89860 154 0 0 20 0 3 0 333573469 626954240 139886 33554432000 4194304 5964478 140735330289984 139898641041720 4400056 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.14
Current children cumulated vsize (KiB) 612260

Child status: 0
Real time (s): 900.323
CPU time (s): 1800.47
CPU user time (s): 1798.49
CPU system time (s): 1.9817
CPU usage (%): 199.98
Max. virtual memory (cumulated for all children) (KiB): 612260

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.49
system time used= 1.9817
maximum resident set size= 559552
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 137664
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 414
involuntary context switches= 2109

runsolver used 1.80272 second user time and 5.12522 second system time

The end

Launcher Data 

Begin job on node133 at 2012-06-03 00:01:27
IDJOB=3728875
IDBENCH=79187
IDSOLVER=2316
FILE ID=node133/3728875-1338674487
RUNJOBID= node133-1338669974-6147
PBS_JOBID= 14636490
Free space on /tmp= 70480 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/roussel/normalized-pigeon-cardinality-25-20--soft-0-100-0.wbo
COMMAND LINE= pwbo2.02 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3728875-1338674487/watcher-3728875-1338674487 -o /tmp/evaluation-result-3728875-1338674487/solver-3728875-1338674487 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728875-1338674487.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3ef623ad54bc9b8a55f5198a1c4abc02
RANDOM SEED=968108173

node133.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28920476 kB
Buffers:          366612 kB
Cached:          2700824 kB
SwapCached:          676 kB
Active:          1343780 kB
Inactive:        1738144 kB
Active(anon):       6048 kB
Inactive(anon):    10240 kB
Active(file):    1337732 kB
Inactive(file):  1727904 kB
Unevictable:        7380 kB
Mlocked:            7380 kB
SwapTotal:      67108856 kB
SwapFree:       67107040 kB
Dirty:              5512 kB
Writeback:             0 kB
AnonPages:         20832 kB
Mapped:            10336 kB
Shmem:                 0 kB
Slab:             732624 kB
SReclaimable:     174616 kB
SUnreclaim:       558008 kB
KernelStack:        1464 kB
PageTables:         3980 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     137072 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70472 MiB
End job on node133 at 2012-06-03 00:16:29