Trace number 3704513

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)-26 1800.16 900.323

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mis/normalized-mis_100_10_2.opb
MD5SUM597624b9879736416e28e0a242fe0005
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-26
Best CPU time to get the best result obtained on this benchmark2.6406
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -26
Optimality of the best value was proved YES
Number of variables100
Total number of constraints100
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints100
Minimum length of a constraint10
Maximum length of a constraint20
Number of terms in the objective function 100
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 100
Number of bits of the sum of numbers in the objective function 7
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 100
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)1260
Sum of products size (including duplicates)2520
Number of different products630
Sum of products size1260

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3704513-1338091052.opb.
0.00/0.00	c Instance file HOME/instance-3704513-1338091052.opb
0.00/0.00	c File size is 49758 bytes.
0.00/0.00	c Cost Offset: -100
0.00/0.00	c Highest Coefficient sum: 20
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.01         s                                      |
0.00/0.00	c |  Number Variables:      730                                                 |
0.00/0.00	c |  Number Clauses:        630                                                 |
0.00/0.00	c |  Number Cardinality:    100                                                 |
0.00/0.00	c |  Number PB Constraints: 630                                                 |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.16/900.31	o -22
1800.16/900.31	o -23
1800.16/900.31	o -24
1800.16/900.31	o -25
1800.16/900.31	o -26
1800.16/900.31	c ===============================================================================
1800.16/900.31	c Wall Clock Time: 900.31 s
1800.16/900.31	c Best Solution: -26
1800.16/900.31	s SATISFIABLE
1800.16/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 x8 -x9 -x10 -x11 x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 x42 -x43 x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 x64 -x65 x66 -x67 x68 -x69 x70 -x71 x72 -x73 x74 x75 x76 -x77 x78 -x79 -x80 x81 -x82 -x83 x84 -x85 -x86 x87 -x88 -x89 -x90 x91 x92 -x93 x94 x95 -x96 x97 -x98 x99 x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267 -x268 -x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 -x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 -x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 -x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 -x339 -x340 -x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 -x354 -x355 -x356 -x357 -x358 -x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 -x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 -x433 -x434 -x435 -x436 -x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 -x456 -x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 -x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 -x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 -x494 -x495 -x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 -x510 -x511 -x512 -x513 -x514 -x515 -x516 -x517 -x518 -x519 -x520 -x521 -x522 -x523 -x524 -x525 -x526 -x527 -x528 -x529 -x530 -x531 -x532 -x533 -x534 -x535 -x536 -x537 -x538 -x539 -x540 -x541 -x542 -x543 -x544 -x545 -x546 -x547 -x548 -x549 -x550 -x551 -x552 -x553 -x554 -x555 -x556 -x557 -x558 -x559 -x560 -x561 -x562 -x563 -x564 -x565 -x566 -x567 -x568 -x569 -x570 -x571 -x572 -x573 -x574 -x575 -x576 -x577 -x578 -x579 -x580 -x581 -x582 -x583 -x584 -x585 -x586 -x587 -x588 -x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 -x597 -x598 -x599 -x600 -x601 -x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 -x615 -x616 -x617 -x618 -x619 -x620 -x621 -x622 -x623 -x624 -x625 -x626 -x627 -x628 -x629 -x630 -x631 -x632 -x633 -x634 -x635 -x636 -x637 -x638 -x639 -x640 -x641 -x642 -x643 -x644 -x645 -x646 -x647 -x648 -x649 -x650 -x651 -x652 -x653 -x654 -x655 -x656 -x657 -x658 -x659 -x660 -x661 -x662 -x663 -x664 -x665 -x666 -x667 -x668 -x669 -x670 -x671 -x672 -x673 -x674 -x675 -x676 -x677 -x678 -x679 -x680 -x681 -x682 -x683 -x684 -x685 -x686 -x687 -x688 -x689 -x690 -x691 -x692 -x693 -x694 -x695 -x696 -x697 -x698 -x699 -x700 -x701 -x702 -x703 -x704 -x705 -x706 -x707 -x708 -x709 -x710 -x711 -x712 -x713 -x714 -x715 -x716 -x717 -x718 -x719 -x720 -x721 -x722 -x723 -x724 -x725 -x726 -x727 -x728 -x729 -x730

Verifier Data 

OK	-26

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3704513-1338091052/watcher-3704513-1338091052 -o /tmp/evaluation-result-3704513-1338091052/solver-3704513-1338091052 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3704513-1338091052.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.69 3.93 3.79 4/180 11458
/proc/meminfo: memFree=27977732/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=4392 CPUtime=0 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) R 11456 11458 10899 0 -1 4202496 412 0 0 0 0 0 0 0 20 0 1 0 275230585 4497408 364 33554432000 4194304 5965102 140736943272656 140735144958072 5137146 0 0 4096 16387 0 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 1098 366 169 433 0 649 0

[startup+0.015147 s]
/proc/loadavg: 3.69 3.93 3.79 4/180 11458
/proc/meminfo: memFree=27977732/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163476 CPUtime=0.01 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 1358 0 0 0 1 0 0 0 20 0 3 0 275230585 167399424 1297 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40869 1297 204 433 0 40433 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 163476

[startup+0.100168 s]
/proc/loadavg: 3.69 3.93 3.79 4/180 11458
/proc/meminfo: memFree=27977732/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163476 CPUtime=0.18 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 1637 0 0 0 18 0 0 0 20 0 3 0 275230585 167399424 1576 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40869 1576 206 433 0 40433 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 163476

[startup+0.300119 s]
/proc/loadavg: 3.69 3.93 3.79 4/180 11458
/proc/meminfo: memFree=27977732/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163476 CPUtime=0.58 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 2288 0 0 0 57 1 0 0 20 0 3 0 275230585 167399424 2227 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40869 2227 206 433 0 40433 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 163476

[startup+0.700133 s]
/proc/loadavg: 3.69 3.93 3.79 4/180 11458
/proc/meminfo: memFree=27977732/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163476 CPUtime=1.37 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 3320 0 0 0 135 2 0 0 20 0 3 0 275230585 167399424 3259 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40869 3259 206 433 0 40433 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 163476

[startup+1.50025 s]
/proc/loadavg: 3.69 3.93 3.79 5/183 11461
/proc/meminfo: memFree=27956844/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163476 CPUtime=2.97 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 4305 0 0 0 294 3 0 0 20 0 3 0 275230585 167399424 4244 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40869 4244 206 433 0 40433 0
[pid=11458/tid=11460] ppid=11456 vsize=163476 CPUtime=1.47 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 1643 0 0 0 145 2 0 0 20 0 3 0 275230586 167399424 4244 33554432000 4194304 5965102 140736943272656 140110678866264 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=163476 CPUtime=1.47 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 1742 0 0 0 146 1 0 0 20 0 3 0 275230586 167399424 4244 33554432000 4194304 5965102 140736943272656 140110668376376 4393813 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 163476

[startup+3.10034 s]
/proc/loadavg: 3.69 3.93 3.79 5/183 11461
/proc/meminfo: memFree=27948784/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163620 CPUtime=6.18 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 5003 0 0 0 613 5 0 0 20 0 3 0 275230585 167546880 4942 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40905 4942 206 433 0 40469 0
[pid=11458/tid=11460] ppid=11456 vsize=163620 CPUtime=3.07 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 1901 0 0 0 305 2 0 0 20 0 3 0 275230586 167546880 4942 33554432000 4194304 5965102 140736943272656 140110678865720 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=163620 CPUtime=3.07 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 2182 0 0 0 305 2 0 0 20 0 3 0 275230586 167546880 4942 33554432000 4194304 5965102 140736943272656 140110668376312 18446744073699066235 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 163620

[startup+6.30037 s]
/proc/loadavg: 3.72 3.93 3.80 5/183 11461
/proc/meminfo: memFree=27928696/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163908 CPUtime=12.57 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 8083 0 0 0 1247 10 0 0 20 0 3 0 275230585 167841792 8022 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40977 8022 206 433 0 40541 0
[pid=11458/tid=11460] ppid=11456 vsize=163908 CPUtime=6.26 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 3185 0 0 0 623 3 0 0 20 0 3 0 275230586 167841792 8022 33554432000 4194304 5965102 140736943272656 140110678865912 4401143 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=163908 CPUtime=6.26 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 3978 0 0 0 619 7 0 0 20 0 3 0 275230586 167841792 8022 33554432000 4194304 5965102 140736943272656 140110668376376 18446744073699066235 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 163908

[startup+12.7004 s]
/proc/loadavg: 3.74 3.94 3.80 5/183 11461
/proc/meminfo: memFree=27884756/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=163800 CPUtime=25.37 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 10810 0 0 0 2524 13 0 0 20 0 3 0 275230585 167731200 10697 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 40950 10697 206 433 0 40514 0
[pid=11458/tid=11460] ppid=11456 vsize=163800 CPUtime=12.64 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 4047 0 0 0 1261 3 0 0 20 0 3 0 275230586 167731200 10697 33554432000 4194304 5965102 140736943272656 140110678866872 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=163800 CPUtime=12.64 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 5843 0 0 0 1255 9 0 0 20 0 3 0 275230586 167731200 10697 33554432000 4194304 5965102 140736943272656 140110668376376 4221120 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 163800

[startup+25.5004 s]
/proc/loadavg: 3.80 3.94 3.80 5/183 11461
/proc/meminfo: memFree=27806768/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=164260 CPUtime=50.96 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 17414 0 0 0 5073 23 0 0 20 0 3 0 275230585 168202240 17301 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 41065 17301 206 433 0 40629 0
[pid=11458/tid=11460] ppid=11456 vsize=164260 CPUtime=25.41 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 6957 0 0 0 2537 4 0 0 20 0 3 0 275230586 168202240 17301 33554432000 4194304 5965102 140736943272656 140110678865720 4401149 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=164260 CPUtime=25.41 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 9537 0 0 0 2522 19 0 0 20 0 3 0 275230586 168202240 17301 33554432000 4194304 5965102 140736943272656 140110668376376 4389236 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 164260

[startup+51.1004 s]
/proc/loadavg: 3.87 3.94 3.80 5/183 11462
/proc/meminfo: memFree=27700708/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=164716 CPUtime=102.15 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 25840 0 0 0 10184 31 0 0 20 0 3 0 275230585 168669184 25726 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 41179 25726 206 433 0 40743 0
[pid=11458/tid=11460] ppid=11456 vsize=164716 CPUtime=50.94 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 11289 0 0 0 5087 7 0 0 20 0 3 0 275230586 168669184 25726 33554432000 4194304 5965102 140736943272656 140110678865720 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=164716 CPUtime=50.94 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 13631 0 0 0 5071 23 0 0 20 0 3 0 275230586 168669184 25726 33554432000 4194304 5965102 140736943272656 140110668376376 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.15
Current children cumulated vsize (KiB) 164716

[startup+102.307 s]
/proc/loadavg: 3.94 3.95 3.81 5/183 11514
/proc/meminfo: memFree=27780972/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=296876 CPUtime=204.53 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 35839 0 0 0 20413 40 0 0 20 0 3 0 275230585 304001024 36170 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 74219 36170 206 433 0 73783 0
[pid=11458/tid=11460] ppid=11456 vsize=296876 CPUtime=101.99 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 17017 0 0 0 10185 14 0 0 20 0 3 0 275230586 304001024 36170 33554432000 4194304 5965102 140736943272656 140110678865720 4401131 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=296876 CPUtime=102.01 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 17902 0 0 0 10173 28 0 0 20 0 3 0 275230586 304001024 36170 33554432000 4194304 5965102 140736943272656 140110668376408 4401582 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 204.53
Current children cumulated vsize (KiB) 296876

[startup+162.3 s]
/proc/loadavg: 3.98 3.95 3.82 5/184 11517
/proc/meminfo: memFree=27664968/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=295964 CPUtime=324.47 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 47321 0 0 0 32399 48 0 0 20 0 3 0 275230585 303067136 47627 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 73991 47627 206 433 0 73555 0
[pid=11458/tid=11460] ppid=11456 vsize=295964 CPUtime=161.82 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 21293 0 0 0 16165 17 0 0 20 0 3 0 275230586 303067136 47627 33554432000 4194304 5965102 140736943272656 140110678866872 4401127 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=295964 CPUtime=161.81 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 25108 0 0 0 16147 34 0 0 20 0 3 0 275230586 303067136 47627 33554432000 4194304 5965102 140736943272656 140110668376376 4400921 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 324.47
Current children cumulated vsize (KiB) 295964

[startup+222.3 s]
/proc/loadavg: 3.99 3.96 3.83 5/184 11540
/proc/meminfo: memFree=27578760/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=295964 CPUtime=444.45 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 54819 0 0 0 44389 56 0 0 20 0 3 0 275230585 303067136 56836 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 73991 56836 206 433 0 73555 0
[pid=11458/tid=11460] ppid=11456 vsize=295964 CPUtime=221.66 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 22279 0 0 0 22145 21 0 0 20 0 3 0 275230586 303067136 56836 33554432000 4194304 5965102 140736943272656 140110678865912 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=295964 CPUtime=221.65 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 31620 0 0 0 22125 40 0 0 20 0 3 0 275230586 303067136 56836 33554432000 4194304 5965102 140736943272656 140110668376376 4393958 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.45
Current children cumulated vsize (KiB) 295964

[startup+282.3 s]
/proc/loadavg: 3.99 3.97 3.83 5/183 11540
/proc/meminfo: memFree=27504924/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=361648 CPUtime=564.42 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 64141 0 0 0 56370 72 0 0 20 0 3 0 275230585 370327552 66158 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 90412 66158 206 433 0 89976 0
[pid=11458/tid=11460] ppid=11456 vsize=361648 CPUtime=281.5 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 28665 0 0 0 28115 35 0 0 20 0 3 0 275230586 370327552 66158 33554432000 4194304 5965102 140736943272656 140110678865720 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=361648 CPUtime=281.5 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 34556 0 0 0 28106 44 0 0 20 0 3 0 275230586 370327552 66158 33554432000 4194304 5965102 140736943272656 140110668376376 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.42
Current children cumulated vsize (KiB) 361648

[startup+342.3 s]
/proc/loadavg: 3.99 3.97 3.84 5/183 11540
/proc/meminfo: memFree=27380800/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=427340 CPUtime=684.4 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 74212 0 0 0 68356 84 0 0 20 0 3 0 275230585 437596160 76243 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 106835 76243 206 433 0 106399 0

################
# More data... #
################

[pid=11458/tid=11461] ppid=11456 vsize=427340 CPUtime=341.35 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 40083 0 0 0 34085 50 0 0 20 0 3 0 275230586 437596160 76243 33554432000 4194304 5965102 140736943272656 140110668376376 4401127 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.4
Current children cumulated vsize (KiB) 427340

[startup+402.3 s]
/proc/loadavg: 3.99 3.97 3.85 5/183 11541
/proc/meminfo: memFree=27313164/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=428424 CPUtime=804.36 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 80806 0 0 0 80344 92 0 0 20 0 3 0 275230585 438706176 83056 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 107106 83056 206 433 0 106670 0
[pid=11458/tid=11460] ppid=11456 vsize=428424 CPUtime=401.16 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 39563 0 0 0 40064 52 0 0 20 0 3 0 275230586 438706176 83056 33554432000 4194304 5965102 140736943272656 140110678865912 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=428424 CPUtime=401.18 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 40323 0 0 0 40067 51 0 0 20 0 3 0 275230586 438706176 83056 33554432000 4194304 5965102 140736943272656 140110668376376 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.36
Current children cumulated vsize (KiB) 428424

[startup+462.3 s]
/proc/loadavg: 3.99 3.97 3.85 5/183 11541
/proc/meminfo: memFree=27200016/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=494468 CPUtime=924.32 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 98897 0 0 0 92323 109 0 0 20 0 3 0 275230585 506335232 101118 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 123617 101118 206 433 0 123181 0
[pid=11458/tid=11460] ppid=11456 vsize=494468 CPUtime=461 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 41785 0 0 0 46045 55 0 0 20 0 3 0 275230586 506335232 101118 33554432000 4194304 5965102 140736943272656 140110678865720 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=494468 CPUtime=461 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 56192 0 0 0 46033 67 0 0 20 0 3 0 275230586 506335232 101118 33554432000 4194304 5965102 140736943272656 140110668376376 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.32
Current children cumulated vsize (KiB) 494468

[startup+522.3 s]
/proc/loadavg: 4.03 3.99 3.86 5/183 11593
/proc/meminfo: memFree=27545956/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=494604 CPUtime=1044.3 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 104469 0 0 0 104315 115 0 0 20 0 3 0 275230585 506474496 106680 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 123651 106680 206 433 0 123215 0
[pid=11458/tid=11460] ppid=11456 vsize=494604 CPUtime=520.84 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 47327 0 0 0 52023 61 0 0 20 0 3 0 275230586 506474496 106680 33554432000 4194304 5965102 140736943272656 140110678865912 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=494604 CPUtime=520.84 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 56222 0 0 0 52016 68 0 0 20 0 3 0 275230586 506474496 106680 33554432000 4194304 5965102 140736943272656 140110668376136 4401064 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.3
Current children cumulated vsize (KiB) 494604

[startup+582.3 s]
/proc/loadavg: 4.01 3.99 3.87 5/183 11593
/proc/meminfo: memFree=27409896/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=560328 CPUtime=1164.25 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 108151 0 0 0 116304 121 0 0 20 0 3 0 275230585 573775872 111175 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 140082 111175 206 433 0 139646 0
[pid=11458/tid=11460] ppid=11456 vsize=560328 CPUtime=580.66 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 50952 0 0 0 57998 68 0 0 20 0 3 0 275230586 573775872 111175 33554432000 4194304 5965102 140736943272656 140110678865720 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=560328 CPUtime=580.68 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 56279 0 0 0 57999 69 0 0 20 0 3 0 275230586 573775872 111175 33554432000 4194304 5965102 140736943272656 140110668376136 4401137 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.25
Current children cumulated vsize (KiB) 560328

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.87 5/183 11593
/proc/meminfo: memFree=27332204/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=560568 CPUtime=1284.24 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 114204 0 0 0 128288 136 0 0 20 0 3 0 275230585 574021632 117229 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 140142 117229 206 433 0 139706 0
[pid=11458/tid=11460] ppid=11456 vsize=560568 CPUtime=640.51 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 56949 0 0 0 63967 84 0 0 20 0 3 0 275230586 574021632 117229 33554432000 4194304 5965102 140736943272656 140110678865720 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=560568 CPUtime=640.53 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 56335 0 0 0 63983 70 0 0 20 0 3 0 275230586 574021632 117229 33554432000 4194304 5965102 140736943272656 140110668376136 4401131 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.24
Current children cumulated vsize (KiB) 560568

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.88 5/183 11594
/proc/meminfo: memFree=27213132/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=560568 CPUtime=1404.2 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 123650 0 0 0 140273 147 0 0 20 0 3 0 275230585 574021632 126666 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 140142 126666 206 433 0 139706 0
[pid=11458/tid=11460] ppid=11456 vsize=560568 CPUtime=700.34 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 58425 0 0 0 69947 87 0 0 20 0 3 0 275230586 574021632 126666 33554432000 4194304 5965102 140736943272656 140110678865720 4401155 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=560568 CPUtime=700.35 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 64305 0 0 0 69956 79 0 0 20 0 3 0 275230586 574021632 126666 33554432000 4194304 5965102 140736943272656 140110668376376 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.2
Current children cumulated vsize (KiB) 560568

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.89 5/184 11597
/proc/meminfo: memFree=27134492/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=560568 CPUtime=1524.2 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 126462 0 0 0 152267 153 0 0 20 0 3 0 275230585 574021632 129477 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 140142 129477 206 433 0 139706 0
[pid=11458/tid=11460] ppid=11456 vsize=560568 CPUtime=760.19 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 61233 0 0 0 75925 94 0 0 20 0 3 0 275230586 574021632 129477 33554432000 4194304 5965102 140736943272656 140110678865720 4393837 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=560568 CPUtime=760.2 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 64309 0 0 0 75940 80 0 0 20 0 3 0 275230586 574021632 129477 33554432000 4194304 5965102 140736943272656 140110668376376 4401131 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.2
Current children cumulated vsize (KiB) 560568

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.89 5/183 11597
/proc/meminfo: memFree=27038392/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=626880 CPUtime=1644.16 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 132815 0 0 0 164251 165 0 0 20 0 3 0 275230585 641925120 135824 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 156720 135824 206 433 0 156284 0
[pid=11458/tid=11460] ppid=11456 vsize=626880 CPUtime=820.03 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 66330 0 0 0 81897 106 0 0 20 0 3 0 275230586 641925120 135824 33554432000 4194304 5965102 140736943272656 140110678865912 4401668 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=626880 CPUtime=820.04 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 65565 0 0 0 81922 82 0 0 20 0 3 0 275230586 641925120 135824 33554432000 4194304 5965102 140736943272656 140110668376376 4401127 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.16
Current children cumulated vsize (KiB) 626880

[startup+882.3 s]
/proc/loadavg: 4.00 3.99 3.90 5/183 11597
/proc/meminfo: memFree=27016596/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=626880 CPUtime=1764.15 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 133203 0 0 0 176250 165 0 0 20 0 3 0 275230585 641925120 136211 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 156720 136211 206 433 0 156284 0
[pid=11458/tid=11460] ppid=11456 vsize=626880 CPUtime=879.87 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 66718 0 0 0 87880 107 0 0 20 0 3 0 275230586 641925120 136211 33554432000 4194304 5965102 140736943272656 140110678865720 4401155 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=626880 CPUtime=879.89 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 65565 0 0 0 87906 83 0 0 20 0 3 0 275230586 641925120 136211 33554432000 4194304 5965102 140736943272656 140110668376376 4401559 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.15
Current children cumulated vsize (KiB) 626880



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.90 5/183 11597
/proc/meminfo: memFree=26973040/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=626880 CPUtime=1800.16 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 135382 0 0 0 179846 170 0 0 20 0 3 0 275230585 641925120 138390 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 156720 138390 206 433 0 156284 0
[pid=11458/tid=11460] ppid=11456 vsize=626880 CPUtime=897.83 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 68897 0 0 0 89671 112 0 0 20 0 3 0 275230586 641925120 138390 33554432000 4194304 5965102 140736943272656 140110678865912 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=626880 CPUtime=897.85 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 65565 0 0 0 89702 83 0 0 20 0 3 0 275230586 641925120 138390 33554432000 4194304 5965102 140736943272656 140110668376376 4401127 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 626880

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.90 5/183 11597
/proc/meminfo: memFree=26973040/32873844 swapFree=7124/7124
[pid=11458] ppid=11456 vsize=626880 CPUtime=1800.16 cores=1,3,5,7
/proc/11458/stat : 11458 (pwbo2.0) S 11456 11458 10899 0 -1 4202496 135382 0 0 0 179846 170 0 0 20 0 3 0 275230585 641925120 138390 33554432000 4194304 5965102 140736943272656 140736943272176 4547341 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/11458/statm: 156720 138390 206 433 0 156284 0
[pid=11458/tid=11460] ppid=11456 vsize=626880 CPUtime=897.83 cores=1,3,5,7
/proc/11458/task/11460/stat : 11460 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 68897 0 0 0 89671 112 0 0 20 0 3 0 275230586 641925120 138390 33554432000 4194304 5965102 140736943272656 140110678865912 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=11458/tid=11461] ppid=11456 vsize=626880 CPUtime=897.85 cores=1,3,5,7
/proc/11458/task/11461/stat : 11461 (pwbo2.0) R 11456 11458 10899 0 -1 4202560 65565 0 0 0 89702 83 0 0 20 0 3 0 275230586 641925120 138390 33554432000 4194304 5965102 140736943272656 140110668376376 4401127 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 626880

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11458 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=751308
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=981698
# CPU time returned by wait4() is 1795.73
# while last known CPU time is 1800.16
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.323
CPU time (s): 1800.16
CPU user time (s): 1798.46
CPU system time (s): 1.7
CPU usage (%): 199.946
Max. virtual memory (cumulated for all children) (KiB): 626880

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.75
system time used= 1.9817
maximum resident set size= 553572
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 135385
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 345
involuntary context switches= 3413

runsolver used 3.64145 second user time and 4.13437 second system time

The end

Launcher Data 

Begin job on node134 at 2012-05-27 05:57:32
IDJOB=3704513
IDBENCH=48169
IDSOLVER=2281
FILE ID=node134/3704513-1338091052
RUNJOBID= node134-1338088337-10916
PBS_JOBID= 14624458
Free space on /tmp= 71044 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mis/normalized-mis_100_10_2.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3704513-1338091052/watcher-3704513-1338091052 -o /tmp/evaluation-result-3704513-1338091052/solver-3704513-1338091052 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3704513-1338091052.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 597624b9879736416e28e0a242fe0005
RANDOM SEED=351165351

node134.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27979212 kB
Buffers:          363920 kB
Cached:          3639268 kB
SwapCached:            0 kB
Active:          1486784 kB
Inactive:        2562232 kB
Active(anon):      41828 kB
Inactive(anon):     5996 kB
Active(file):    1444956 kB
Inactive(file):  2556236 kB
Unevictable:        7124 kB
Mlocked:            7124 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             11452 kB
Writeback:           244 kB
AnonPages:         52204 kB
Mapped:            15264 kB
Shmem:               212 kB
Slab:             706028 kB
SReclaimable:     147056 kB
SUnreclaim:       558972 kB
KernelStack:        1488 kB
PageTables:         4056 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     160300 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3704513-1338091052.opb

Free space on /tmp at the end= 71040 MiB
End job on node134 at 2012-05-27 06:12:34