Trace number 3703546

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)5147 1800.09 900.325

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-9symml.opb
MD5SUM866c660dea8282137b8c78839dd4c03f
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4517
Best CPU time to get the best result obtained on this benchmark0.174972
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 4517
Optimality of the best value was proved YES
Number of variables651
Total number of constraints1658
Number of constraints which are clauses1656
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2
Minimum length of a constraint1
Maximum length of a constraint42
Number of terms in the objective function 651
Biggest coefficient in the objective function 61
Number of bits for the biggest coefficient in the objective function 6
Sum of the numbers in the objective function 28138
Number of bits of the sum of numbers in the objective function 15
Biggest number in a constraint 61
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 28138
Number of bits of the biggest sum of numbers15
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703546-1338089390.opb.
0.00/0.00	c Instance file HOME/instance-3703546-1338089390.opb
0.00/0.00	c File size is 71286 bytes.
0.00/0.00	c Cost Offset: 0
0.00/0.00	c Highest Coefficient sum: 43
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.01         s                                      |
0.00/0.00	c |  Number Variables:      651                                                 |
0.00/0.00	c |  Number Clauses:        1658                                                |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    PB Constraint                                       |
0.00/0.01	c |                                                                             |
0.00/0.01	c ===============================================================================
1800.09/900.31	o 6175
1800.09/900.31	o 5890
1800.09/900.31	o 5582
1800.09/900.31	o 5577
1800.09/900.31	o 5563
1800.09/900.31	o 5561
1800.09/900.31	o 5482
1800.09/900.31	o 5480
1800.09/900.31	o 5335
1800.09/900.31	o 5326
1800.09/900.31	o 5310
1800.09/900.31	o 5308
1800.09/900.31	o 5292
1800.09/900.31	o 5251
1800.09/900.31	o 5228
1800.09/900.31	o 5219
1800.09/900.31	o 5195
1800.09/900.31	o 5147
1800.09/900.31	c ===============================================================================
1800.09/900.31	c Wall Clock Time: 900.31 s
1800.09/900.31	c Best Solution: 5147
1800.09/900.31	s SATISFIABLE
1800.09/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 x7 x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 x16 -x17 -x18 -x19 -x20 -x21 -x22 x23 -x24 -x25 -x26 x27 -x28 -x29 x30 -x31 x32 x33 -x34 -x35 -x36 -x37 -x38 x39 -x40 -x41 x42 -x43 -x44 -x45 -x46 x47 -x48 x49 -x50 -x51 -x52 x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 x88 -x89 x90 -x91 -x92 -x93 x94 -x95 -x96 -x97 -x98 x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 x110 -x111 -x112 x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 x135 -x136 -x137 -x138 -x139 x140 x141 -x142 -x143 -x144 -x145 -x146 x147 x148 -x149 -x150 x151 -x152 -x153 -x154 -x155 x156 -x157 -x158 -x159 x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 x181 -x182 x183 -x184 x185 x186 -x187 x188 -x189 x190 x191 -x192 -x193 -x194 x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 x206 -x207 -x208 -x209 x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 x219 x220 x221 -x222 -x223 -x224 x225 x226 x227 x228 -x229 -x230 -x231 -x232 -x233 -x234 x235 -x236 x237 -x238 -x239 x240 -x241 -x242 -x243 -x244 x245 -x246 x247 x248 -x249 -x250 x251 -x252 -x253 -x254 -x255 x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 x267 -x268 -x269 -x270 -x271 x272 x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 x282 -x283 -x284 x285 -x286 x287 -x288 x289 -x290 -x291 -x292 -x293 -x294 x295 -x296 x297 x298 x299 -x300 x301 -x302 x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 x311 -x312 -x313 -x314 -x315 -x316 -x317 x318 -x319 x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 x329 -x330 -x331 -x332 -x333 x334 -x335 -x336 -x337 -x338 -x339 -x340 -x341 -x342 -x343 -x344 x345 -x346 x347 x348 x349 x350 -x351 -x352 -x353 -x354 -x355 -x356 -x357 -x358 -x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 x368 -x369 -x370 x371 -x372 -x373 x374 -x375 x376 x377 -x378 x379 -x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 -x396 -x397 -x398 -x399 x400 -x401 -x402 x403 x404 -x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 -x413 -x414 x415 -x416 -x417 -x418 -x419 -x420 -x421 x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 x430 x431 x432 -x433 -x434 -x435 x436 -x437 x438 x439 x440 x441 x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 x453 -x454 -x455 -x456 -x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 -x470 x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 x479 x480 -x481 -x482 -x483 -x484 -x485 x486 -x487 x488 -x489 -x490 -x491 -x492 -x493 -x494 -x495 x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 -x510 -x511 -x512 -x513 -x514 x515 -x516 -x517 x518 -x519 -x520 -x521 -x522 -x523 -x524 -x525 -x526 -x527 -x528 -x529 -x530 -x531 -x532 -x533 -x534 -x535 -x536 -x537 -x538 x539 -x540 -x541 -x542 -x543 -x544 -x545 -x546 -x547 -x548 -x549 x550 -x551 -x552 -x553 -x554 -x555 -x556 -x557 -x558 x559 x560 -x561 -x562 -x563 -x564 -x565 -x566 -x567 x568 -x569 -x570 -x571 -x572 -x573 -x574 -x575 -x576 -x577 -x578 -x579 -x580 -x581 -x582 -x583 -x584 -x585 -x586 -x587 -x588 -x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 -x597 -x598 -x599 -x600 -x601 x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 -x615 -x616 -x617 -x618 -x619 -x620 -x621 -x622 -x623 -x624 -x625 -x626 -x627 x628 -x629 -x630 x631 x632 x633 x634 -x635 -x636 -x637 -x638 -x639 x640 -x641 -x642 -x643 -x644 x645 x646 x647 -x648 x649 x650 -x651

Verifier Data

OK	5147

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703546-1338089390/watcher-3703546-1338089390 -o /tmp/evaluation-result-3703546-1338089390/solver-3703546-1338089390 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703546-1338089390.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.79 3.02 4/178 11653
/proc/meminfo: memFree=31267960/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=4132 CPUtime=0 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) R 11651 11653 11438 0 -1 4202496 360 0 0 0 0 0 0 0 20 0 1 0 275067579 4231168 313 33554432000 4194304 5965102 140736885172096 140733212177384 4348724 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 1033 313 168 433 0 579 0

[startup+0.0610489 s]
/proc/loadavg: 3.68 3.79 3.02 4/178 11653
/proc/meminfo: memFree=31267960/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=163036 CPUtime=0.1 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 1549 0 0 0 10 0 0 0 20 0 3 0 275067579 166948864 1440 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 40759 1440 200 433 0 40323 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 163036

[startup+0.100197 s]
/proc/loadavg: 3.68 3.79 3.02 4/178 11653
/proc/meminfo: memFree=31267960/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=163036 CPUtime=0.18 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 1739 0 0 0 18 0 0 0 20 0 3 0 275067579 166948864 1628 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 40759 1628 200 433 0 40323 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 163036

[startup+0.300142 s]
/proc/loadavg: 3.68 3.79 3.02 4/178 11653
/proc/meminfo: memFree=31267960/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=163036 CPUtime=0.57 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 2985 0 0 0 56 1 0 0 20 0 3 0 275067579 166948864 2636 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 40759 2636 200 433 0 40323 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 163036

[startup+0.70015 s]
/proc/loadavg: 3.68 3.79 3.02 4/178 11653
/proc/meminfo: memFree=31267960/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=163036 CPUtime=1.37 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 5196 0 0 0 135 2 0 0 20 0 3 0 275067579 166948864 4044 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 40759 4050 200 433 0 40323 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 163036

[startup+1.50029 s]
/proc/loadavg: 3.68 3.79 3.02 5/181 11656
/proc/meminfo: memFree=31235920/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=163304 CPUtime=2.96 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 10489 0 0 0 293 3 0 0 20 0 3 0 275067579 167223296 6348 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 40826 6348 200 433 0 40390 0
[pid=11653/tid=11655] ppid=11651 vsize=163304 CPUtime=1.47 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 7244 0 0 0 146 1 0 0 20 0 3 0 275067580 167223296 6348 33554432000 4194304 5965102 140736885172096 140349566601752 4401155 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=163304 CPUtime=1.47 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 2352 0 0 0 144 3 0 0 20 0 3 0 275067580 167223296 6348 33554432000 4194304 5965102 140736885172096 140349556111192 4404732 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 163304

[startup+3.10033 s]
/proc/loadavg: 3.68 3.79 3.02 5/181 11656
/proc/meminfo: memFree=31211740/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=163568 CPUtime=6.17 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 14997 0 0 0 612 5 0 0 20 0 3 0 275067579 167493632 8871 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 40892 8871 200 433 0 40456 0
[pid=11653/tid=11655] ppid=11651 vsize=163568 CPUtime=3.07 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 10870 0 0 0 305 2 0 0 20 0 3 0 275067580 167493632 8871 33554432000 4194304 5965102 140736885172096 140349566602056 4388988 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=163568 CPUtime=3.07 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 3234 0 0 0 304 3 0 0 20 0 3 0 275067580 167493632 8871 33554432000 4194304 5965102 140736885172096 140349556111608 4401064 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 163568

[startup+6.30032 s]
/proc/loadavg: 3.70 3.79 3.02 5/181 11656
/proc/meminfo: memFree=31170324/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=164116 CPUtime=12.56 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 18115 0 0 0 1251 5 0 0 20 0 3 0 275067579 168054784 11989 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 41029 11989 200 433 0 40593 0
[pid=11653/tid=11655] ppid=11651 vsize=164116 CPUtime=6.26 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 11047 0 0 0 624 2 0 0 20 0 3 0 275067580 168054784 11989 33554432000 4194304 5965102 140736885172096 140349566601016 4404735 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=164116 CPUtime=6.25 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 6175 0 0 0 622 3 0 0 20 0 3 0 275067580 168054784 11989 33554432000 4194304 5965102 140736885172096 140349556111192 4404757 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 164116

[startup+12.7004 s]
/proc/loadavg: 3.73 3.79 3.03 5/182 11659
/proc/meminfo: memFree=31131144/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=165424 CPUtime=25.36 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 24280 0 0 0 2522 14 0 0 20 0 3 0 275067579 169394176 18154 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 41356 18154 200 433 0 40920 0
[pid=11653/tid=11655] ppid=11651 vsize=165424 CPUtime=12.64 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 13226 0 0 0 1260 4 0 0 20 0 3 0 275067580 169394176 18154 33554432000 4194304 5965102 140736885172096 140349566601256 4401568 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=165424 CPUtime=12.64 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 10161 0 0 0 1255 9 0 0 20 0 3 0 275067580 169394176 18154 33554432000 4194304 5965102 140736885172096 140349556111720 18446744073699066235 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 165424

[startup+25.5004 s]
/proc/loadavg: 3.79 3.80 3.04 5/182 11659
/proc/meminfo: memFree=31084584/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=168300 CPUtime=50.96 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 28945 0 0 0 5076 20 0 0 20 0 3 0 275067579 172339200 22078 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 42075 22078 200 433 0 41639 0
[pid=11653/tid=11655] ppid=11651 vsize=168300 CPUtime=25.41 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 15569 0 0 0 2534 7 0 0 20 0 3 0 275067580 172339200 22078 33554432000 4194304 5965102 140736885172096 140349566601752 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=168300 CPUtime=25.4 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 12483 0 0 0 2528 12 0 0 20 0 3 0 275067580 172339200 22078 33554432000 4194304 5965102 140736885172096 140349556111192 5137076 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 168300

[startup+51.1004 s]
/proc/loadavg: 3.86 3.82 3.06 5/182 11659
/proc/meminfo: memFree=31018568/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=170812 CPUtime=102.15 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 36338 0 0 0 10192 23 0 0 20 0 3 0 275067579 174911488 29463 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 42703 29463 200 433 0 42267 0
[pid=11653/tid=11655] ppid=11651 vsize=170812 CPUtime=50.94 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 21129 0 0 0 5085 9 0 0 20 0 3 0 275067580 174911488 29463 33554432000 4194304 5965102 140736885172096 140349566601016 4390169 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=170812 CPUtime=50.94 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 14316 0 0 0 5081 13 0 0 20 0 3 0 275067580 174911488 29463 33554432000 4194304 5965102 140736885172096 140349556111432 4390210 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.15
Current children cumulated vsize (KiB) 170812

[startup+102.306 s]
/proc/loadavg: 3.94 3.84 3.11 5/181 11659
/proc/meminfo: memFree=30914240/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=308444 CPUtime=204.55 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 47126 0 0 0 20426 29 0 0 20 0 3 0 275067579 315846656 40021 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 77111 40021 200 433 0 76675 0
[pid=11653/tid=11655] ppid=11651 vsize=308444 CPUtime=102.02 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 25391 0 0 0 10189 13 0 0 20 0 3 0 275067580 315846656 40021 33554432000 4194304 5965102 140736885172096 140349566601544 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=308444 CPUtime=102.01 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 20842 0 0 0 10184 17 0 0 20 0 3 0 275067580 315846656 40021 33554432000 4194304 5965102 140736885172096 140349556111432 4401131 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.55
Current children cumulated vsize (KiB) 308444

[startup+162.3 s]
/proc/loadavg: 3.98 3.87 3.16 5/181 11659
/proc/meminfo: memFree=30807016/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=315264 CPUtime=324.47 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 59813 0 0 0 32412 35 0 0 20 0 3 0 275067579 322830336 53091 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 78816 53091 200 433 0 78380 0
[pid=11653/tid=11655] ppid=11651 vsize=315264 CPUtime=161.85 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 29380 0 0 0 16169 16 0 0 20 0 3 0 275067580 322830336 53091 33554432000 4194304 5965102 140736885172096 140349566601016 4390210 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=315264 CPUtime=161.81 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 29540 0 0 0 16159 22 0 0 20 0 3 0 275067580 322830336 53091 33554432000 4194304 5965102 140736885172096 140349556111432 4401155 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.47
Current children cumulated vsize (KiB) 315264

[startup+222.3 s]
/proc/loadavg: 3.99 3.89 3.21 5/181 11660
/proc/meminfo: memFree=30746052/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=319908 CPUtime=444.41 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 72463 0 0 0 44385 56 0 0 20 0 3 0 275067579 327585792 66775 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 79977 66775 200 433 0 79541 0
[pid=11653/tid=11655] ppid=11651 vsize=319908 CPUtime=221.66 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 36496 0 0 0 22139 27 0 0 20 0 3 0 275067580 327585792 66775 33554432000 4194304 5965102 140736885172096 140349566601208 4222464 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=319908 CPUtime=221.65 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 35074 0 0 0 22130 35 0 0 20 0 3 0 275067580 327585792 66775 33554432000 4194304 5965102 140736885172096 140349556111432 4401041 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.41
Current children cumulated vsize (KiB) 319908

[startup+282.3 s]
/proc/loadavg: 3.99 3.91 3.26 5/181 11660
/proc/meminfo: memFree=30655072/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=391284 CPUtime=564.39 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 78960 0 0 0 56376 63 0 0 20 0 3 0 275067579 400674816 73016 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 97821 73016 200 433 0 97385 0
[pid=11653/tid=11655] ppid=11651 vsize=391284 CPUtime=281.51 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 40724 0 0 0 28117 34 0 0 20 0 3 0 275067580 400674816 73016 33554432000 4194304 5965102 140736885172096 140349566601016 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=391284 CPUtime=281.49 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 37343 0 0 0 28112 37 0 0 20 0 3 0 275067580 400674816 73016 33554432000 4194304 5965102 140736885172096 140349556111432 4391664 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.39
Current children cumulated vsize (KiB) 391284

[startup+342.3 s]
/proc/loadavg: 4.07 3.94 3.31 5/182 11661
/proc/meminfo: memFree=30592844/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=464300 CPUtime=684.37 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 94379 0 0 0 68329 108 0 0 20 0 3 0 275067579 475443200 88434 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 116075 88434 200 433 0 115639 0

################
# More data... #
################

[pid=11653/tid=11656] ppid=11651 vsize=464300 CPUtime=341.33 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 46129 0 0 0 34072 61 0 0 20 0 3 0 275067580 475443200 88434 33554432000 4194304 5965102 140736885172096 140349556111432 4401041 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.37
Current children cumulated vsize (KiB) 464300

[startup+402.3 s]
/proc/loadavg: 4.02 3.95 3.35 5/181 11661
/proc/meminfo: memFree=30550156/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=467844 CPUtime=804.35 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 102713 0 0 0 80316 119 0 0 20 0 3 0 275067579 479072256 96248 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 116961 96248 200 433 0 116525 0
[pid=11653/tid=11655] ppid=11651 vsize=467844 CPUtime=401.2 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 53772 0 0 0 40054 66 0 0 20 0 3 0 275067580 479072256 96248 33554432000 4194304 5965102 140736885172096 140349566601016 4390187 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=467844 CPUtime=401.17 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 48048 0 0 0 40053 64 0 0 20 0 3 0 275067580 479072256 96248 33554432000 4194304 5965102 140736885172096 140349556111432 18446744073699066235 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.35
Current children cumulated vsize (KiB) 467844

[startup+462.3 s]
/proc/loadavg: 4.01 3.95 3.39 5/181 11661
/proc/meminfo: memFree=30489544/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=535588 CPUtime=924.32 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 111720 0 0 0 92307 125 0 0 20 0 3 0 275067579 548442112 106065 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 133897 106065 200 433 0 133461 0
[pid=11653/tid=11655] ppid=11651 vsize=535588 CPUtime=461.04 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 59972 0 0 0 46033 71 0 0 20 0 3 0 275067580 548442112 106065 33554432000 4194304 5965102 140736885172096 140349566601208 4222464 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=535588 CPUtime=461.01 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 50855 0 0 0 46036 65 0 0 20 0 3 0 275067580 548442112 106065 33554432000 4194304 5965102 140736885172096 140349556111672 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.32
Current children cumulated vsize (KiB) 535588

[startup+522.3 s]
/proc/loadavg: 4.00 3.96 3.42 5/181 11662
/proc/meminfo: memFree=30456588/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=538200 CPUtime=1044.26 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 115649 0 0 0 104294 132 0 0 20 0 3 0 275067579 551116800 110283 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 134550 110283 200 433 0 134114 0
[pid=11653/tid=11655] ppid=11651 vsize=538200 CPUtime=520.85 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 61500 0 0 0 52011 74 0 0 20 0 3 0 275067580 551116800 110283 33554432000 4194304 5965102 140736885172096 140349566601016 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=538200 CPUtime=520.85 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 53256 0 0 0 52014 71 0 0 20 0 3 0 275067580 551116800 110283 33554432000 4194304 5965102 140736885172096 140349556111432 4390200 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.26
Current children cumulated vsize (KiB) 538200

[startup+582.3 s]
/proc/loadavg: 4.00 3.96 3.46 5/181 11662
/proc/meminfo: memFree=30412864/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=547456 CPUtime=1164.2 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 124116 0 0 0 116283 137 0 0 20 0 3 0 275067579 560594944 118828 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 136864 118828 200 433 0 136428 0
[pid=11653/tid=11655] ppid=11651 vsize=547456 CPUtime=580.67 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 62178 0 0 0 57989 78 0 0 20 0 3 0 275067580 560594944 118828 33554432000 4194304 5965102 140736885172096 140349566601016 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=547456 CPUtime=580.68 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 61045 0 0 0 57994 74 0 0 20 0 3 0 275067580 560594944 118828 33554432000 4194304 5965102 140736885172096 140349556111432 4404767 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.2
Current children cumulated vsize (KiB) 547456

[startup+642.3 s]
/proc/loadavg: 4.00 3.97 3.49 5/182 11665
/proc/meminfo: memFree=30360236/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=550656 CPUtime=1284.18 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 134338 0 0 0 128251 167 0 0 20 0 3 0 275067579 563871744 127548 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 137664 127548 200 433 0 137228 0
[pid=11653/tid=11655] ppid=11651 vsize=550656 CPUtime=640.52 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 71739 0 0 0 63944 108 0 0 20 0 3 0 275067580 563871744 127548 33554432000 4194304 5965102 140736885172096 140349566601016 4404463 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=550656 CPUtime=640.52 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 61706 0 0 0 63976 76 0 0 20 0 3 0 275067580 563871744 127548 33554432000 4194304 5965102 140736885172096 140349556111432 4410675 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.18
Current children cumulated vsize (KiB) 550656

[startup+702.3 s]
/proc/loadavg: 4.00 3.97 3.52 5/181 11665
/proc/meminfo: memFree=30303700/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=618688 CPUtime=1404.15 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 137959 0 0 0 140238 177 0 0 20 0 3 0 275067579 633536512 131169 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 154672 131169 200 433 0 154236 0
[pid=11653/tid=11655] ppid=11651 vsize=618688 CPUtime=700.36 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 74935 0 0 0 69917 119 0 0 20 0 3 0 275067580 633536512 131169 33554432000 4194304 5965102 140736885172096 140349566601016 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=618688 CPUtime=700.35 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 62131 0 0 0 69958 77 0 0 20 0 3 0 275067580 633536512 131169 33554432000 4194304 5965102 140736885172096 140349556111432 4390200 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.15
Current children cumulated vsize (KiB) 618688

[startup+762.307 s]
/proc/loadavg: 4.00 3.97 3.54 5/181 11665
/proc/meminfo: memFree=30227752/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=623524 CPUtime=1524.14 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 146152 0 0 0 152220 194 0 0 20 0 3 0 275067579 638488576 139361 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 155881 139361 200 433 0 155445 0
[pid=11653/tid=11655] ppid=11651 vsize=623524 CPUtime=760.21 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 81959 0 0 0 75883 138 0 0 20 0 3 0 275067580 638488576 139361 33554432000 4194304 5965102 140736885172096 140349566601208 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=623524 CPUtime=760.2 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 63300 0 0 0 75942 78 0 0 20 0 3 0 275067580 638488576 139361 33554432000 4194304 5965102 140736885172096 140349556111432 4380336 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.14
Current children cumulated vsize (KiB) 623524

[startup+822.3 s]
/proc/loadavg: 4.08 3.99 3.57 5/181 11666
/proc/meminfo: memFree=30184700/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=691552 CPUtime=1644.11 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 153258 0 0 0 164210 201 0 0 20 0 3 0 275067579 708149248 146467 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 172888 146467 200 433 0 172452 0
[pid=11653/tid=11655] ppid=11651 vsize=691552 CPUtime=820.05 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 83452 0 0 0 81865 140 0 0 20 0 3 0 275067580 708149248 146467 33554432000 4194304 5965102 140736885172096 140349566601208 4389878 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=691552 CPUtime=820.04 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 68913 0 0 0 81920 84 0 0 20 0 3 0 275067580 708149248 146467 33554432000 4194304 5965102 140736885172096 140349556111672 4390212 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.11
Current children cumulated vsize (KiB) 691552

[startup+882.3 s]
/proc/loadavg: 4.03 3.99 3.60 5/181 11666
/proc/meminfo: memFree=30152668/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=696452 CPUtime=1764.09 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 155641 0 0 0 176203 206 0 0 20 0 3 0 275067579 713166848 148850 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 174113 148850 200 433 0 173677 0
[pid=11653/tid=11655] ppid=11651 vsize=696452 CPUtime=879.9 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 83458 0 0 0 87849 141 0 0 20 0 3 0 275067580 713166848 148850 33554432000 4194304 5965102 140736885172096 140349566601208 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=696452 CPUtime=879.88 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 71290 0 0 0 87898 90 0 0 20 0 3 0 275067580 713166848 148850 33554432000 4194304 5965102 140736885172096 140349556111672 4380449 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.09
Current children cumulated vsize (KiB) 696452



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.02 3.99 3.61 3/177 11667
/proc/meminfo: memFree=30683496/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=696452 CPUtime=1800.09 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 155642 0 0 0 179803 206 0 0 20 0 3 0 275067579 713166848 148851 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 174113 148851 200 433 0 173677 0
[pid=11653/tid=11655] ppid=11651 vsize=696452 CPUtime=897.86 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 83459 0 0 0 89645 141 0 0 20 0 3 0 275067580 713166848 148851 33554432000 4194304 5965102 140736885172096 140349566601208 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=696452 CPUtime=897.84 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 71290 0 0 0 89694 90 0 0 20 0 3 0 275067580 713166848 148851 33554432000 4194304 5965102 140736885172096 140349556111672 4401510 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 696452

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.02 3.99 3.61 3/177 11667
/proc/meminfo: memFree=30683496/32873844 swapFree=7364/7364
[pid=11653] ppid=11651 vsize=696452 CPUtime=1800.09 cores=0,2,4,6
/proc/11653/stat : 11653 (pwbo2.0) S 11651 11653 11438 0 -1 4202496 155642 0 0 0 179803 206 0 0 20 0 3 0 275067579 713166848 148851 33554432000 4194304 5965102 140736885172096 140736885171616 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11653/statm: 174113 148851 200 433 0 173677 0
[pid=11653/tid=11655] ppid=11651 vsize=696452 CPUtime=897.86 cores=0,2,4,6
/proc/11653/task/11655/stat : 11655 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 83459 0 0 0 89645 141 0 0 20 0 3 0 275067580 713166848 148851 33554432000 4194304 5965102 140736885172096 140349566601208 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11653/tid=11656] ppid=11651 vsize=696452 CPUtime=897.84 cores=0,2,4,6
/proc/11653/task/11656/stat : 11656 (pwbo2.0) R 11651 11653 11438 0 -1 4202560 71290 0 0 0 89694 90 0 0 20 0 3 0 275067580 713166848 148851 33554432000 4194304 5965102 140736885172096 140349556111672 4401510 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 696452

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11653 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=404361
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=351642
# CPU time returned by wait4() is 1795.76
# while last known CPU time is 1800.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.325
CPU time (s): 1800.09
CPU user time (s): 1798.03
CPU system time (s): 2.06
CPU usage (%): 199.938
Max. virtual memory (cumulated for all children) (KiB): 696452

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.4
system time used= 2.35164
maximum resident set size= 595416
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 155645
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 326
involuntary context switches= 1871

runsolver used 1.79073 second user time and 4.86626 second system time

The end

Launcher Data

Begin job on node109 at 2012-05-27 05:29:50
IDJOB=3703546
IDBENCH=2017
IDSOLVER=2279
FILE ID=node109/3703546-1338089390
RUNJOBID= node109-1338088487-11454
PBS_JOBID= 14624462
Free space on /tmp= 71344 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB05/manquinho/synthesis-ptl-cmos-circuits/normalized-9symml.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703546-1338089390/watcher-3703546-1338089390 -o /tmp/evaluation-result-3703546-1338089390/solver-3703546-1338089390 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703546-1338089390.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 866c660dea8282137b8c78839dd4c03f
RANDOM SEED=1454050191

node109.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31268596 kB
Buffers:          248776 kB
Cached:           542036 kB
SwapCached:            0 kB
Active:           692168 kB
Inactive:         120840 kB
Active(anon):      13520 kB
Inactive(anon):    10916 kB
Active(file):     678648 kB
Inactive(file):   109924 kB
Unevictable:        7364 kB
Mlocked:            7364 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             11168 kB
Writeback:             0 kB
AnonPages:         31292 kB
Mapped:            15048 kB
Shmem:               200 kB
Slab:             651520 kB
SReclaimable:      93136 kB
SUnreclaim:       558384 kB
KernelStack:        1488 kB
PageTables:         3772 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     154644 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71340 MiB
End job on node109 at 2012-05-27 05:44:52