Trace number 3712437

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.54 900.324

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/
normalized-chnl15_25_pb.cnf.cr--soft-33-100-0.wbo
MD5SUM4fda08e2dc650152cad1c676f7fa8f96
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark15
Best CPU time to get the best result obtained on this benchmark0.242962
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables750
Total number of constraints80
Number of soft constraints54
Number of constraints which are clauses50
Number of constraints which are cardinality constraints (but not clauses)30
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint15
Maximum length of a constraint25
Top cost 2808
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 2807
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 26
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712437-1338189614.wbo.
0.00/0.00	c Instance file HOME/instance-3712437-1338189614.wbo
0.00/0.00	c File size is 12903 bytes.
0.00/0.00	c Highest Coefficient sum: 26
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      804                                                 |
0.00/0.00	c |  Number Clauses:        50                                                  |
0.00/0.00	c |  Number Cardinality:    11                                                  |
0.00/0.00	c |  Number PB Constraints: 19                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.18/900.31	o 325
1800.18/900.31	o 148
1800.18/900.31	o 118
1800.18/900.31	o 112
1800.18/900.31	o 89
1800.18/900.31	o 53
1800.18/900.31	o 15
1800.18/900.31	c ===============================================================================
1800.18/900.31	c Wall Clock Time: 900.31 s
1800.18/900.31	c Best Solution: 15
1800.18/900.31	s SATISFIABLE
1800.18/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 x60 -x61 -x62 -x63 -x64 x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 x117 -x118 -x119 -x120 -x121 x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 x221 -x222 -x223 -x224 -x225 x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 x267 -x268 -x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 x299 -x300 -x301 -x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 x339 -x340 -x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 x352 -x353 -x354 -x355 -x356 -x357 -x358 -x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 -x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 -x433 -x434 x435 -x436 x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 -x456 x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 x468 -x469 -x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 -x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 -x494 x495 -x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 x510 -x511 -x512 -x513 -x514 -x515 -x516 -x517 -x518 -x519 -x520 -x521 x522 -x523 -x524 -x525 -x526 -x527 -x528 x529 -x530 -x531 -x532 -x533 -x534 -x535 -x536 -x537 -x538 -x539 -x540 -x541 -x542 -x543 -x544 -x545 -x546 -x547 -x548 -x549 -x550 -x551 x552 -x553 -x554 -x555 -x556 -x557 -x558 -x559 -x560 x561 -x562 -x563 -x564 -x565 -x566 -x567 -x568 -x569 -x570 -x571 -x572 -x573 -x574 -x575 -x576 -x577 -x578 -x579 -x580 -x581 x582 -x583 -x584 -x585 -x586 -x587 -x588 -x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 x597 -x598 -x599 -x600 -x601 -x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 x615 x616 -x617 -x618 -x619 -x620 -x621 -x622 -x623 -x624 -x625 -x626 -x627 -x628 -x629 -x630 -x631 -x632 -x633 x634 -x635 -x636 -x637 -x638 -x639 -x640 -x641 -x642 -x643 -x644 -x645 -x646 -x647 -x648 -x649 -x650 -x651 -x652 -x653 x654 -x655 -x656 -x657 -x658 -x659 -x660 -x661 -x662 -x663 -x664 -x665 -x666 -x667 -x668 -x669 -x670 -x671 -x672 -x673 -x674 x675 -x676 -x677 -x678 -x679 -x680 -x681 -x682 -x683 -x684 -x685 x686 -x687 -x688 -x689 -x690 -x691 -x692 -x693 -x694 -x695 -x696 -x697 -x698 -x699 -x700 -x701 x702 -x703 -x704 -x705 -x706 -x707 -x708 -x709 -x710 -x711 -x712 -x713 -x714 -x715 -x716 -x717 -x718 x719 -x720 -x721 -x722 -x723 -x724 -x725 -x726 -x727 -x728 -x729 -x730 -x731 -x732 -x733 -x734 x735 -x736 -x737 -x738 -x739 -x740 -x741 -x742 x743 -x744 -x745 -x746 -x747 -x748 -x749 -x750

Verifier Data 

OK	15

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712437-1338189614/watcher-3712437-1338189614 -o /tmp/evaluation-result-3712437-1338189614/solver-3712437-1338189614 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712437-1338189614.wbo 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 3.97 3.92 2/175 27154
/proc/meminfo: memFree=31029696/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=162792 CPUtime=0 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 1044 0 0 0 0 0 0 0 20 0 3 0 285087271 166699008 991 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 40698 992 194 433 0 40262 0
[pid=27154/tid=27159] ppid=27152 vsize=162792 CPUtime=0 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 109 0 0 0 0 0 0 0 20 0 3 0 285087272 166699008 992 33554432000 4194304 5964478 140736058943520 140582622759624 5244295 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=162792 CPUtime=0 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 81 0 0 0 0 0 0 0 20 0 3 0 285087272 166699008 993 33554432000 4194304 5964478 140736058943520 140582612269208 4409608 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0

[startup+0.086369 s]
/proc/loadavg: 4.00 3.97 3.92 2/175 27154
/proc/meminfo: memFree=31029696/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=180996 CPUtime=0.14 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 8776 0 0 0 11 3 0 0 20 0 3 0 285087271 185339904 8643 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 45249 8647 205 433 0 44813 0
[pid=27154/tid=27159] ppid=27152 vsize=180996 CPUtime=0.06 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 334 0 0 0 6 0 0 0 20 0 3 0 285087272 185339904 8650 33554432000 4194304 5964478 140736058943520 140582622758712 4399980 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=180996 CPUtime=0.07 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 7597 0 0 0 3 4 0 0 20 0 3 0 285087272 185339904 8653 33554432000 4194304 5964478 140736058943520 140582612267976 5244295 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 180996

[startup+0.100367 s]
/proc/loadavg: 4.00 3.97 3.92 2/175 27154
/proc/meminfo: memFree=31029696/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=184396 CPUtime=0.17 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 10199 0 0 0 13 4 0 0 20 0 3 0 285087271 188821504 10041 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 46099 10045 205 433 0 45663 0
[pid=27154/tid=27159] ppid=27152 vsize=184396 CPUtime=0.08 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 367 0 0 0 8 0 0 0 20 0 3 0 285087272 188821504 10045 33554432000 4194304 5964478 140736058943520 140582622758904 5214452 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=184396 CPUtime=0.08 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 8982 0 0 0 3 5 0 0 20 0 3 0 285087272 188821504 10046 33554432000 4194304 5964478 140736058943520 140582612267976 5244295 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 184396

[startup+0.300342 s]
/proc/loadavg: 4.00 3.97 3.92 2/175 27154
/proc/meminfo: memFree=31029696/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=190904 CPUtime=0.57 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 13732 0 0 0 51 6 0 0 20 0 3 0 285087271 195485696 13574 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 47726 13574 206 433 0 47290 0
[pid=27154/tid=27159] ppid=27152 vsize=190904 CPUtime=0.28 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 719 0 0 0 28 0 0 0 20 0 3 0 285087272 195485696 13574 33554432000 4194304 5964478 140736058943520 140582622758904 4400051 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=190904 CPUtime=0.28 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 12158 0 0 0 21 7 0 0 20 0 3 0 285087272 195485696 13574 33554432000 4194304 5964478 140736058943520 140582612269288 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 190904

[startup+0.700277 s]
/proc/loadavg: 4.00 3.97 3.92 2/175 27154
/proc/meminfo: memFree=31029696/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=190904 CPUtime=1.37 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 14319 0 0 0 130 7 0 0 20 0 3 0 285087271 195485696 14161 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 47726 14161 206 433 0 47290 0
[pid=27154/tid=27159] ppid=27152 vsize=190904 CPUtime=0.68 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 1068 0 0 0 68 0 0 0 20 0 3 0 285087272 195485696 14161 33554432000 4194304 5964478 140736058943520 140582622758904 4400071 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=190904 CPUtime=0.68 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 12396 0 0 0 61 7 0 0 20 0 3 0 285087272 195485696 14161 33554432000 4194304 5964478 140736058943520 140582612269416 5136474 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 190904

[startup+1.5003 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30939528/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=190904 CPUtime=2.97 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 15583 0 0 0 290 7 0 0 20 0 3 0 285087271 195485696 15425 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 47726 15425 206 433 0 47290 0
[pid=27154/tid=27159] ppid=27152 vsize=190904 CPUtime=1.48 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 1609 0 0 0 148 0 0 0 20 0 3 0 285087272 195485696 15425 33554432000 4194304 5964478 140736058943520 140582622758952 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=190904 CPUtime=1.48 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 13119 0 0 0 141 7 0 0 20 0 3 0 285087272 195485696 15425 33554432000 4194304 5964478 140736058943520 140582612269176 4399899 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 190904

[startup+3.10022 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30929980/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=191264 CPUtime=6.17 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 17900 0 0 0 609 8 0 0 20 0 3 0 285087271 195854336 17742 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 47816 17742 206 433 0 47380 0
[pid=27154/tid=27159] ppid=27152 vsize=191264 CPUtime=3.08 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 2430 0 0 0 308 0 0 0 20 0 3 0 285087272 195854336 17742 33554432000 4194304 5964478 140736058943520 140582622758904 4400099 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=191264 CPUtime=3.08 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 14615 0 0 0 300 8 0 0 20 0 3 0 285087272 195854336 17742 33554432000 4194304 5964478 140736058943520 140582612269368 5136404 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 191264

[startup+6.30027 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30912304/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=191264 CPUtime=12.57 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 19459 0 0 0 1248 9 0 0 20 0 3 0 285087271 195854336 19301 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 47816 19301 206 433 0 47380 0
[pid=27154/tid=27159] ppid=27152 vsize=191264 CPUtime=6.28 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 2912 0 0 0 626 2 0 0 20 0 3 0 285087272 195854336 19301 33554432000 4194304 5964478 140736058943520 140582622758712 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=191264 CPUtime=6.28 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 15692 0 0 0 620 8 0 0 20 0 3 0 285087272 195854336 19301 33554432000 4194304 5964478 140736058943520 140582612269176 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 191264

[startup+12.7002 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30894828/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=191696 CPUtime=25.36 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 21362 0 0 0 2527 9 0 0 20 0 3 0 285087271 196296704 21553 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 47924 21553 206 433 0 47488 0
[pid=27154/tid=27159] ppid=27152 vsize=191696 CPUtime=12.68 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 3489 0 0 0 1266 2 0 0 20 0 3 0 285087272 196296704 21553 33554432000 4194304 5964478 140736058943520 140582622758904 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=191696 CPUtime=12.68 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 17018 0 0 0 1259 9 0 0 20 0 3 0 285087272 196296704 21553 33554432000 4194304 5964478 140736058943520 140582612269176 4400071 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 191696

[startup+25.5004 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30864232/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=192244 CPUtime=50.95 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 25104 0 0 0 5084 11 0 0 20 0 3 0 285087271 196857856 25291 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 48061 25291 206 433 0 47625 0
[pid=27154/tid=27159] ppid=27152 vsize=192244 CPUtime=25.48 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 5887 0 0 0 2545 3 0 0 20 0 3 0 285087272 196857856 25291 33554432000 4194304 5964478 140736058943520 140582622758712 4400073 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=192244 CPUtime=25.47 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 18362 0 0 0 2537 10 0 0 20 0 3 0 285087272 196857856 25291 33554432000 4194304 5964478 140736058943520 140582612269176 4400075 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 192244

[startup+51.1004 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30825324/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=194500 CPUtime=102.13 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 30079 0 0 0 10198 15 0 0 20 0 3 0 285087271 199168000 30462 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 48625 30462 206 433 0 48189 0
[pid=27154/tid=27159] ppid=27152 vsize=194500 CPUtime=51.07 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 9077 0 0 0 5102 5 0 0 20 0 3 0 285087272 199168000 30462 33554432000 4194304 5964478 140736058943520 140582622758904 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=194500 CPUtime=51.07 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 20147 0 0 0 5095 12 0 0 20 0 3 0 285087272 199168000 30462 33554432000 4194304 5964478 140736058943520 140582612269176 4400099 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.13
Current children cumulated vsize (KiB) 194500

[startup+102.307 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30741452/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=267704 CPUtime=204.52 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 42528 0 0 0 20430 22 0 0 20 0 3 0 285087271 274128896 44199 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 66926 44199 206 433 0 66490 0
[pid=27154/tid=27159] ppid=27152 vsize=267704 CPUtime=102.27 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 12867 0 0 0 10218 9 0 0 20 0 3 0 285087272 274128896 44199 33554432000 4194304 5964478 140736058943520 140582622758712 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=267704 CPUtime=102.27 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 28806 0 0 0 10211 16 0 0 20 0 3 0 285087272 274128896 44199 33554432000 4194304 5964478 140736058943520 140582612269416 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.52
Current children cumulated vsize (KiB) 267704

[startup+162.3 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30682132/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=272732 CPUtime=324.49 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 49609 0 0 0 32419 30 0 0 20 0 3 0 285087271 279277568 51308 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 68183 51308 206 433 0 67747 0
[pid=27154/tid=27159] ppid=27152 vsize=272732 CPUtime=162.27 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 14726 0 0 0 16215 12 0 0 20 0 3 0 285087272 279277568 51308 33554432000 4194304 5964478 140736058943520 140582622758952 4400406 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=272732 CPUtime=162.27 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 34028 0 0 0 16203 24 0 0 20 0 3 0 285087272 279277568 51308 33554432000 4194304 5964478 140736058943520 140582612269368 4400071 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.49
Current children cumulated vsize (KiB) 272732

[startup+222.3 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30646160/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=278980 CPUtime=444.45 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 54711 0 0 0 44408 37 0 0 20 0 3 0 285087271 285675520 56522 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 69745 56522 206 433 0 69309 0
[pid=27154/tid=27159] ppid=27152 vsize=278980 CPUtime=222.27 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 16400 0 0 0 22212 15 0 0 20 0 3 0 285087272 285675520 56522 33554432000 4194304 5964478 140736058943520 140582622758904 4400416 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=278980 CPUtime=222.25 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 37456 0 0 0 22195 30 0 0 20 0 3 0 285087272 285675520 56522 33554432000 4194304 5964478 140736058943520 140582612269368 4400071 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.45
Current children cumulated vsize (KiB) 278980

################
# More data... #
################

/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 19975 0 0 0 28206 20 0 0 20 0 3 0 285087272 361517056 63947 33554432000 4194304 5964478 140736058943520 140582622758712 4400071 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=353044 CPUtime=282.25 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 41371 0 0 0 28189 36 0 0 20 0 3 0 285087272 361517056 63947 33554432000 4194304 5964478 140736058943520 140582612269176 4400075 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.43
Current children cumulated vsize (KiB) 353044

[startup+342.3 s]
/proc/loadavg: 4.02 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30544920/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=430032 CPUtime=684.41 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 72449 0 0 0 68381 60 0 0 20 0 3 0 285087271 440352768 74195 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 107508 74195 206 433 0 107072 0
[pid=27154/tid=27159] ppid=27152 vsize=430032 CPUtime=342.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 23895 0 0 0 34201 25 0 0 20 0 3 0 285087272 440352768 74195 33554432000 4194304 5964478 140736058943520 140582622758904 4400099 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=430032 CPUtime=342.26 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 47699 0 0 0 34179 47 0 0 20 0 3 0 285087272 440352768 74195 33554432000 4194304 5964478 140736058943520 140582612269368 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.41
Current children cumulated vsize (KiB) 430032

[startup+402.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30487920/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=442152 CPUtime=804.39 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 84118 0 0 0 80368 71 0 0 20 0 3 0 285087271 452763648 85861 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 110538 85861 206 433 0 110102 0
[pid=27154/tid=27159] ppid=27152 vsize=442152 CPUtime=402.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 26254 0 0 0 40198 28 0 0 20 0 3 0 285087272 452763648 85861 33554432000 4194304 5964478 140736058943520 140582622758712 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=442152 CPUtime=402.26 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 57009 0 0 0 40169 57 0 0 20 0 3 0 285087272 452763648 85861 33554432000 4194304 5964478 140736058943520 140582612269416 4400093 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.39
Current children cumulated vsize (KiB) 442152

[startup+462.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30415140/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=517176 CPUtime=924.35 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 98954 0 0 0 92348 87 0 0 20 0 3 0 285087271 529588224 100922 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 129294 100922 206 433 0 128858 0
[pid=27154/tid=27159] ppid=27152 vsize=517176 CPUtime=462.27 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 29489 0 0 0 46195 32 0 0 20 0 3 0 285087272 529588224 100922 33554432000 4194304 5964478 140736058943520 140582622758712 4400075 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=517176 CPUtime=462.24 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 68610 0 0 0 46153 71 0 0 20 0 3 0 285087272 529588224 100922 33554432000 4194304 5964478 140736058943520 140582612269368 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.35
Current children cumulated vsize (KiB) 517176

[startup+522.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30377524/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=524484 CPUtime=1044.32 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 105267 0 0 0 104336 96 0 0 20 0 3 0 285087271 537071616 107370 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 131121 107370 206 433 0 130685 0
[pid=27154/tid=27159] ppid=27152 vsize=524484 CPUtime=522.25 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 29568 0 0 0 52193 32 0 0 20 0 3 0 285087272 537071616 107370 33554432000 4194304 5964478 140736058943520 140582622758952 4400071 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=524484 CPUtime=522.24 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 74844 0 0 0 52145 79 0 0 20 0 3 0 285087272 537071616 107370 33554432000 4194304 5964478 140736058943520 140582612269368 4400500 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.32
Current children cumulated vsize (KiB) 524484

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27199
/proc/meminfo: memFree=30368224/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=528804 CPUtime=1164.3 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 108548 0 0 0 116330 100 0 0 20 0 3 0 285087271 541495296 110651 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 132201 110651 206 433 0 131765 0
[pid=27154/tid=27159] ppid=27152 vsize=528804 CPUtime=582.25 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 29945 0 0 0 58192 33 0 0 20 0 3 0 285087272 541495296 110651 33554432000 4194304 5964478 140736058943520 140582622758952 4400090 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=528804 CPUtime=582.24 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 77748 0 0 0 58140 84 0 0 20 0 3 0 285087272 541495296 110651 33554432000 4194304 5964478 140736058943520 140582612269368 4400075 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.3
Current children cumulated vsize (KiB) 528804

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/182 27202
/proc/meminfo: memFree=30320556/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=533292 CPUtime=1284.28 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 117184 0 0 0 128317 111 0 0 20 0 3 0 285087271 546091008 119283 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 133323 119283 206 433 0 132887 0
[pid=27154/tid=27159] ppid=27152 vsize=533292 CPUtime=642.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 35131 0 0 0 64186 40 0 0 20 0 3 0 285087272 546091008 119283 33554432000 4194304 5964478 140736058943520 140582622758712 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=533292 CPUtime=642.25 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 81198 0 0 0 64134 91 0 0 20 0 3 0 285087272 546091008 119283 33554432000 4194304 5964478 140736058943520 140582612269368 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.28
Current children cumulated vsize (KiB) 533292

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27202
/proc/meminfo: memFree=30282380/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=606080 CPUtime=1404.26 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 123953 0 0 0 140304 122 0 0 20 0 3 0 285087271 620625920 126052 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 151520 126052 206 433 0 151084 0
[pid=27154/tid=27159] ppid=27152 vsize=606080 CPUtime=702.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 35149 0 0 0 70185 41 0 0 20 0 3 0 285087272 620625920 126052 33554432000 4194304 5964478 140736058943520 140582622758952 4400040 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=606080 CPUtime=702.25 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 87949 0 0 0 70122 103 0 0 20 0 3 0 285087272 620625920 126052 33554432000 4194304 5964478 140736058943520 140582612269368 4399959 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.26
Current children cumulated vsize (KiB) 606080

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27202
/proc/meminfo: memFree=30252308/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=610240 CPUtime=1524.23 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 130319 0 0 0 152288 135 0 0 20 0 3 0 285087271 624885760 132577 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 152560 132577 206 433 0 152124 0
[pid=27154/tid=27159] ppid=27152 vsize=610240 CPUtime=762.27 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 35411 0 0 0 76185 42 0 0 20 0 3 0 285087272 624885760 132577 33554432000 4194304 5964478 140736058943520 140582622758952 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=610240 CPUtime=762.24 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 94053 0 0 0 76107 117 0 0 20 0 3 0 285087272 624885760 132577 33554432000 4194304 5964478 140736058943520 140582612269368 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.23
Current children cumulated vsize (KiB) 610240

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/182 27203
/proc/meminfo: memFree=30222204/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=681356 CPUtime=1644.19 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 136864 0 0 0 164273 146 0 0 20 0 3 0 285087271 697708544 139223 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 170339 139223 206 433 0 169903 0
[pid=27154/tid=27159] ppid=27152 vsize=681356 CPUtime=822.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 37433 0 0 0 82181 45 0 0 20 0 3 0 285087272 697708544 139223 33554432000 4194304 5964478 140736058943520 140582622758712 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=681356 CPUtime=822.23 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 98576 0 0 0 82096 127 0 0 20 0 3 0 285087272 697708544 139223 33554432000 4194304 5964478 140736058943520 140582612269368 4399994 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.19
Current children cumulated vsize (KiB) 681356

[startup+882.3 s]
/proc/loadavg: 4.06 4.00 3.93 5/181 27204
/proc/meminfo: memFree=30201436/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=683516 CPUtime=1764.17 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 141029 0 0 0 176261 156 0 0 20 0 3 0 285087271 699920384 143405 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 170879 143405 206 433 0 170443 0
[pid=27154/tid=27159] ppid=27152 vsize=683516 CPUtime=882.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 38244 0 0 0 88180 46 0 0 20 0 3 0 285087272 699920384 143405 33554432000 4194304 5964478 140736058943520 140582622758904 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=683516 CPUtime=882.23 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 101930 0 0 0 88086 137 0 0 20 0 3 0 285087272 699920384 143405 33554432000 4194304 5964478 140736058943520 140582612269368 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.17
Current children cumulated vsize (KiB) 683516



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.04 4.00 3.93 5/181 27204
/proc/meminfo: memFree=30194100/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=686088 CPUtime=1800.18 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 142623 0 0 0 179859 159 0 0 20 0 3 0 285087271 702554112 144985 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 171522 144985 206 433 0 171086 0
[pid=27154/tid=27159] ppid=27152 vsize=686088 CPUtime=900.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 39097 0 0 0 89979 47 0 0 20 0 3 0 285087272 702554112 144985 33554432000 4194304 5964478 140736058943520 140582622758712 4400075 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=686088 CPUtime=900.24 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 102671 0 0 0 89885 139 0 0 20 0 3 0 285087272 702554112 144985 33554432000 4194304 5964478 140736058943520 140582612269368 4400075 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.18
Current children cumulated vsize (KiB) 686088

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.04 4.00 3.93 5/181 27204
/proc/meminfo: memFree=30194100/32873648 swapFree=7112/7112
[pid=27154] ppid=27152 vsize=686088 CPUtime=1800.18 cores=0,2,4,6
/proc/27154/stat : 27154 (pwbo2.01) S 27152 27154 26380 0 -1 4202496 142623 0 0 0 179859 159 0 0 20 0 3 0 285087271 702554112 144985 33554432000 4194304 5964478 140736058943520 140736058943040 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/27154/statm: 171522 144985 206 433 0 171086 0
[pid=27154/tid=27159] ppid=27152 vsize=686088 CPUtime=900.26 cores=0,2,4,6
/proc/27154/task/27159/stat : 27159 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 39097 0 0 0 89979 47 0 0 20 0 3 0 285087272 702554112 144985 33554432000 4194304 5964478 140736058943520 140582622758712 4400075 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=27154/tid=27160] ppid=27152 vsize=686088 CPUtime=900.24 cores=0,2,4,6
/proc/27154/task/27160/stat : 27160 (pwbo2.01) R 27152 27154 26380 0 -1 4202560 102671 0 0 0 89885 139 0 0 20 0 3 0 285087272 702554112 144985 33554432000 4194304 5964478 140736058943520 140582612269368 4400075 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.18
Current children cumulated vsize (KiB) 686088

Child status: 0
Real time (s): 900.324
CPU time (s): 1800.54
CPU user time (s): 1798.65
CPU system time (s): 1.88971
CPU usage (%): 199.988
Max. virtual memory (cumulated for all children) (KiB): 686088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.65
system time used= 1.88971
maximum resident set size= 579948
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 142625
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 525
involuntary context switches= 1924

runsolver used 1.74973 second user time and 5.2762 second system time

The end

Launcher Data 

Begin job on node126 at 2012-05-28 09:20:14
IDJOB=3712437
IDBENCH=78687
IDSOLVER=2292
FILE ID=node126/3712437-1338189614
RUNJOBID= node126-1338182394-26396
PBS_JOBID= 14624566
Free space on /tmp= 71356 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/normalized-chnl15_25_pb.cnf.cr--soft-33-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712437-1338189614/watcher-3712437-1338189614 -o /tmp/evaluation-result-3712437-1338189614/solver-3712437-1338189614 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712437-1338189614.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4fda08e2dc650152cad1c676f7fa8f96
RANDOM SEED=759869211

node126.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31029820 kB
Buffers:          333408 kB
Cached:           680996 kB
SwapCached:        17756 kB
Active:           766136 kB
Inactive:         271040 kB
Active(anon):       4192 kB
Inactive(anon):    20452 kB
Active(file):     761944 kB
Inactive(file):   250588 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67086932 kB
Dirty:              5656 kB
Writeback:             0 kB
AnonPages:         12388 kB
Mapped:             9904 kB
Shmem:                 0 kB
Slab:             669676 kB
SReclaimable:     113932 kB
SUnreclaim:       555744 kB
KernelStack:        1440 kB
PageTables:         3972 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     136780 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71348 MiB
End job on node126 at 2012-05-28 09:35:16