Trace number 3703630

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)-41 1800.02 900.354

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/
~kexu/benchmarks/frb45-21-opb/normalized-frb45-21-5.opb
MD5SUMdadfd792215a2bce735ffb7b3e25dcc5
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-43
Best CPU time to get the best result obtained on this benchmark1800.09
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -44
Optimality of the best value was proved NO
Number of variables945
Total number of constraints58579
Number of constraints which are clauses58579
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 945
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 945
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 945
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703630-1338091641.opb.
0.00/0.00	c Instance file HOME/instance-3703630-1338091641.opb
0.00/0.00	c File size is 1399605 bytes.
0.09/0.10	c Cost Offset: -945
0.09/0.10	c Highest Coefficient sum: 3
0.09/0.10	c ============================[ Problem Statistics ]=============================
0.09/0.10	c |                                                                             |
0.09/0.10	c |  Parsing time:          0.10         s                                      |
0.09/0.10	c |  Number Variables:      945                                                 |
0.09/0.10	c |  Number Clauses:        58579                                               |
0.09/0.10	c |  Number Cardinality:    0                                                   |
0.09/0.10	c |  Number PB Constraints: 0                                                   |
0.09/0.10	c |                                                                             |
0.09/0.13	c |  Problem Type:          Optimization                                        |
0.09/0.13	c |  Objective Function:    Cardinality Constraint                              |
0.09/0.13	c |                                                                             |
0.09/0.13	c ===============================================================================
1800.02/900.31	o -33
1800.02/900.31	o -34
1800.02/900.31	o -35
1800.02/900.31	o -36
1800.02/900.31	o -37
1800.02/900.31	o -38
1800.02/900.31	o -39
1800.02/900.31	o -40
1800.02/900.31	o -41
1800.02/900.31	c ===============================================================================
1800.02/900.31	c Wall Clock Time: 900.31 s
1800.02/900.31	c Best Solution: -41
1800.02/900.31	s SATISFIABLE
1800.02/900.31	v -x945 -x944 -x943 -x942 -x941 -x940 -x939 -x938 -x937 -x936 -x935 -x934 -x933 -x932 -x931 -x930 -x929 -x928 -x927 -x926 x925 -x924 -x923 x922 -x921 -x920 -x919 -x918 -x917 -x916 -x915 -x914 -x913 -x912 -x911 -x910 -x909 -x908 -x907 -x906 -x905 -x904 -x903 -x902 -x901 -x900 -x899 -x898 -x897 -x896 -x895 -x894 -x893 -x892 -x891 x890 -x889 -x888 -x887 -x886 -x885 -x884 -x883 -x882 -x881 -x880 -x879 -x878 -x877 -x876 x875 -x874 -x873 -x872 -x871 -x870 -x869 -x868 -x867 -x866 -x865 -x864 -x863 -x862 -x861 -x860 -x859 -x858 -x857 -x856 -x855 x854 -x853 -x852 -x851 -x850 -x849 -x848 -x847 -x846 -x845 -x844 -x843 -x842 -x841 -x840 -x839 -x838 -x837 -x836 -x835 -x834 -x833 -x832 -x831 x830 -x829 -x828 -x827 -x826 -x825 -x824 -x823 -x822 -x821 -x820 -x819 x818 -x817 -x816 -x815 -x814 -x813 -x812 -x811 -x810 -x809 -x808 -x807 -x806 -x805 -x804 -x803 -x802 -x801 -x800 -x799 -x798 -x797 -x796 -x795 -x794 -x793 -x792 -x791 -x790 -x789 -x788 -x787 -x786 -x785 -x784 -x783 -x782 -x781 -x780 -x779 -x778 -x777 -x776 -x775 -x774 -x773 -x772 -x771 x770 -x769 -x768 -x767 -x766 -x765 -x764 -x763 -x762 -x761 -x760 -x759 -x758 -x757 -x756 -x755 -x754 -x753 -x752 -x751 -x750 -x749 -x748 -x747 -x746 -x745 -x744 -x743 -x742 -x741 -x740 -x739 x738 -x737 -x736 -x735 -x734 -x733 -x732 -x731 -x730 -x729 -x728 -x727 -x726 -x725 -x724 -x723 -x722 -x721 -x720 -x719 x718 -x717 -x716 -x715 -x714 -x713 x712 -x711 -x710 -x709 -x708 -x707 -x706 -x705 -x704 -x703 -x702 -x701 -x700 -x699 -x698 -x697 -x696 -x695 -x694 x693 -x692 -x691 -x690 -x689 -x688 -x687 -x686 -x685 -x684 -x683 -x682 -x681 -x680 -x679 -x678 -x677 -x676 -x675 -x674 -x673 -x672 -x671 -x670 -x669 -x668 -x667 -x666 -x665 -x664 -x663 -x662 -x661 -x660 -x659 -x658 -x657 -x656 -x655 -x654 -x653 x652 -x651 -x650 -x649 x648 -x647 -x646 -x645 -x644 -x643 -x642 -x641 -x640 -x639 -x638 -x637 -x636 -x635 -x634 -x633 -x632 -x631 -x630 -x629 -x628 -x627 -x626 -x625 -x624 -x623 -x622 -x621 -x620 -x619 -x618 -x617 -x616 -x615 -x614 -x613 -x612 -x611 -x610 -x609 -x608 -x607 -x606 -x605 -x604 -x603 -x602 -x601 -x600 -x599 x598 -x597 -x596 -x595 -x594 -x593 -x592 -x591 -x590 -x589 -x588 -x587 x586 -x585 -x584 -x583 -x582 -x581 -x580 -x579 -x578 -x577 -x576 -x575 -x574 -x573 -x572 -x571 -x570 -x569 -x568 -x567 -x566 -x565 -x564 -x563 -x562 -x561 x560 -x559 -x558 -x557 -x556 -x555 -x554 -x553 -x552 -x551 -x550 -x549 -x548 -x547 -x546 -x545 -x544 -x543 -x542 -x541 -x540 -x539 -x538 -x537 -x536 -x535 x534 -x533 -x532 -x531 -x530 -x529 -x528 -x527 -x526 -x525 -x524 -x523 -x522 -x521 -x520 -x519 -x518 -x517 -x516 -x515 -x514 -x513 -x512 -x511 -x510 -x509 -x508 -x507 -x506 -x505 -x504 -x503 -x502 -x501 -x500 -x499 -x498 -x497 -x496 -x495 -x494 -x493 -x492 -x491 -x490 -x489 -x488 -x487 x486 -x485 -x484 -x483 -x482 -x481 -x480 -x479 -x478 -x477 -x476 -x475 -x474 -x473 x472 -x471 -x470 -x469 -x468 -x467 -x466 -x465 -x464 -x463 -x462 -x461 -x460 -x459 -x458 -x457 -x456 -x455 -x454 x453 -x452 -x451 -x450 -x449 -x448 -x447 -x446 -x445 -x444 -x443 -x442 -x441 -x440 -x439 -x438 -x437 -x436 -x435 -x434 -x433 -x432 x431 -x430 -x429 -x428 -x427 -x426 -x425 -x424 -x423 -x422 -x421 -x420 -x419 -x418 -x417 -x416 -x415 -x414 -x413 -x412 -x411 -x410 -x409 -x408 -x407 -x406 -x405 -x404 -x403 -x402 -x401 x400 -x399 -x398 -x397 -x396 -x395 -x394 -x393 -x392 -x391 -x390 -x389 -x388 -x387 -x386 x385 -x384 -x383 -x382 -x381 -x380 -x379 -x378 -x377 -x376 -x375 -x374 -x373 -x372 -x371 -x370 -x369 -x368 -x367 x366 -x365 -x364 -x363 -x362 -x361 -x360 -x359 -x358 -x357 -x356 -x355 -x354 -x353 -x352 -x351 -x350 -x349 -x348 -x347 -x346 -x345 -x344 -x343 -x342 x341 -x340 -x339 -x338 -x337 -x336 -x335 -x334 -x333 -x332 -x331 x330 -x329 -x328 -x327 -x326 -x325 -x324 -x323 -x322 -x321 -x320 -x319 -x318 -x317 -x316 -x315 -x314 -x313 x312 -x311 -x310 -x309 -x308 -x307 -x306 -x305 -x304 -x303 -x302 -x301 -x300 -x299 -x298 -x297 -x296 -x295 -x294 -x293 -x292 -x291 -x290 -x289 -x288 -x287 -x286 -x285 -x284 -x283 -x282 x281 -x280 -x279 -x278 -x277 -x276 -x275 -x274 -x273 -x272 -x271 -x270 -x269 -x268 -x267 -x266 -x265 -x264 -x263 -x262 -x261 -x260 -x259 -x258 -x257 -x256 -x255 -x254 -x253 -x252 -x251 -x250 -x249 -x248 -x247 -x246 x245 -x244 -x243 -x242 -x241 -x240 -x239 -x238 -x237 -x236 -x235 -x234 -x233 -x232 -x231 -x230 -x229 -x228 -x227 -x226 -x225 -x224 -x223 -x222 -x221 x220 -x219 -x218 -x217 -x216 -x215 -x214 -x213 -x212 -x211 -x210 -x209 -x208 -x207 -x206 -x205 -x204 -x203 -x202 -x201 -x200 -x199 -x198 -x197 x196 -x195 -x194 -x193 -x192 -x191 -x190 -x189 x188 -x187 -x186 -x185 -x184 -x183 -x182 -x181 -x180 -x179 -x178 -x177 -x176 -x175 -x174 -x173 -x172 -x171 -x170 -x169 -x168 -x167 -x166 -x165 -x164 -x163 -x162 -x161 -x160 -x159 -x158 -x157 -x156 -x155 -x154 -x153 x152 -x151 -x150 -x149 -x148 -x147 -x146 -x145 -x144 x143 -x142 -x141 -x140 -x139 -x138 -x137 -x136 -x135 -x134 -x133 -x132 -x131 -x130 -x129 -x128 -x127 -x126 -x125 -x124 -x123 -x122 x121 -x120 -x119 -x118 -x117 -x116 -x115 -x114 -x113 -x112 -x111 -x110 -x109 -x108 -x107 -x106 -x105 -x104 -x103 -x102 -x101 -x100 -x99 -x98 -x97 -x96 -x95 -x94 -x93 -x92 -x91 -x90 -x89 -x88 x87 -x86 -x85 -x84 -x83 -x82 -x81 -x80 -x79 -x78 -x77 -x76 -x75 x74 -x73 -x72 -x71 -x70 -x69 -x68 -x67 -x66 -x65 -x64 -x63 -x62 -x61 -x60 -x59 -x58 -x57 -x56 -x55 x54 -x53 -x52 -x51 -x50 -x49 -x48 -x47 -x46 -x45 -x44 -x43 -x42 -x41 -x40 -x39 -x38 -x37 -x36 -x35 -x34 x33 -x32 -x31 -x30 -x29 -x28 -x27 -x26 -x25 -x24 -x23 -x22 -x21 -x20 -x19 -x18 -x17 -x16 -x15 -x14 x13 -x12 -x11 -x10 -x9 -x8 -x7 -x6 -x5 -x4 -x3 -x2 -x1

Verifier Data 

OK	-41

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703630-1338091641/watcher-3703630-1338091641 -o /tmp/evaluation-result-3703630-1338091641/solver-3703630-1338091641 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703630-1338091641.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.00 3.92 4/178 25591
/proc/meminfo: memFree=30403188/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=5960 CPUtime=0 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) R 25589 25591 25163 0 -1 4202496 464 0 0 0 0 0 0 0 20 0 1 0 275289542 6103040 416 33554432000 4194304 5965102 140734976063312 140736179590952 4350598 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 1490 416 171 433 0 712 0

[startup+0.0946469 s]
/proc/loadavg: 4.00 4.00 3.92 4/178 25591
/proc/meminfo: memFree=30403188/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=14084 CPUtime=0.08 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) R 25589 25591 25163 0 -1 4202496 2830 0 0 0 8 0 0 0 20 0 1 0 275289542 14422016 2717 33554432000 4194304 5965102 140734976063312 140736179590952 5137146 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 3521 2717 468 433 0 2743 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 14084

[startup+0.100355 s]
/proc/loadavg: 4.00 4.00 3.92 4/178 25591
/proc/meminfo: memFree=30403188/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=14612 CPUtime=0.09 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) R 25589 25591 25163 0 -1 4202496 2981 0 0 0 9 0 0 0 20 0 1 0 275289542 14962688 2867 33554432000 4194304 5965102 140734976063312 140736179590952 4351217 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 3653 2867 488 433 0 2875 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 14612

[startup+0.300192 s]
/proc/loadavg: 4.00 4.00 3.92 4/178 25591
/proc/meminfo: memFree=30403188/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=178228 CPUtime=0.46 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 12230 0 0 0 41 5 0 0 20 0 3 0 275289542 182505472 11523 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 44557 11523 203 433 0 44121 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 178228

[startup+0.700182 s]
/proc/loadavg: 4.00 4.00 3.92 4/178 25591
/proc/meminfo: memFree=30403188/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=178228 CPUtime=1.26 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 12266 0 0 0 120 6 0 0 20 0 3 0 275289542 182505472 11559 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 44557 11559 205 433 0 44121 0
Current children cumulated CPU time (s) 1.26
Current children cumulated vsize (KiB) 178228

[startup+1.50031 s]
/proc/loadavg: 3.92 3.99 3.91 5/181 25594
/proc/meminfo: memFree=30338676/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=178228 CPUtime=2.86 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 12377 0 0 0 280 6 0 0 20 0 3 0 275289542 182505472 11670 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 44557 11670 205 433 0 44121 0
[pid=25591/tid=25593] ppid=25589 vsize=178228 CPUtime=1.38 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 3810 0 0 0 136 2 0 0 20 0 3 0 275289553 182505472 11670 33554432000 4194304 5965102 140734976063312 140240808372680 5139774 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=178228 CPUtime=1.37 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 5030 0 0 0 133 4 0 0 20 0 3 0 275289553 182505472 11670 33554432000 4194304 5965102 140734976063312 140240797882488 4220675 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 178228

[startup+3.1003 s]
/proc/loadavg: 3.92 3.99 3.91 5/181 25594
/proc/meminfo: memFree=30336924/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=178228 CPUtime=6.06 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 12748 0 0 0 599 7 0 0 20 0 3 0 275289542 182505472 12041 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 44557 12041 205 433 0 44121 0
[pid=25591/tid=25593] ppid=25589 vsize=178228 CPUtime=2.97 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 4042 0 0 0 295 2 0 0 20 0 3 0 275289553 182505472 12041 33554432000 4194304 5965102 140734976063312 140240808372760 5134521 0 0 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=178228 CPUtime=2.97 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 5169 0 0 0 293 4 0 0 20 0 3 0 275289553 182505472 12041 33554432000 4194304 5965102 140734976063312 140240797882680 4401619 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.06
Current children cumulated vsize (KiB) 178228

[startup+6.30023 s]
/proc/loadavg: 3.93 3.99 3.91 5/181 25594
/proc/meminfo: memFree=30324848/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=178228 CPUtime=12.46 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 14762 0 0 0 1238 8 0 0 20 0 3 0 275289542 182505472 14055 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 44557 14056 205 433 0 44121 0
[pid=25591/tid=25593] ppid=25589 vsize=178228 CPUtime=6.15 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 4706 0 0 0 613 2 0 0 20 0 3 0 275289553 182505472 14056 33554432000 4194304 5965102 140734976063312 140240808372760 5143165 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=178228 CPUtime=6.17 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 6520 0 0 0 612 5 0 0 20 0 3 0 275289553 182505472 14056 33554432000 4194304 5965102 140734976063312 140240797882680 5137076 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.46
Current children cumulated vsize (KiB) 178228

[startup+12.7002 s]
/proc/loadavg: 3.93 3.99 3.91 5/181 25594
/proc/meminfo: memFree=30271544/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=178228 CPUtime=25.25 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 28867 0 0 0 2513 12 0 0 20 0 3 0 275289542 182505472 20756 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 44557 20756 206 433 0 44121 0
[pid=25591/tid=25593] ppid=25589 vsize=178228 CPUtime=12.54 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 13359 0 0 0 1250 4 0 0 20 0 3 0 275289553 182505472 20756 33554432000 4194304 5965102 140734976063312 140240808372760 5136313 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=178228 CPUtime=12.54 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 11971 0 0 0 1247 7 0 0 20 0 3 0 275289553 182505472 20756 33554432000 4194304 5965102 140734976063312 140240797882680 4401107 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.25
Current children cumulated vsize (KiB) 178228

[startup+25.5003 s]
/proc/loadavg: 3.95 3.99 3.91 5/181 25594
/proc/meminfo: memFree=30176320/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=244488 CPUtime=50.85 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 46349 0 0 0 5066 19 0 0 20 0 3 0 275289542 250355712 32835 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 61122 32835 206 433 0 60686 0
[pid=25591/tid=25593] ppid=25589 vsize=244488 CPUtime=25.31 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 23026 0 0 0 2524 7 0 0 20 0 3 0 275289553 250355712 32835 33554432000 4194304 5965102 140734976063312 140240808372264 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=244488 CPUtime=25.31 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 19786 0 0 0 2521 10 0 0 20 0 3 0 275289553 250355712 32835 33554432000 4194304 5965102 140734976063312 140240797882680 4401559 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.85
Current children cumulated vsize (KiB) 244488

[startup+51.1003 s]
/proc/loadavg: 3.96 3.99 3.91 5/181 25594
/proc/meminfo: memFree=29999836/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=310384 CPUtime=102.04 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 68439 0 0 0 10172 32 0 0 20 0 3 0 275289542 317833216 54783 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 77596 54783 206 433 0 77160 0
[pid=25591/tid=25593] ppid=25589 vsize=310384 CPUtime=50.84 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 30871 0 0 0 5072 12 0 0 20 0 3 0 275289553 317833216 54783 33554432000 4194304 5965102 140734976063312 140240808373176 4401082 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=310384 CPUtime=50.84 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 34031 0 0 0 5065 19 0 0 20 0 3 0 275289553 317833216 54783 33554432000 4194304 5965102 140734976063312 140240797882680 4401559 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.04
Current children cumulated vsize (KiB) 310384

[startup+102.307 s]
/proc/loadavg: 3.98 3.99 3.91 5/181 25594
/proc/meminfo: memFree=29821692/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=442664 CPUtime=204.43 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 96963 0 0 0 20388 55 0 0 20 0 3 0 275289542 453287936 83307 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 110666 83307 206 433 0 110230 0
[pid=25591/tid=25593] ppid=25589 vsize=442664 CPUtime=101.92 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 35100 0 0 0 10176 16 0 0 20 0 3 0 275289553 453287936 83307 33554432000 4194304 5965102 140734976063312 140240808372024 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=442664 CPUtime=101.91 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 58326 0 0 0 10151 40 0 0 20 0 3 0 275289553 453287936 83307 33554432000 4194304 5965102 140734976063312 140240797882680 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.43
Current children cumulated vsize (KiB) 442664

[startup+162.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/182 25597
/proc/meminfo: memFree=29524512/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=508624 CPUtime=324.4 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 128002 0 0 0 32362 78 0 0 20 0 3 0 275289542 520830976 114501 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 127156 114501 206 433 0 126720 0
[pid=25591/tid=25593] ppid=25589 vsize=508624 CPUtime=161.76 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 41343 0 0 0 16154 22 0 0 20 0 3 0 275289553 520830976 114501 33554432000 4194304 5965102 140734976063312 140240808373176 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=508624 CPUtime=161.74 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 83122 0 0 0 16115 59 0 0 20 0 3 0 275289553 520830976 114501 33554432000 4194304 5965102 140734976063312 140240797882680 4401800 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.4
Current children cumulated vsize (KiB) 508624

[startup+222.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25597
/proc/meminfo: memFree=29345024/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=640912 CPUtime=444.35 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 147607 0 0 0 44341 94 0 0 20 0 3 0 275289542 656293888 131972 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 160228 131972 206 433 0 159792 0
[pid=25591/tid=25593] ppid=25589 vsize=640912 CPUtime=221.6 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 41503 0 0 0 22137 23 0 0 20 0 3 0 275289553 656293888 131972 33554432000 4194304 5965102 140734976063312 140240808373064 4401475 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=640912 CPUtime=221.55 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 102567 0 0 0 22079 76 0 0 20 0 3 0 275289553 656293888 131972 33554432000 4194304 5965102 140734976063312 140240797882680 4410257 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.35
Current children cumulated vsize (KiB) 640912

[startup+282.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25598
/proc/meminfo: memFree=29247224/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=641072 CPUtime=564.29 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 147718 0 0 0 56335 94 0 0 20 0 3 0 275289542 656457728 132543 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 160268 132543 206 433 0 159832 0
[pid=25591/tid=25593] ppid=25589 vsize=641072 CPUtime=281.43 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 41540 0 0 0 28119 24 0 0 20 0 3 0 275289553 656457728 132543 33554432000 4194304 5965102 140734976063312 140240808373064 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=641072 CPUtime=281.37 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 102641 0 0 0 28060 77 0 0 20 0 3 0 275289553 656457728 132543 33554432000 4194304 5965102 140734976063312 140240797882440 4389907 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.29
Current children cumulated vsize (KiB) 641072

[startup+342.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25598
/proc/meminfo: memFree=29110608/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=706764 CPUtime=684.24 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 154135 0 0 0 68326 98 0 0 20 0 3 0 275289542 723726336 138929 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 176691 138929 206 433 0 176255 0

################
# More data... #
################

[pid=25591/tid=25594] ppid=25589 vsize=706764 CPUtime=341.18 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 102725 0 0 0 34040 78 0 0 20 0 3 0 275289553 723726336 138929 33554432000 4194304 5965102 140734976063312 140240797882440 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.24
Current children cumulated vsize (KiB) 706764

[startup+402.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25598
/proc/meminfo: memFree=29036860/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=706764 CPUtime=804.18 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 154203 0 0 0 80320 98 0 0 20 0 3 0 275289542 723726336 138951 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 176691 138951 206 433 0 176255 0
[pid=25591/tid=25593] ppid=25589 vsize=706764 CPUtime=401.11 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 47887 0 0 0 40081 30 0 0 20 0 3 0 275289553 723726336 138951 33554432000 4194304 5965102 140734976063312 140240808372760 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=706764 CPUtime=400.99 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 102779 0 0 0 40020 79 0 0 20 0 3 0 275289553 723726336 138951 33554432000 4194304 5965102 140734976063312 140240797882440 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.18
Current children cumulated vsize (KiB) 706764

[startup+462.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25598
/proc/meminfo: memFree=28970164/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=706908 CPUtime=924.15 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 155583 0 0 0 92316 99 0 0 20 0 3 0 275289542 723873792 141324 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 176727 141324 206 433 0 176291 0
[pid=25591/tid=25593] ppid=25589 vsize=706908 CPUtime=460.94 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 49253 0 0 0 46063 31 0 0 20 0 3 0 275289553 723873792 141324 33554432000 4194304 5965102 140734976063312 140240808372024 4401009 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=706908 CPUtime=460.83 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 102793 0 0 0 46004 79 0 0 20 0 3 0 275289553 723873792 141324 33554432000 4194304 5965102 140734976063312 140240797882440 4401131 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.15
Current children cumulated vsize (KiB) 706908

[startup+522.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25598
/proc/meminfo: memFree=28911456/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=707040 CPUtime=1044.13 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 161603 0 0 0 104311 102 0 0 20 0 3 0 275289542 724008960 147336 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 176760 147336 206 433 0 176324 0
[pid=25591/tid=25593] ppid=25589 vsize=707040 CPUtime=520.79 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 55239 0 0 0 52045 34 0 0 20 0 3 0 275289553 724008960 147336 33554432000 4194304 5965102 140734976063312 140240808372024 4401041 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=707040 CPUtime=520.68 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 102827 0 0 0 51988 80 0 0 20 0 3 0 275289553 724008960 147336 33554432000 4194304 5965102 140734976063312 140240797882440 4401559 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.13
Current children cumulated vsize (KiB) 707040

[startup+582.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25599
/proc/meminfo: memFree=28794540/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=774340 CPUtime=1164.11 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 184498 0 0 0 116293 118 0 0 20 0 3 0 275289542 792924160 170231 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 193585 170231 206 433 0 193149 0
[pid=25591/tid=25593] ppid=25589 vsize=774340 CPUtime=580.64 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 61985 0 0 0 58023 41 0 0 20 0 3 0 275289553 792924160 170231 33554432000 4194304 5965102 140734976063312 140240808372024 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=774340 CPUtime=580.52 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 118976 0 0 0 57960 92 0 0 20 0 3 0 275289553 792924160 170231 33554432000 4194304 5965102 140734976063312 140240797882680 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.11
Current children cumulated vsize (KiB) 774340

[startup+642.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25599
/proc/meminfo: memFree=28652676/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=905684 CPUtime=1284.11 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 214724 0 0 0 128267 144 0 0 20 0 3 0 275289542 927420416 200457 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 226421 200457 206 433 0 225985 0
[pid=25591/tid=25593] ppid=25589 vsize=905684 CPUtime=640.49 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 66906 0 0 0 64003 46 0 0 20 0 3 0 275289553 927420416 200457 33554432000 4194304 5965102 140734976063312 140240808372024 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=905684 CPUtime=640.37 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 144281 0 0 0 63923 114 0 0 20 0 3 0 275289553 927420416 200457 33554432000 4194304 5965102 140734976063312 140240797882680 4401475 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.11
Current children cumulated vsize (KiB) 905684

[startup+702.3 s]
/proc/loadavg: 3.99 3.99 3.91 5/181 25599
/proc/meminfo: memFree=28535276/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=971536 CPUtime=1404.08 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 243426 0 0 0 140242 166 0 0 20 0 3 0 275289542 994852864 229159 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 242884 229160 206 433 0 242448 0
[pid=25591/tid=25593] ppid=25589 vsize=971536 CPUtime=700.33 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 75011 0 0 0 69980 53 0 0 20 0 3 0 275289553 994852864 229160 33554432000 4194304 5965102 140734976063312 140240808372216 4401155 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=971536 CPUtime=700.2 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 164879 0 0 0 69888 132 0 0 20 0 3 0 275289553 994852864 229160 33554432000 4194304 5965102 140734976063312 140240797882680 5137076 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.08
Current children cumulated vsize (KiB) 971536

[startup+762.307 s]
/proc/loadavg: 4.06 4.00 3.92 5/182 25602
/proc/meminfo: memFree=28411388/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=1168292 CPUtime=1524.06 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 273119 0 0 0 152217 189 0 0 20 0 3 0 275289542 1196331008 258852 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 292073 258852 206 433 0 291637 0
[pid=25591/tid=25593] ppid=25589 vsize=1168292 CPUtime=760.18 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 81706 0 0 0 75959 59 0 0 20 0 3 0 275289553 1196331008 258852 33554432000 4194304 5965102 140734976063312 140240808372216 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=1168292 CPUtime=760.05 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 187876 0 0 0 75854 151 0 0 20 0 3 0 275289553 1196331008 258852 33554432000 4194304 5965102 140734976063312 140240797882680 4401137 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.06
Current children cumulated vsize (KiB) 1168292

[startup+822.3 s]
/proc/loadavg: 4.02 4.00 3.92 5/181 25602
/proc/meminfo: memFree=28375620/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=1169100 CPUtime=1644.04 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 280378 0 0 0 164209 195 0 0 20 0 3 0 275289542 1197158400 266110 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 292275 266110 206 433 0 291839 0
[pid=25591/tid=25593] ppid=25589 vsize=1169100 CPUtime=820.02 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 84880 0 0 0 81939 63 0 0 20 0 3 0 275289553 1197158400 266110 33554432000 4194304 5965102 140734976063312 140240808372264 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=1169100 CPUtime=819.89 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 191961 0 0 0 81834 155 0 0 20 0 3 0 275289553 1197158400 266110 33554432000 4194304 5965102 140734976063312 140240797882680 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.04
Current children cumulated vsize (KiB) 1169100

[startup+882.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/181 25603
/proc/meminfo: memFree=28348616/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=1169252 CPUtime=1764.02 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 280682 0 0 0 176207 195 0 0 20 0 3 0 275289542 1197314048 266414 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 292313 266414 206 433 0 291877 0
[pid=25591/tid=25593] ppid=25589 vsize=1169252 CPUtime=879.87 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 85175 0 0 0 87923 64 0 0 20 0 3 0 275289553 1197314048 266414 33554432000 4194304 5965102 140734976063312 140240808372024 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=1169252 CPUtime=879.73 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 191970 0 0 0 87817 156 0 0 20 0 3 0 275289553 1197314048 266414 33554432000 4194304 5965102 140734976063312 140240797882440 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.02
Current children cumulated vsize (KiB) 1169252



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 4.00 3.92 3/178 25604
/proc/meminfo: memFree=29360840/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=1169252 CPUtime=1800.02 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 280807 0 0 0 179807 195 0 0 20 0 3 0 275289542 1197314048 266539 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 292313 266539 206 433 0 291877 0
[pid=25591/tid=25593] ppid=25589 vsize=1169252 CPUtime=897.83 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 85270 0 0 0 89719 64 0 0 20 0 3 0 275289553 1197314048 266539 33554432000 4194304 5965102 140734976063312 140240808372024 4401582 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=1169252 CPUtime=897.69 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 192000 0 0 0 89613 156 0 0 20 0 3 0 275289553 1197314048 266539 33554432000 4194304 5965102 140734976063312 140240797882440 4401143 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1169252

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 4.00 3.92 3/178 25604
/proc/meminfo: memFree=29360840/32873648 swapFree=7108/7108
[pid=25591] ppid=25589 vsize=1169252 CPUtime=1800.02 cores=0,2,4,6
/proc/25591/stat : 25591 (pwbo2.0) S 25589 25591 25163 0 -1 4202496 280807 0 0 0 179807 195 0 0 20 0 3 0 275289542 1197314048 266539 33554432000 4194304 5965102 140734976063312 140734976062832 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/25591/statm: 292313 266539 206 433 0 291877 0
[pid=25591/tid=25593] ppid=25589 vsize=1169252 CPUtime=897.83 cores=0,2,4,6
/proc/25591/task/25593/stat : 25593 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 85270 0 0 0 89719 64 0 0 20 0 3 0 275289553 1197314048 266539 33554432000 4194304 5965102 140734976063312 140240808372024 4401582 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=25591/tid=25594] ppid=25589 vsize=1169252 CPUtime=897.69 cores=0,2,4,6
/proc/25591/task/25594/stat : 25594 (pwbo2.0) R 25589 25591 25163 0 -1 4202560 192000 0 0 0 89613 156 0 0 20 0 3 0 275289553 1197314048 266539 33554432000 4194304 5965102 140734976063312 140240797882440 4401143 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1169252

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25591 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=423358
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=266655
# CPU time returned by wait4() is 1795.69
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.354
CPU time (s): 1800.02
CPU user time (s): 1798.07
CPU system time (s): 1.95
CPU usage (%): 199.924
Max. virtual memory (cumulated for all children) (KiB): 1169252

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.42
system time used= 2.26666
maximum resident set size= 1066168
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 280810
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1253
involuntary context switches= 1891

runsolver used 2.20966 second user time and 4.78527 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-27 06:07:21
IDJOB=3703630
IDBENCH=2254
IDSOLVER=2279
FILE ID=node123/3703630-1338091641
RUNJOBID= node123-1338088025-25179
PBS_JOBID= 14624452
Free space on /tmp= 71684 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/~kexu/benchmarks/frb45-21-opb/normalized-frb45-21-5.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703630-1338091641/watcher-3703630-1338091641 -o /tmp/evaluation-result-3703630-1338091641/solver-3703630-1338091641 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703630-1338091641.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dadfd792215a2bce735ffb7b3e25dcc5
RANDOM SEED=3088836

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30410256 kB
Buffers:          274284 kB
Cached:          1360980 kB
SwapCached:         1808 kB
Active:           700304 kB
Inactive:         966764 kB
Active(anon):      23012 kB
Inactive(anon):    10968 kB
Active(file):     677292 kB
Inactive(file):   955796 kB
Unevictable:        7108 kB
Mlocked:            7108 kB
SwapTotal:      67108856 kB
SwapFree:       67104820 kB
Dirty:             13316 kB
Writeback:             0 kB
AnonPages:         37016 kB
Mapped:            14780 kB
Shmem:               100 kB
Slab:             657720 kB
SReclaimable:     102216 kB
SUnreclaim:       555504 kB
KernelStack:        1448 kB
PageTables:         4416 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     164944 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71680 MiB
End job on node123 at 2012-05-27 06:22:23