Trace number 3725777

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)465 1800.02 900.335

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/
miplib2003/normalized-mps-v2-20-10-seymour.opb
MD5SUM97ebaccbda37d5c570b4e2ec3cd7f8f0
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark425
Best CPU time to get the best result obtained on this benchmark1789.74
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 425
Optimality of the best value was proved NO
Number of variables1372
Total number of constraints4944
Number of constraints which are clauses4944
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint19
Number of terms in the objective function 1372
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1372
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1372
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3725777-1338651516.opb.
0.00/0.00	c Instance file HOME/instance-3725777-1338651516.opb
0.00/0.00	c File size is 324105 bytes.
0.01/0.03	c Cost Offset: 0
0.01/0.03	c Highest Coefficient sum: 20
0.01/0.03	c ============================[ Problem Statistics ]=============================
0.01/0.03	c |                                                                             |
0.01/0.03	c |  Parsing time:          0.03         s                                      |
0.01/0.03	c |  Number Variables:      1372                                                |
0.01/0.03	c |  Number Clauses:        4944                                                |
0.01/0.03	c |  Number Cardinality:    0                                                   |
0.01/0.03	c |  Number PB Constraints: 0                                                   |
0.01/0.03	c |                                                                             |
0.01/0.03	c |  Problem Type:          Optimization                                        |
0.01/0.03	c |  Objective Function:    Cardinality Constraint                              |
0.01/0.03	c |                                                                             |
0.01/0.03	c ===============================================================================
1800.02/900.31	o 465
1800.02/900.31	c ===============================================================================
1800.02/900.31	c Wall Clock Time: 900.31 s
1800.02/900.31	c Best Solution: 465
1800.02/900.31	s SATISFIABLE
1800.02/900.31	v -x1 x485 x596 x707 x818 -x929 x1040 x1151 x1262 -x2 x113 -x224 x335 -x419 -x430 x441 -x452 -x463 x474 -x486 -x497 -x508 x519 x530 -x541 x552 x563 x574 -x585 -x597 -x608 x619 x630 x641 x652 x663 x674 x685 -x696 x708 x719 x730 x741 -x752 x763 x774 x785 -x796 -x807 x819 x830 x841 x852 x863 x874 x885 x896 x907 x918 -x930 -x941 x952 x963 x974 -x985 x996 x1007 x1018 x1029 x1041 x1052 x1063 -x1074 -x1085 -x1096 x1107 -x1118 -x1129 -x1140 x1152 x1163 x1174 x1185 -x1196 x1207 x1218 x1229 x1240 x1251 x1263 x1274 x1285 -x1296 x1307 x1318 x1329 -x1340 x1351 x1362 x3 -x14 x25 x36 x47 -x58 -x69 x80 -x91 x102 -x114 x125 x136 x147 -x158 -x169 -x180 x191 -x202 x213 x225 x236 -x247 -x258 x269 -x280 x291 x302 -x313 -x324 x336 x347 x358 -x369 -x380 -x391 x402 -x413 -x417 -x418 -x420 x421 x422 x423 x424 x425 -x426 -x427 -x428 x429 x431 -x432 x433 x434 x435 -x436 -x437 x438 -x439 x440 -x442 x443 -x444 x445 x446 x447 x448 -x449 x450 -x451 x453 x454 -x455 -x456 x457 -x458 -x459 -x460 x461 x462 -x464 x465 x466 x467 -x468 x469 x470 x471 -x472 -x473 x475 -x476 -x477 x478 x479 -x480 -x481 -x482 -x483 -x484 -x487 x488 x489 x490 x491 x492 -x493 -x494 -x495 -x496 -x498 -x499 x500 x501 -x502 x503 -x504 x505 -x506 x507 -x509 -x510 -x511 -x512 -x513 -x514 -x515 -x516 x517 x518 -x520 -x521 x522 -x523 x524 x525 x526 -x527 -x528 x529 -x531 -x532 -x533 x534 -x535 x536 -x537 x538 -x539 -x540 x542 -x543 x544 x545 -x546 x547 -x548 -x549 x550 -x551 x553 x554 -x555 -x556 x557 -x558 -x559 x560 -x561 x562 -x564 x565 x566 -x567 x568 -x569 -x570 x571 -x572 x573 -x575 -x576 -x577 -x578 -x579 x580 -x581 x582 x583 -x584 x586 -x587 x588 x589 -x590 -x591 -x592 -x593 -x594 -x595 x598 -x599 -x600 -x601 -x602 -x603 x604 -x605 x606 x607 -x609 -x610 x611 -x612 x613 x614 x615 -x616 x617 -x618 x620 -x621 x622 -x623 -x624 -x625 x626 -x627 -x628 x629 -x631 -x632 -x633 x634 -x635 x636 x637 -x638 x639 x640 x642 x643 -x644 -x645 x646 x647 -x648 x649 -x650 -x651 -x653 -x654 -x655 -x656 x657 -x658 -x659 -x660 x661 x662 -x664 -x665 -x666 -x667 -x668 -x669 x670 -x671 x672 x673 -x675 -x676 -x677 x678 x679 x680 x681 x682 -x683 x684 -x686 -x687 x688 -x689 x690 -x691 -x692 -x693 -x694 -x695 -x697 x698 x699 x700 -x701 -x702 -x703 x704 -x705 -x706 x709 -x710 -x711 -x712 -x713 x714 -x715 -x716 -x717 -x718 -x720 -x721 -x722 x723 -x724 -x725 x726 x727 -x728 -x729 -x731 -x732 -x733 -x734 x735 x736 x737 x738 x739 x740 x742 x743 x744 x745 -x746 -x747 -x748 x749 x750 x751 -x753 x754 -x755 x756 x757 -x758 x759 x760 -x761 -x762 -x764 x765 x766 x767 x768 x769 x770 x771 -x772 x773 -x775 x776 x777 x778 x779 x780 x781 -x782 x783 -x784 x786 -x787 x788 -x789 -x790 -x791 x792 x793 x794 x795 x797 x798 -x799 -x800 x801 -x802 x803 x804 -x805 -x806 x808 x809 x810 -x811 x812 -x813 -x814 -x815 -x816 x817 -x820 x821 x822 -x823 -x824 x825 x826 -x827 -x828 -x829 -x831 x832 x833 -x834 x835 -x836 x837 -x838 x839 -x840 x842 x843 -x844 -x845 x846 -x847 -x848 -x849 x850 x851 -x853 -x854 -x855 -x856 -x857 x858 -x859 -x860 -x861 x862 -x864 -x865 -x866 -x867 -x868 -x869 x870 -x871 x872 x873 -x875 -x876 -x877 x878 x879 x880 -x881 -x882 -x883 -x884 x886 -x887 -x888 x889 x890 x891 x892 x893 x894 -x895 -x897 x898 -x899 -x900 -x901 x902 -x903 x904 x905 x906 -x908 -x909 x910 -x911 x912 -x913 -x914 -x915 x916 -x917 x919 -x920 -x921 -x922 -x923 x924 -x925 -x926 x927 -x928 -x931 -x932 x933 x934 x935 -x936 -x937 -x938 -x939 -x940 x942 x943 x944 x945 -x946 -x947 -x948 x949 -x950 -x951 -x953 -x954 -x955 -x956 x957 -x958 -x959 -x960 -x961 -x962 -x964 -x965 -x966 x967 -x968 x969 -x970 -x971 -x972 x973 x975 x976 x977 -x978 -x979 -x980 x981 x982 x983 -x984 x986 -x987 x988 -x989 -x990 -x991 -x992 x993 -x994 -x995 -x997 -x998 -x999 x1000 -x1001 x1002 x1003 x1004 x1005 -x1006 x1008 -x1009 x1010 x1011 -x1012 -x1013 -x1014 -x1015 x1016 x1017 -x1019 -x1020 x1021 -x1022 x1023 -x1024 x1025 x1026 -x1027 x1028 -x1030 -x1031 -x1032 -x1033 -x1034 -x1035 -x1036 -x1037 x1038 -x1039 -x1042 -x1043 -x1044 -x1045 -x1046 -x1047 x1048 -x1049 -x1050 -x1051 x1053 -x1054 x1055 x1056 -x1057 -x1058 -x1059 -x1060 -x1061 x1062 x1064 -x1065 x1066 -x1067 x1068 -x1069 -x1070 x1071 -x1072 x1073 x1075 -x1076 -x1077 -x1078 -x1079 -x1080 -x1081 -x1082 -x1083 x1084 x1086 x1087 -x1088 -x1089 -x1090 -x1091 -x1092 x1093 x1094 -x1095 -x1097 -x1098 -x1099 -x1100 -x1101 -x1102 -x1103 -x1104 x1105 -x1106 -x1108 -x1109 -x1110 -x1111 -x1112 -x1113 x1114 -x1115 x1116 x1117 -x1119 -x1120 -x1121 -x1122 x1123 -x1124 x1125 x1126 -x1127 x1128 x1130 x1131 -x1132 -x1133 -x1134 -x1135 -x1136 -x1137 -x1138 -x1139 -x1141 -x1142 -x1143 -x1144 -x1145 -x1146 -x1147 -x1148 -x1149 x1150 -x1153 -x1154 -x1155 -x1156 -x1157 -x1158 -x1159 -x1160 -x1161 x1162 x1164 -x1165 -x1166 x1167 x1168 x1169 -x1170 x1171 -x1172 x1173 -x1175 -x1176 -x1177 -x1178 -x1179 x1180 x1181 -x1182 -x1183 -x1184 -x1186 -x1187 -x1188 -x1189 -x1190 -x1191 -x1192 -x1193 x1194 -x1195 x1197 -x1198 x1199 -x1200 -x1201 -x1202 x1203 x1204 -x1205 -x1206 -x1208 -x1209 x1210 x1211 x1212 -x1213 -x1214 -x1215 -x1216 -x1217 x1219 -x1220 -x1221 -x1222 -x1223 -x1224 x1225 -x1226 -x1227 -x1228 -x1230 -x1231 -x1232 -x1233 -x1234 -x1235 x1236 -x1237 -x1238 x1239 x1241 -x1242 x1243 -x1244 -x1245 -x1246 x1247 x1248 -x1249 x1250 -x1252 x1253 -x1254 x1255 -x1256 -x1257 -x1258 x1259 x1260 x1261 -x1264 -x1265 x1266 x1267 -x1268 -x1269 -x1270 x1271 -x1272 -x1273 -x1275 -x1276 -x1277 x1278 x1279 -x1280 x1281 -x1282 -x1283 -x1284 -x1286 -x1287 -x1288 -x1289 x1290 x1291 x1292 -x1293 x1294 -x1295 -x1297 -x1298 x1299 -x1300 -x1301 -x1302 -x1303 -x1304 -x1305 x1306 -x1308 -x1309 x1310 -x1311 -x1312 x1313 -x1314 -x1315 -x1316 -x1317 -x1319 -x1320 -x1321 -x1322 x1323 -x1324 -x1325 -x1326 -x1327 -x1328 -x1330 -x1331 -x1332 -x1333 -x1334 x1335 -x1336 -x1337 x1338 -x1339 -x1341 x1342 x1343 -x1344 x1345 -x1346 -x1347 -x1348 -x1349 -x1350 -x1352 -x1353 -x1354 -x1355 -x1356 -x1357 x1358 -x1359 -x1360 -x1361 -x1363 -x1364 -x1365 -x1366 -x1367 -x1368 x1369 -x1370 x1371 -x1372 x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 x12 -x13 -x15 x16 x17 x18 -x19 -x20 -x21 -x22 -x23 -x24 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 x34 -x35 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x59 -x60 -x61 -x62 -x63 -x64 x65 x66 -x67 -x68 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x81 -x82 -x83 -x84 -x85 -x86 -x87 x88 -x89 x90 -x92 x93 -x94 -x95 x96 -x97 -x98 -x99 -x100 -x101 -x103 -x104 x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x115 x116 -x117 -x118 -x119 x120 -x121 -x122 x123 x124 -x126 -x127 -x128 -x129 -x130 -x131 -x132 x133 -x134 -x135 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x148 x149 -x150 x151 -x152 -x153 -x154 x155 -x156 -x157 -x159 -x160 -x161 -x162 -x163 -x164 x165 -x166 -x167 -x168 x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x181 -x182 x183 -x184 x185 x186 -x187 -x188 -x189 -x190 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x203 -x204 -x205 -x206 x207 x208 -x209 -x210 x211 -x212 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x226 -x227 -x228 x229 -x230 -x231 -x232 -x233 -x234 -x235 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x248 -x249 -x250 -x251 -x252 -x253 -x254 x255 x256 -x257 x259 -x260 -x261 -x262 x263 -x264 -x265 -x266 -x267 -x268 -x270 -x271 -x272 -x273 -x274 x275 -x276 -x277 -x278 x279 -x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 x290 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 -x303 -x304 -x305 -x306 -x307 -x308 -x309 x310 -x311 -x312 -x314 -x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x325 -x326 x327 -x328 -x329 -x330 -x331 -x332 -x333 -x334 -x337 x338 -x339 -x340 x341 -x342 x343 -x344 -x345 -x346 -x348 -x349 x350 -x351 -x352 -x353 -x354 -x355 -x356 -x357 -x359 -x360 -x361 -x362 x363 -x364 -x365 -x366 -x367 -x368 -x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x381 -x382 -x383 -x384 -x385 -x386 -x387 -x388 -x389 x390 x392 -x393 x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x403 -x404 -x405 -x406 x407 x408 x409 x410 -x411 -x412 -x414 -x415 -x416

Verifier Data 

OK	465

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3725777-1338651516/watcher-3725777-1338651516 -o /tmp/evaluation-result-3725777-1338651516/solver-3725777-1338651516 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725777-1338651516.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.43 1.86 1.95 2/174 32304
/proc/meminfo: memFree=29117960/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=4112 CPUtime=0 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) R 32302 32304 30509 0 -1 4202496 256 0 0 0 0 0 0 0 20 0 1 0 331276045 4210688 209 33554432000 4194304 5964478 140734533094928 140736436115032 5136490 0 0 4096 16387 0 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 1028 213 149 433 0 512 0

[startup+0.0227149 s]
/proc/loadavg: 1.43 1.86 1.95 2/174 32304
/proc/meminfo: memFree=29117960/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=5196 CPUtime=0.01 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) R 32302 32304 30509 0 -1 4202496 599 0 0 0 1 0 0 0 20 0 1 0 331276045 5320704 552 33554432000 4194304 5964478 140734533094928 140736436115032 5136490 0 0 4096 16387 0 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 1299 552 211 433 0 783 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 5196

[startup+0.100167 s]
/proc/loadavg: 1.43 1.86 1.95 2/174 32304
/proc/meminfo: memFree=29117960/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=176564 CPUtime=0.15 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 6603 0 0 0 14 1 0 0 20 0 3 0 331276045 180801536 6408 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44141 6408 201 433 0 43705 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 176564

[startup+0.300197 s]
/proc/loadavg: 1.43 1.86 1.95 2/174 32304
/proc/meminfo: memFree=29117960/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=176564 CPUtime=0.55 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 6732 0 0 0 54 1 0 0 20 0 3 0 331276045 180801536 6537 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44141 6537 201 433 0 43705 0
Current children cumulated CPU time (s) 0.55
Current children cumulated vsize (KiB) 176564

[startup+0.700197 s]
/proc/loadavg: 1.43 1.86 1.95 2/174 32304
/proc/meminfo: memFree=29117960/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=176564 CPUtime=1.35 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 7311 0 0 0 133 2 0 0 20 0 3 0 331276045 180801536 6875 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44141 6875 202 433 0 43705 0
Current children cumulated CPU time (s) 1.35
Current children cumulated vsize (KiB) 176564

[startup+1.50039 s]
/proc/loadavg: 1.43 1.86 1.95 5/181 32314
/proc/meminfo: memFree=29051756/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=176564 CPUtime=2.95 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 8153 0 0 0 293 2 0 0 20 0 3 0 331276045 180801536 7654 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44141 7654 203 433 0 43705 0
[pid=32304/tid=32313] ppid=32302 vsize=176564 CPUtime=1.45 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 1798 0 0 0 145 0 0 0 20 0 3 0 331276048 180801536 7654 33554432000 4194304 5964478 140734533094928 140319485131080 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=176564 CPUtime=1.44 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 5170 0 0 0 143 1 0 0 20 0 3 0 331276048 180801536 7654 33554432000 4194304 5964478 140734533094928 140319474641128 4403343 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 176564

[startup+3.10038 s]
/proc/loadavg: 1.64 1.89 1.96 5/181 32314
/proc/meminfo: memFree=29040472/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=176564 CPUtime=6.15 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 9264 0 0 0 613 2 0 0 20 0 3 0 331276045 180801536 8740 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44141 8740 203 433 0 43705 0
[pid=32304/tid=32313] ppid=32302 vsize=176564 CPUtime=3.04 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 2808 0 0 0 303 1 0 0 20 0 3 0 331276048 180801536 8740 33554432000 4194304 5964478 140734533094928 140319485131704 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=176564 CPUtime=3.04 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 5271 0 0 0 303 1 0 0 20 0 3 0 331276048 180801536 8740 33554432000 4194304 5964478 140734533094928 140319474641208 4399915 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 176564

[startup+6.30038 s]
/proc/loadavg: 1.64 1.89 1.96 5/181 32314
/proc/meminfo: memFree=29023856/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=176780 CPUtime=12.55 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 11015 0 0 0 1251 4 0 0 20 0 3 0 331276045 181022720 10491 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44195 10491 203 433 0 43759 0
[pid=32304/tid=32313] ppid=32302 vsize=176780 CPUtime=6.24 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 4145 0 0 0 623 1 0 0 20 0 3 0 331276048 181022720 10491 33554432000 4194304 5964478 140734533094928 140319485130680 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=176780 CPUtime=6.23 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 5685 0 0 0 621 2 0 0 20 0 3 0 331276048 181022720 10491 33554432000 4194304 5964478 140734533094928 140319474641016 18446744073699066235 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 176780

[startup+12.7004 s]
/proc/loadavg: 2.00 1.96 1.98 5/181 32314
/proc/meminfo: memFree=28971344/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=177104 CPUtime=25.34 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 17259 0 0 0 2523 11 0 0 20 0 3 0 331276045 181354496 16735 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44276 16735 203 433 0 43840 0
[pid=32304/tid=32313] ppid=32302 vsize=177104 CPUtime=12.62 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 9135 0 0 0 1257 5 0 0 20 0 3 0 331276048 181354496 16735 33554432000 4194304 5964478 140734533094928 140319485130744 4400042 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=177104 CPUtime=12.61 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 6939 0 0 0 1255 6 0 0 20 0 3 0 331276048 181354496 16735 33554432000 4194304 5964478 140734533094928 140319474641208 4399946 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.34
Current children cumulated vsize (KiB) 177104

[startup+25.5004 s]
/proc/loadavg: 2.31 2.03 2.01 5/181 32314
/proc/meminfo: memFree=28918184/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=177372 CPUtime=50.94 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 24418 0 0 0 5078 16 0 0 20 0 3 0 331276045 181628928 23894 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44343 23894 203 433 0 43907 0
[pid=32304/tid=32313] ppid=32302 vsize=177372 CPUtime=25.39 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 14227 0 0 0 2532 7 0 0 20 0 3 0 331276048 181628928 23894 33554432000 4194304 5964478 140734533094928 140319485130552 4389100 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=177372 CPUtime=25.38 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 9006 0 0 0 2530 8 0 0 20 0 3 0 331276048 181628928 23894 33554432000 4194304 5964478 140734533094928 140319474641016 4400010 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 177372

[startup+51.1004 s]
/proc/loadavg: 2.88 2.18 2.06 5/181 32314
/proc/meminfo: memFree=28855408/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=177288 CPUtime=102.13 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 31964 0 0 0 10190 23 0 0 20 0 3 0 331276045 181542912 30959 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 44322 30959 203 433 0 43886 0
[pid=32304/tid=32313] ppid=32302 vsize=177288 CPUtime=50.92 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 16571 0 0 0 5083 9 0 0 20 0 3 0 331276048 181542912 30959 33554432000 4194304 5964478 140734533094928 140319485131592 4389132 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=177288 CPUtime=50.91 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 14208 0 0 0 5077 14 0 0 20 0 3 0 331276048 181542912 30959 33554432000 4194304 5964478 140734533094928 140319474641256 5136420 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.13
Current children cumulated vsize (KiB) 177288

[startup+102.307 s]
/proc/loadavg: 3.55 2.49 2.17 5/182 32317
/proc/meminfo: memFree=28739024/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=309848 CPUtime=204.52 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 50236 0 0 0 20409 43 0 0 20 0 3 0 331276045 317284352 49391 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 77462 49391 203 433 0 77026 0
[pid=32304/tid=32313] ppid=32302 vsize=309848 CPUtime=101.99 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 21918 0 0 0 10184 15 0 0 20 0 3 0 331276048 317284352 49391 33554432000 4194304 5964478 140734533094928 140319485130552 4403560 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=309848 CPUtime=101.98 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 27133 0 0 0 10169 29 0 0 20 0 3 0 331276048 317284352 49391 33554432000 4194304 5964478 140734533094928 140319474641208 4400603 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.52
Current children cumulated vsize (KiB) 309848

[startup+162.3 s]
/proc/loadavg: 3.82 2.74 2.27 5/181 32317
/proc/meminfo: memFree=28603592/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=441896 CPUtime=324.45 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 75769 0 0 0 32382 63 0 0 20 0 3 0 331276045 452501504 75298 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 110474 75298 203 433 0 110038 0
[pid=32304/tid=32313] ppid=32302 vsize=441896 CPUtime=161.8 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 34276 0 0 0 16155 25 0 0 20 0 3 0 331276048 452501504 75298 33554432000 4194304 5964478 140734533094928 140319485130552 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=441896 CPUtime=161.8 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 40308 0 0 0 16139 41 0 0 20 0 3 0 331276048 452501504 75298 33554432000 4194304 5964478 140734533094928 140319474641208 4399854 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.45
Current children cumulated vsize (KiB) 441896

[startup+222.3 s]
/proc/loadavg: 3.97 3.00 2.39 5/181 32317
/proc/meminfo: memFree=28466848/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=509408 CPUtime=444.37 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 101921 0 0 0 44349 88 0 0 20 0 3 0 331276045 521633792 101404 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 127352 101404 203 433 0 126916 0
[pid=32304/tid=32313] ppid=32302 vsize=509408 CPUtime=221.61 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 44132 0 0 0 22125 36 0 0 20 0 3 0 331276048 521633792 101404 33554432000 4194304 5964478 140734533094928 140319485130744 4399941 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=509408 CPUtime=221.62 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 56604 0 0 0 22105 57 0 0 20 0 3 0 331276048 521633792 101404 33554432000 4194304 5964478 140734533094928 140319474641208 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.37
Current children cumulated vsize (KiB) 509408

[startup+282.3 s]
/proc/loadavg: 3.99 3.16 2.48 5/181 32318
/proc/meminfo: memFree=28380548/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=575212 CPUtime=564.34 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 109656 0 0 0 56338 96 0 0 20 0 3 0 331276045 589017088 110339 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 143803 110339 203 433 0 143367 0
[pid=32304/tid=32313] ppid=32302 vsize=575212 CPUtime=281.45 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 49852 0 0 0 28103 42 0 0 20 0 3 0 331276048 589017088 110339 33554432000 4194304 5964478 140734533094928 140319485130744 4403564 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=575212 CPUtime=281.46 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 58619 0 0 0 28085 61 0 0 20 0 3 0 331276048 589017088 110339 33554432000 4194304 5964478 140734533094928 140319474640968 4399854 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.34
Current children cumulated vsize (KiB) 575212

[startup+342.3 s]
/proc/loadavg: 3.99 3.31 2.57 5/181 32318
/proc/meminfo: memFree=28355272/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=575496 CPUtime=684.32 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 117184 0 0 0 68328 104 0 0 20 0 3 0 331276045 589307904 117864 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 143874 117864 203 433 0 143438 0

################
# More data... #
################

[pid=32304/tid=32314] ppid=32302 vsize=575496 CPUtime=341.31 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 58693 0 0 0 34069 62 0 0 20 0 3 0 331276048 589307904 117864 33554432000 4194304 5964478 140734533094928 140319474640968 4409199 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.32
Current children cumulated vsize (KiB) 575496

[startup+402.3 s]
/proc/loadavg: 3.99 3.43 2.66 5/181 32318
/proc/meminfo: memFree=28285520/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=576248 CPUtime=804.31 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 125055 0 0 0 80319 112 0 0 20 0 3 0 331276045 590077952 125735 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 144062 125735 203 433 0 143626 0
[pid=32304/tid=32313] ppid=32302 vsize=576248 CPUtime=401.13 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 65012 0 0 0 40053 60 0 0 20 0 3 0 331276048 590077952 125735 33554432000 4194304 5964478 140734533094928 140319485130344 4400103 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=576248 CPUtime=401.15 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 58858 0 0 0 40052 63 0 0 20 0 3 0 331276048 590077952 125735 33554432000 4194304 5964478 140734533094928 140319474641208 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.31
Current children cumulated vsize (KiB) 576248

[startup+462.3 s]
/proc/loadavg: 3.99 3.54 2.74 5/181 32318
/proc/meminfo: memFree=28169464/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=641924 CPUtime=924.27 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 134906 0 0 0 92302 125 0 0 20 0 3 0 331276045 657330176 135874 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 160481 135874 203 433 0 160045 0
[pid=32304/tid=32313] ppid=32302 vsize=641924 CPUtime=460.97 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 66736 0 0 0 46036 61 0 0 20 0 3 0 331276048 657330176 135874 33554432000 4194304 5964478 140734533094928 140319485130792 4400103 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=641924 CPUtime=460.99 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 66985 0 0 0 46024 75 0 0 20 0 3 0 331276048 657330176 135874 33554432000 4194304 5964478 140734533094928 140319474641208 4403343 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.27
Current children cumulated vsize (KiB) 641924

[startup+522.3 s]
/proc/loadavg: 3.99 3.62 2.81 5/181 32318
/proc/meminfo: memFree=28056652/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=708340 CPUtime=1044.2 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 159195 0 0 0 104266 154 0 0 20 0 3 0 331276045 725340160 160486 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 177085 160486 203 433 0 176649 0
[pid=32304/tid=32313] ppid=32302 vsize=708340 CPUtime=520.79 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 79784 0 0 0 52002 77 0 0 20 0 3 0 331276048 725340160 160486 33554432000 4194304 5964478 140734533094928 140319485130792 4400115 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=708340 CPUtime=520.81 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 78226 0 0 0 51991 90 0 0 20 0 3 0 331276048 725340160 160486 33554432000 4194304 5964478 140734533094928 140319474641208 4400661 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.2
Current children cumulated vsize (KiB) 708340

[startup+582.3 s]
/proc/loadavg: 3.99 3.68 2.89 5/181 32319
/proc/meminfo: memFree=27928216/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=775092 CPUtime=1164.14 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 171032 0 0 0 116241 173 0 0 20 0 3 0 331276045 793694208 172362 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 193773 172362 203 433 0 193337 0
[pid=32304/tid=32313] ppid=32302 vsize=775092 CPUtime=580.61 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 81089 0 0 0 57982 79 0 0 20 0 3 0 331276048 793694208 172362 33554432000 4194304 5964478 140734533094928 140319485130616 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=775092 CPUtime=580.63 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 88758 0 0 0 57954 109 0 0 20 0 3 0 331276048 793694208 172362 33554432000 4194304 5964478 140734533094928 140319474641208 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.14
Current children cumulated vsize (KiB) 775092

[startup+642.3 s]
/proc/loadavg: 3.99 3.74 2.96 5/181 32319
/proc/meminfo: memFree=27815500/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=840760 CPUtime=1284.1 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 184974 0 0 0 128223 187 0 0 20 0 3 0 331276045 860938240 186432 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 210190 186432 203 433 0 209754 0
[pid=32304/tid=32313] ppid=32302 vsize=840760 CPUtime=640.44 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 89299 0 0 0 63956 88 0 0 20 0 3 0 331276048 860938240 186432 33554432000 4194304 5964478 140734533094928 140319485130792 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=840760 CPUtime=640.47 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 94490 0 0 0 63930 117 0 0 20 0 3 0 331276048 860938240 186432 33554432000 4194304 5964478 140734533094928 140319474640968 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.1
Current children cumulated vsize (KiB) 840760

[startup+702.3 s]
/proc/loadavg: 4.04 3.80 3.02 5/182 32322
/proc/meminfo: memFree=27809032/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=840760 CPUtime=1404.06 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 186618 0 0 0 140216 190 0 0 20 0 3 0 331276045 860938240 188079 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 210190 188079 203 433 0 209754 0
[pid=32304/tid=32313] ppid=32302 vsize=840760 CPUtime=700.27 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 90927 0 0 0 69936 91 0 0 20 0 3 0 331276048 860938240 188079 33554432000 4194304 5964478 140734533094928 140319485130616 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=840760 CPUtime=700.31 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 94506 0 0 0 69913 118 0 0 20 0 3 0 331276048 860938240 188079 33554432000 4194304 5964478 140734533094928 140319474640968 4399978 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.06
Current children cumulated vsize (KiB) 840760

[startup+762.307 s]
/proc/loadavg: 4.01 3.83 3.08 5/181 32322
/proc/meminfo: memFree=27752496/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=840912 CPUtime=1524.06 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 187096 0 0 0 152216 190 0 0 20 0 3 0 331276045 861093888 188556 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 210228 188556 203 433 0 209792 0
[pid=32304/tid=32313] ppid=32302 vsize=840912 CPUtime=760.12 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 91369 0 0 0 75919 93 0 0 20 0 3 0 331276048 861093888 188556 33554432000 4194304 5964478 140734533094928 140319485130552 4388769 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=840912 CPUtime=760.16 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 94542 0 0 0 75897 119 0 0 20 0 3 0 331276048 861093888 188556 33554432000 4194304 5964478 140734533094928 140319474640968 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.06
Current children cumulated vsize (KiB) 840912

[startup+822.3 s]
/proc/loadavg: 4.00 3.86 3.13 5/181 32322
/proc/meminfo: memFree=27681520/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=841060 CPUtime=1644.02 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 189053 0 0 0 164211 191 0 0 20 0 3 0 331276045 861245440 190641 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 210265 190641 203 433 0 209829 0
[pid=32304/tid=32313] ppid=32302 vsize=841060 CPUtime=819.96 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 93290 0 0 0 81901 95 0 0 20 0 3 0 331276048 861245440 190641 33554432000 4194304 5964478 140734533094928 140319485130552 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=841060 CPUtime=820 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 94578 0 0 0 81880 120 0 0 20 0 3 0 331276048 861245440 190641 33554432000 4194304 5964478 140734533094928 140319474640968 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.02
Current children cumulated vsize (KiB) 841060

[startup+882.3 s]
/proc/loadavg: 4.00 3.88 3.19 5/181 32323
/proc/meminfo: memFree=27625068/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=841392 CPUtime=1764.01 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 191252 0 0 0 176207 194 0 0 20 0 3 0 331276045 861585408 192837 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 210348 192837 203 433 0 209912 0
[pid=32304/tid=32313] ppid=32302 vsize=841392 CPUtime=879.8 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 95419 0 0 0 87882 98 0 0 20 0 3 0 331276048 861585408 192837 33554432000 4194304 5964478 140734533094928 140319485130552 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=841392 CPUtime=879.84 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 94648 0 0 0 87863 121 0 0 20 0 3 0 331276048 861585408 192837 33554432000 4194304 5964478 140734533094928 140319474640968 4399854 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.01
Current children cumulated vsize (KiB) 841392



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.89 3.20 5/181 32323
/proc/meminfo: memFree=27602964/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=841528 CPUtime=1800.02 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 192010 0 0 0 179808 194 0 0 20 0 3 0 331276045 861724672 193593 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 210382 193593 203 433 0 209946 0
[pid=32304/tid=32313] ppid=32302 vsize=841528 CPUtime=897.76 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 96155 0 0 0 89678 98 0 0 20 0 3 0 331276048 861724672 193593 33554432000 4194304 5964478 140734533094928 140319485130552 4400006 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=841528 CPUtime=897.8 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 94670 0 0 0 89659 121 0 0 20 0 3 0 331276048 861724672 193593 33554432000 4194304 5964478 140734533094928 140319474640968 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 841528

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.89 3.20 5/181 32323
/proc/meminfo: memFree=27602964/32873844 swapFree=7644/7644
[pid=32304] ppid=32302 vsize=841528 CPUtime=1800.02 cores=1,3,5,7
/proc/32304/stat : 32304 (pwbo2.02) S 32302 32304 30509 0 -1 4202496 192010 0 0 0 179808 194 0 0 20 0 3 0 331276045 861724672 193593 33554432000 4194304 5964478 140734533094928 140734533094448 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/32304/statm: 210382 193593 203 433 0 209946 0
[pid=32304/tid=32313] ppid=32302 vsize=841528 CPUtime=897.76 cores=1,3,5,7
/proc/32304/task/32313/stat : 32313 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 96155 0 0 0 89678 98 0 0 20 0 3 0 331276048 861724672 193593 33554432000 4194304 5964478 140734533094928 140319485130552 4400006 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=32304/tid=32314] ppid=32302 vsize=841528 CPUtime=897.8 cores=1,3,5,7
/proc/32304/task/32314/stat : 32314 (pwbo2.02) R 32302 32304 30509 0 -1 4202560 94670 0 0 0 89659 121 0 0 20 0 3 0 331276048 861724672 193593 33554432000 4194304 5964478 140734533094928 140319474640968 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 841528

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32304 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=420358
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=232660
# CPU time returned by wait4() is 1795.65
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.335
CPU time (s): 1800.02
CPU user time (s): 1798.08
CPU system time (s): 1.94
CPU usage (%): 199.928
Max. virtual memory (cumulated for all children) (KiB): 841528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.42
system time used= 2.23266
maximum resident set size= 774376
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 192011
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 701
involuntary context switches= 3653

runsolver used 2.01169 second user time and 5.47417 second system time

The end

Launcher Data 

Begin job on node147 at 2012-06-02 17:38:36
IDJOB=3725777
IDBENCH=1873
IDSOLVER=2309
FILE ID=node147/3725777-1338651516
RUNJOBID= node147-1338651516-32282
PBS_JOBID= 14636433
Free space on /tmp= 70784 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-seymour.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3725777-1338651516/watcher-3725777-1338651516 -o /tmp/evaluation-result-3725777-1338651516/solver-3725777-1338651516 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725777-1338651516.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 97ebaccbda37d5c570b4e2ec3cd7f8f0
RANDOM SEED=356225497

node147.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29118736 kB
Buffers:          423620 kB
Cached:          2465964 kB
SwapCached:         3380 kB
Active:          1416724 kB
Inactive:        1479232 kB
Active(anon):       2164 kB
Inactive(anon):     5920 kB
Active(file):    1414560 kB
Inactive(file):  1473312 kB
Unevictable:        7644 kB
Mlocked:            7644 kB
SwapTotal:      67108856 kB
SwapFree:       67100236 kB
Dirty:             11292 kB
Writeback:             0 kB
AnonPages:         10816 kB
Mapped:             8740 kB
Shmem:                 0 kB
Slab:             719384 kB
SReclaimable:     160772 kB
SUnreclaim:       558612 kB
KernelStack:        1384 kB
PageTables:         3788 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     104392 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70776 MiB
End job on node147 at 2012-06-02 17:53:39