Trace number 3728517

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.02MSAT (TO) 1800.07 900.221

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/
normalized-chnl10_20_pb.cnf.cr--soft-66-100-0.wbo
MD5SUM1f875ef306d18e6f86db860a031faa4e
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark96
Best CPU time to get the best result obtained on this benchmark0.135979
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables400
Total number of constraints60
Number of soft constraints16
Number of constraints which are clauses40
Number of constraints which are cardinality constraints (but not clauses)20
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint10
Maximum length of a constraint20
Top cost 813
Min constraint cost 1
Max constraint cost 95
Sum of constraints costs 812
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 21
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3728517-1338669605.wbo.
0.00/0.00	c Instance file HOME/instance-3728517-1338669605.wbo
0.00/0.00	c File size is 6962 bytes.
0.00/0.00	c Highest Coefficient sum: 21
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      416                                                 |
0.00/0.00	c |  Number Clauses:        40                                                  |
0.00/0.00	c |  Number Cardinality:    18                                                  |
0.00/0.00	c |  Number PB Constraints: 2                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.07/900.21	o 392
1800.07/900.21	o 96
1800.07/900.21	c ===============================================================================
1800.07/900.21	c Wall Clock Time: 900.21 s
1800.07/900.21	c Best Solution: 96
1800.07/900.21	s SATISFIABLE
1800.07/900.21	v -x1 -x2 -x3 -x4 -x5 x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 x18 -x19 -x20 -x21 -x22 -x23 x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 x64 -x65 -x66 -x67 -x68 -x69 -x70 x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 x109 -x110 -x111 -x112 x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 x150 -x151 -x152 -x153 -x154 -x155 x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 x249 -x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 -x259 x260 -x261 -x262 -x263 -x264 -x265 x266 -x267 -x268 -x269 -x270 -x271 -x272 -x273 x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 -x282 x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 x297 -x298 -x299 -x300 -x301 x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 x326 -x327 -x328 -x329 -x330 -x331 -x332 -x333 x334 -x335 -x336 -x337 -x338 -x339 -x340 -x341 -x342 -x343 -x344 -x345 x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 x354 -x355 -x356 -x357 -x358 -x359 -x360 x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 -x373 x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 -x384 -x385 x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 x394 -x395 -x396 -x397 -x398 -x399 -x400

Verifier Data 

OK	96

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3728517-1338669605/watcher-3728517-1338669605 -o /tmp/evaluation-result-3728517-1338669605/solver-3728517-1338669605 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728517-1338669605.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.84 1.97 1.99 4/176 31904
/proc/meminfo: memFree=27409008/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=162520 CPUtime=0 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 918 0 0 0 0 0 0 0 20 0 3 0 333085394 166420480 868 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 40630 868 195 433 0 40194 0
[pid=31904/tid=31905] ppid=31900 vsize=162520 CPUtime=0 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 70 0 0 0 0 0 0 0 20 0 3 0 333085394 166420480 868 33554432000 4194304 5964478 140735763494528 140118812576816 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=162520 CPUtime=0 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 58 0 0 0 0 0 0 0 20 0 3 0 333085394 166420480 868 33554432000 4194304 5964478 140735763494528 140118802087000 4389480 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.100267 s]
/proc/loadavg: 1.84 1.97 1.99 4/176 31904
/proc/meminfo: memFree=27409008/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=162520 CPUtime=0.19 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 1255 0 0 0 19 0 0 0 20 0 3 0 333085394 166420480 1205 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 40630 1205 197 433 0 40194 0
[pid=31904/tid=31905] ppid=31900 vsize=162520 CPUtime=0.08 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 269 0 0 0 8 0 0 0 20 0 3 0 333085394 166420480 1205 33554432000 4194304 5964478 140735763494528 140118812575544 4388952 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=162520 CPUtime=0.08 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 196 0 0 0 8 0 0 0 20 0 3 0 333085394 166420480 1205 33554432000 4194304 5964478 140735763494528 140118802086008 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 162520

[startup+0.200322 s]
/proc/loadavg: 1.84 1.97 1.99 4/176 31904
/proc/meminfo: memFree=27409008/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=162520 CPUtime=0.39 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 1489 0 0 0 39 0 0 0 20 0 3 0 333085394 166420480 1439 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 40630 1439 197 433 0 40194 0
[pid=31904/tid=31905] ppid=31900 vsize=162520 CPUtime=0.18 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 435 0 0 0 18 0 0 0 20 0 3 0 333085394 166420480 1439 33554432000 4194304 5964478 140735763494528 140118812575544 4400109 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=162520 CPUtime=0.18 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 264 0 0 0 18 0 0 0 20 0 3 0 333085394 166420480 1439 33554432000 4194304 5964478 140735763494528 140118802086248 4400432 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 162520

[startup+0.300335 s]
/proc/loadavg: 1.84 1.97 1.99 4/176 31904
/proc/meminfo: memFree=27409008/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=162520 CPUtime=0.58 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 1623 0 0 0 58 0 0 0 20 0 3 0 333085394 166420480 1573 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 40630 1573 197 433 0 40194 0
[pid=31904/tid=31905] ppid=31900 vsize=162520 CPUtime=0.28 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 506 0 0 0 28 0 0 0 20 0 3 0 333085394 166420480 1573 33554432000 4194304 5964478 140735763494528 140118812575544 4409506 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=162520 CPUtime=0.28 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 327 0 0 0 28 0 0 0 20 0 3 0 333085394 166420480 1573 33554432000 4194304 5964478 140735763494528 140118802086248 4381576 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 162520

[startup+0.700293 s]
/proc/loadavg: 1.84 1.97 1.99 4/176 31904
/proc/meminfo: memFree=27409008/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=168480 CPUtime=1.38 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 4878 0 0 0 137 1 0 0 20 0 3 0 333085394 172523520 4789 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 42120 4789 206 433 0 41684 0
[pid=31904/tid=31905] ppid=31900 vsize=168480 CPUtime=0.68 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 782 0 0 0 68 0 0 0 20 0 3 0 333085394 172523520 4789 33554432000 4194304 5964478 140735763494528 140118812575544 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=168480 CPUtime=0.68 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 3306 0 0 0 67 1 0 0 20 0 3 0 333085394 172523520 4789 33554432000 4194304 5964478 140735763494528 140118802085672 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 168480

[startup+1.50024 s]
/proc/loadavg: 1.84 1.97 1.99 5/182 31910
/proc/meminfo: memFree=27348756/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=168624 CPUtime=2.99 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 5517 0 0 0 297 2 0 0 20 0 3 0 333085394 172670976 5428 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 42156 5428 206 433 0 41720 0
[pid=31904/tid=31905] ppid=31900 vsize=168624 CPUtime=1.48 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 1122 0 0 0 148 0 0 0 20 0 3 0 333085394 172670976 5428 33554432000 4194304 5964478 140735763494528 140118812575784 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=168624 CPUtime=1.48 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 3605 0 0 0 147 1 0 0 20 0 3 0 333085394 172670976 5428 33554432000 4194304 5964478 140735763494528 140118802086200 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 168624

[startup+3.1003 s]
/proc/loadavg: 2.09 2.02 2.01 5/182 31910
/proc/meminfo: memFree=27340324/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=168768 CPUtime=6.18 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 6226 0 0 0 616 2 0 0 20 0 3 0 333085394 172818432 6137 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 42192 6137 206 433 0 41756 0
[pid=31904/tid=31905] ppid=31900 vsize=168768 CPUtime=3.07 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 1525 0 0 0 307 0 0 0 20 0 3 0 333085394 172818432 6137 33554432000 4194304 5964478 140735763494528 140118812575736 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=168768 CPUtime=3.08 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 3911 0 0 0 306 2 0 0 20 0 3 0 333085394 172818432 6137 33554432000 4194304 5964478 140735763494528 140118802086200 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 168768

[startup+6.30031 s]
/proc/loadavg: 2.09 2.02 2.01 5/182 31910
/proc/meminfo: memFree=27324824/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=168840 CPUtime=12.58 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 7183 0 0 0 1255 3 0 0 20 0 3 0 333085394 172892160 7094 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 42210 7094 206 433 0 41774 0
[pid=31904/tid=31905] ppid=31900 vsize=168840 CPUtime=6.26 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 2004 0 0 0 626 0 0 0 20 0 3 0 333085394 172892160 7094 33554432000 4194304 5964478 140735763494528 140118812575736 4400056 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=168840 CPUtime=6.27 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 4389 0 0 0 625 2 0 0 20 0 3 0 333085394 172892160 7094 33554432000 4194304 5964478 140735763494528 140118802086008 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 168840

[startup+12.7003 s]
/proc/loadavg: 2.39 2.08 2.03 5/182 31910
/proc/meminfo: memFree=27289904/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=171468 CPUtime=25.39 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 9334 0 0 0 2535 4 0 0 20 0 3 0 333085394 175583232 9217 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 42867 9217 206 433 0 42431 0
[pid=31904/tid=31905] ppid=31900 vsize=171468 CPUtime=12.65 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 2791 0 0 0 1264 1 0 0 20 0 3 0 333085394 175583232 9217 33554432000 4194304 5964478 140735763494528 140118812575544 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=171468 CPUtime=12.65 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 5753 0 0 0 1263 2 0 0 20 0 3 0 333085394 175583232 9217 33554432000 4194304 5964478 140735763494528 140118802086200 4400831 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.39
Current children cumulated vsize (KiB) 171468

[startup+25.5068 s]
/proc/loadavg: 2.71 2.16 2.05 5/182 31910
/proc/meminfo: memFree=27236624/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=172252 CPUtime=50.98 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 10993 0 0 0 5092 6 0 0 20 0 3 0 333085394 176386048 10855 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 43063 10855 206 433 0 42627 0
[pid=31904/tid=31905] ppid=31900 vsize=172252 CPUtime=25.42 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 3830 0 0 0 2539 3 0 0 20 0 3 0 333085394 176386048 10855 33554432000 4194304 5964478 140735763494528 140118812575544 4400115 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=172252 CPUtime=25.42 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 6373 0 0 0 2539 3 0 0 20 0 3 0 333085394 176386048 10855 33554432000 4194304 5964478 140735763494528 140118802086008 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 172252

[startup+51.1003 s]
/proc/loadavg: 3.15 2.31 2.10 5/182 31910
/proc/meminfo: memFree=27175692/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=174232 CPUtime=102.17 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 13365 0 0 0 10207 10 0 0 20 0 3 0 333085394 178413568 13227 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 43558 13227 206 433 0 43122 0
[pid=31904/tid=31905] ppid=31900 vsize=174232 CPUtime=50.95 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 5531 0 0 0 5089 6 0 0 20 0 3 0 333085394 178413568 13227 33554432000 4194304 5964478 140735763494528 140118812575544 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=174232 CPUtime=50.95 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 7044 0 0 0 5091 4 0 0 20 0 3 0 333085394 178413568 13227 33554432000 4194304 5964478 140735763494528 140118802086248 4400496 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.17
Current children cumulated vsize (KiB) 174232

[startup+102.3 s]
/proc/loadavg: 3.63 2.57 2.20 5/181 31910
/proc/meminfo: memFree=27112592/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=180032 CPUtime=204.54 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 17222 0 0 0 20439 15 0 0 20 0 3 0 333085394 184352768 17536 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 45008 17536 206 433 0 44572 0
[pid=31904/tid=31905] ppid=31900 vsize=180032 CPUtime=102.01 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 8063 0 0 0 10192 9 0 0 20 0 3 0 333085394 184352768 17536 33554432000 4194304 5964478 140735763494528 140118812575784 4400103 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=180032 CPUtime=102.01 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 8369 0 0 0 10194 7 0 0 20 0 3 0 333085394 184352768 17536 33554432000 4194304 5964478 140735763494528 140118802086200 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.54
Current children cumulated vsize (KiB) 180032

[startup+162.3 s]
/proc/loadavg: 3.86 2.82 2.31 5/181 31910
/proc/meminfo: memFree=27042412/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=186596 CPUtime=324.52 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 20022 0 0 0 32435 17 0 0 20 0 3 0 333085394 191074304 21551 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 46649 21551 206 433 0 46213 0
[pid=31904/tid=31905] ppid=31900 vsize=186596 CPUtime=161.85 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 9646 0 0 0 16173 12 0 0 20 0 3 0 333085394 191074304 21551 33554432000 4194304 5964478 140735763494528 140118812575544 4400097 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=186596 CPUtime=161.85 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 9586 0 0 0 16177 8 0 0 20 0 3 0 333085394 191074304 21551 33554432000 4194304 5964478 140735763494528 140118802086008 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.52
Current children cumulated vsize (KiB) 186596

[startup+222.3 s]
/proc/loadavg: 3.95 3.05 2.42 5/181 31911
/proc/meminfo: memFree=26992736/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=192488 CPUtime=444.51 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 24591 0 0 0 44427 24 0 0 20 0 3 0 333085394 197107712 26096 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 48122 26096 206 433 0 47686 0
[pid=31904/tid=31905] ppid=31900 vsize=192488 CPUtime=221.71 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 12508 0 0 0 22153 18 0 0 20 0 3 0 333085394 197107712 26096 33554432000 4194304 5964478 140735763494528 140118812575784 4400018 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=192488 CPUtime=221.71 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 11293 0 0 0 22160 11 0 0 20 0 3 0 333085394 197107712 26096 33554432000 4194304 5964478 140735763494528 140118802086200 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.51
Current children cumulated vsize (KiB) 192488

################
# More data... #
################

[pid=31904/tid=31906] ppid=31900 vsize=197724 CPUtime=281.55 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 12415 0 0 0 28142 13 0 0 20 0 3 0 333085394 202469376 30083 33554432000 4194304 5964478 140735763494528 140118802086008 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.48
Current children cumulated vsize (KiB) 197724

[startup+342.307 s]
/proc/loadavg: 3.99 3.36 2.61 5/181 31911
/proc/meminfo: memFree=26895412/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=202252 CPUtime=684.46 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 31090 0 0 0 68411 35 0 0 20 0 3 0 333085394 207106048 32591 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 50563 32591 206 433 0 50127 0
[pid=31904/tid=31905] ppid=31900 vsize=202252 CPUtime=341.39 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 17313 0 0 0 34109 30 0 0 20 0 3 0 333085394 207106048 32591 33554432000 4194304 5964478 140735763494528 140118812575736 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=202252 CPUtime=341.4 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 12987 0 0 0 34125 15 0 0 20 0 3 0 333085394 207106048 32591 33554432000 4194304 5964478 140735763494528 140118802086024 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.46
Current children cumulated vsize (KiB) 202252

[startup+402.3 s]
/proc/loadavg: 3.99 3.47 2.68 5/181 31911
/proc/meminfo: memFree=26855808/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=206608 CPUtime=804.42 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 36599 0 0 0 80398 44 0 0 20 0 3 0 333085394 211566592 38104 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 51652 38104 206 433 0 51216 0
[pid=31904/tid=31905] ppid=31900 vsize=206608 CPUtime=401.23 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 18542 0 0 0 40089 34 0 0 20 0 3 0 333085394 211566592 38104 33554432000 4194304 5964478 140735763494528 140118812575784 4400124 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=206608 CPUtime=401.24 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 17267 0 0 0 40102 22 0 0 20 0 3 0 333085394 211566592 38104 33554432000 4194304 5964478 140735763494528 140118802086248 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.42
Current children cumulated vsize (KiB) 206608

[startup+462.3 s]
/proc/loadavg: 3.99 3.56 2.76 5/181 31911
/proc/meminfo: memFree=26812476/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=275508 CPUtime=924.41 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 39204 0 0 0 92392 49 0 0 20 0 3 0 333085394 282120192 40705 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 68877 40705 206 433 0 68441 0
[pid=31904/tid=31905] ppid=31900 vsize=275508 CPUtime=461.07 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 20508 0 0 0 46069 38 0 0 20 0 3 0 333085394 282120192 40705 33554432000 4194304 5964478 140735763494528 140118812575736 4399986 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=275508 CPUtime=461.08 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 17906 0 0 0 46084 24 0 0 20 0 3 0 333085394 282120192 40705 33554432000 4194304 5964478 140735763494528 140118802086008 4400067 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.41
Current children cumulated vsize (KiB) 275508

[startup+522.3 s]
/proc/loadavg: 4.06 3.65 2.84 5/181 31912
/proc/meminfo: memFree=26769252/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=284232 CPUtime=1044.39 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 44615 0 0 0 104382 57 0 0 20 0 3 0 333085394 291053568 46107 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 71058 46107 206 433 0 70622 0
[pid=31904/tid=31905] ppid=31900 vsize=284232 CPUtime=520.92 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 22768 0 0 0 52049 43 0 0 20 0 3 0 333085394 291053568 46107 33554432000 4194304 5964478 140735763494528 140118812575736 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=284232 CPUtime=520.93 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 21057 0 0 0 52065 28 0 0 20 0 3 0 333085394 291053568 46107 33554432000 4194304 5964478 140735763494528 140118802086008 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.39
Current children cumulated vsize (KiB) 284232

[startup+582.3 s]
/proc/loadavg: 4.02 3.71 2.91 5/181 31912
/proc/meminfo: memFree=26736516/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=287588 CPUtime=1164.38 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 47071 0 0 0 116376 62 0 0 20 0 3 0 333085394 294490112 48563 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 71897 48563 206 433 0 71461 0
[pid=31904/tid=31905] ppid=31900 vsize=287588 CPUtime=580.76 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 24128 0 0 0 58030 46 0 0 20 0 3 0 333085394 294490112 48563 33554432000 4194304 5964478 140735763494528 140118812575736 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=287588 CPUtime=580.77 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 22153 0 0 0 58046 31 0 0 20 0 3 0 333085394 294490112 48563 33554432000 4194304 5964478 140735763494528 140118802086200 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.38
Current children cumulated vsize (KiB) 287588

[startup+642.3 s]
/proc/loadavg: 4.01 3.76 2.98 5/182 31915
/proc/meminfo: memFree=26708592/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=291060 CPUtime=1284.34 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 49528 0 0 0 128369 65 0 0 20 0 3 0 333085394 298045440 51021 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 72765 51021 206 433 0 72329 0
[pid=31904/tid=31905] ppid=31900 vsize=291060 CPUtime=640.6 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 25005 0 0 0 64011 49 0 0 20 0 3 0 333085394 298045440 51021 33554432000 4194304 5964478 140735763494528 140118812575784 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=291060 CPUtime=640.62 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 23733 0 0 0 64028 34 0 0 20 0 3 0 333085394 298045440 51021 33554432000 4194304 5964478 140735763494528 140118802086248 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.34
Current children cumulated vsize (KiB) 291060

[startup+702.3 s]
/proc/loadavg: 4.00 3.80 3.04 5/181 31915
/proc/meminfo: memFree=26688216/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=361048 CPUtime=1404.32 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 52780 0 0 0 140361 71 0 0 20 0 3 0 333085394 369713152 54303 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 90262 54303 206 433 0 89826 0
[pid=31904/tid=31905] ppid=31900 vsize=361048 CPUtime=700.44 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 25777 0 0 0 69993 51 0 0 20 0 3 0 333085394 369713152 54303 33554432000 4194304 5964478 140735763494528 140118812575736 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=361048 CPUtime=700.45 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 26213 0 0 0 70006 39 0 0 20 0 3 0 333085394 369713152 54303 33554432000 4194304 5964478 140735763494528 140118802086008 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.32
Current children cumulated vsize (KiB) 361048

[startup+762.3 s]
/proc/loadavg: 4.00 3.84 3.10 5/181 31915
/proc/meminfo: memFree=26669544/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=364880 CPUtime=1524.3 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 55094 0 0 0 152354 76 0 0 20 0 3 0 333085394 373637120 56617 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 91220 56617 206 433 0 90784 0
[pid=31904/tid=31905] ppid=31900 vsize=364880 CPUtime=760.29 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 27447 0 0 0 75973 56 0 0 20 0 3 0 333085394 373637120 56617 33554432000 4194304 5964478 140735763494528 140118812575736 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=364880 CPUtime=760.3 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 26857 0 0 0 75989 41 0 0 20 0 3 0 333085394 373637120 56617 33554432000 4194304 5964478 140735763494528 140118802086248 4400435 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.3
Current children cumulated vsize (KiB) 364880

[startup+822.3 s]
/proc/loadavg: 4.00 3.86 3.15 5/181 31916
/proc/meminfo: memFree=26647964/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=367072 CPUtime=1644.28 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 56132 0 0 0 164351 77 0 0 20 0 3 0 333085394 375881728 57655 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 91768 57655 206 433 0 91332 0
[pid=31904/tid=31905] ppid=31900 vsize=367072 CPUtime=820.14 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 28167 0 0 0 81955 59 0 0 20 0 3 0 333085394 375881728 57655 33554432000 4194304 5964478 140735763494528 140118812575784 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=367072 CPUtime=820.14 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 27175 0 0 0 81972 42 0 0 20 0 3 0 333085394 375881728 57655 33554432000 4194304 5964478 140735763494528 140118802086248 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.28
Current children cumulated vsize (KiB) 367072

[startup+882.3 s]
/proc/loadavg: 4.00 3.89 3.20 5/181 31916
/proc/meminfo: memFree=26627916/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=370084 CPUtime=1764.27 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 59109 0 0 0 176343 84 0 0 20 0 3 0 333085394 378966016 60632 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 92521 60632 206 433 0 92085 0
[pid=31904/tid=31905] ppid=31900 vsize=370084 CPUtime=879.99 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 29800 0 0 0 87934 65 0 0 20 0 3 0 333085394 378966016 60632 33554432000 4194304 5964478 140735763494528 140118812575736 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=370084 CPUtime=880 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 28519 0 0 0 87955 45 0 0 20 0 3 0 333085394 378966016 60632 33554432000 4194304 5964478 140735763494528 140118802086200 4400078 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.27
Current children cumulated vsize (KiB) 370084



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.2 s]
/proc/loadavg: 4.00 3.89 3.22 5/181 31916
/proc/meminfo: memFree=26619608/32873844 swapFree=6608/6608
[pid=31904] ppid=31900 vsize=370916 CPUtime=1800.07 cores=1,3,5,7
/proc/31904/stat : 31904 (pwbo2.02) S 31900 31904 31325 0 -1 4202496 60116 0 0 0 179921 86 0 0 20 0 3 0 333085394 379817984 61639 33554432000 4194304 5964478 140735763494528 140735763494048 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/31904/statm: 92729 61639 206 433 0 92293 0
[pid=31904/tid=31905] ppid=31900 vsize=370916 CPUtime=897.84 cores=1,3,5,7
/proc/31904/task/31905/stat : 31905 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 30288 0 0 0 89718 66 0 0 20 0 3 0 333085394 379817984 61639 33554432000 4194304 5964478 140735763494528 140118812575736 4400097 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=31904/tid=31906] ppid=31900 vsize=370916 CPUtime=897.85 cores=1,3,5,7
/proc/31904/task/31906/stat : 31906 (pwbo2.02) R 31900 31904 31325 0 -1 4202560 29038 0 0 0 89739 46 0 0 20 0 3 0 333085394 379817984 61639 33554432000 4194304 5964478 140735763494528 140118802086200 4400069 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 370916

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31904 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=599179
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=139826
# CPU time returned by wait4() is 1795.74
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.221
CPU time (s): 1800.07
CPU user time (s): 1799.21
CPU system time (s): 0.86
CPU usage (%): 199.959
Max. virtual memory (cumulated for all children) (KiB): 370916

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.6
system time used= 1.13983
maximum resident set size= 246564
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 60118
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 118
involuntary context switches= 1841

runsolver used 2.12068 second user time and 5.03723 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-02 22:40:05
IDJOB=3728517
IDBENCH=78667
IDSOLVER=2316
FILE ID=node140/3728517-1338669605
RUNJOBID= node140-1338669605-31878
PBS_JOBID= 14636482
Free space on /tmp= 70624 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/normalized-chnl10_20_pb.cnf.cr--soft-66-100-0.wbo
COMMAND LINE= pwbo2.02 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3728517-1338669605/watcher-3728517-1338669605 -o /tmp/evaluation-result-3728517-1338669605/solver-3728517-1338669605 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728517-1338669605.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1f875ef306d18e6f86db860a031faa4e
RANDOM SEED=1912999171

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27409272 kB
Buffers:          395736 kB
Cached:          4171472 kB
SwapCached:         1664 kB
Active:          1230464 kB
Inactive:        3345616 kB
Active(anon):       1656 kB
Inactive(anon):     9416 kB
Active(file):    1228808 kB
Inactive(file):  3336200 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105156 kB
Dirty:             10916 kB
Writeback:             0 kB
AnonPages:         14024 kB
Mapped:             9556 kB
Shmem:                 8 kB
Slab:             748092 kB
SReclaimable:     189732 kB
SUnreclaim:       558360 kB
KernelStack:        1384 kB
PageTables:         3540 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     104412 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70616 MiB
End job on node140 at 2012-06-02 22:55:08