Trace number 3726330

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)22 1800.14 900.315

General information on the benchmark

Name/OPT-SMALLINT-LIN/
kullmann/normalized-sbox_4_shg.opb
MD5SUM175e0a4a6cd805ac131e3fa3fd7ba75e
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark22
Best CPU time to get the best result obtained on this benchmark0.138978
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables147
Total number of constraints240
Number of constraints which are clauses240
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint21
Number of terms in the objective function 147
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 147
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 147
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3726330-1338658813.opb.
0.00/0.00	c Instance file HOME/instance-3726330-1338658813.opb
0.00/0.00	c File size is 21642 bytes.
0.00/0.00	c Cost Offset: 0
0.00/0.00	c Highest Coefficient sum: 22
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      147                                                 |
0.00/0.00	c |  Number Clauses:        240                                                 |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.14/900.31	o 32
1800.14/900.31	o 28
1800.14/900.31	o 27
1800.14/900.31	o 26
1800.14/900.31	o 25
1800.14/900.31	o 24
1800.14/900.31	o 23
1800.14/900.31	o 22
1800.14/900.31	c ===============================================================================
1800.14/900.31	c Wall Clock Time: 900.31 s
1800.14/900.31	c Best Solution: 22
1800.14/900.31	s SATISFIABLE
1800.14/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 x12 x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 x37 -x38 x39 -x40 -x41 -x42 -x43 x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 x54 -x55 -x56 -x57 -x58 x59 -x60 -x61 -x62 x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 x81 -x82 -x83 x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 x92 -x93 -x94 x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 x108 -x109 -x110 -x111 -x112 x113 -x114 -x115 x116 -x117 -x118 -x119 -x120 -x121 -x122 x123 -x124 x125 -x126 -x127 -x128 -x129 -x130 -x131 x132 -x133 x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 x146 -x147

Verifier Data 

OK	22

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3726330-1338658813/watcher-3726330-1338658813 -o /tmp/evaluation-result-3726330-1338658813/solver-3726330-1338658813 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726330-1338658813.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.81 3.95 3.94 4/181 24912
/proc/meminfo: memFree=28169104/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=162976 CPUtime=0 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 1065 0 0 0 0 0 0 0 20 0 3 0 332006678 166887424 1012 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40744 1014 201 433 0 40308 0
[pid=24912/tid=24913] ppid=24910 vsize=162976 CPUtime=0 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 51 0 0 0 0 0 0 0 20 0 3 0 332006678 166887424 1018 33554432000 4194304 5964478 140733592328352 139942859897176 5133698 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=162976 CPUtime=0 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 264 0 0 0 0 0 0 0 20 0 3 0 332006678 166887424 1020 33554432000 4194304 5964478 140733592328352 139942849406376 4395266 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0

[startup+0.0485671 s]
/proc/loadavg: 3.81 3.95 3.94 4/181 24912
/proc/meminfo: memFree=28169104/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=163360 CPUtime=0.08 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 1346 0 0 0 8 0 0 0 20 0 3 0 332006678 167280640 1293 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40840 1293 204 433 0 40404 0
[pid=24912/tid=24913] ppid=24910 vsize=163360 CPUtime=0.03 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 165 0 0 0 3 0 0 0 20 0 3 0 332006678 167280640 1293 33554432000 4194304 5964478 140733592328352 139942859897096 4400432 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=163360 CPUtime=0.03 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 423 0 0 0 3 0 0 0 20 0 3 0 332006678 167280640 1293 33554432000 4194304 5964478 140733592328352 139942849406376 4392698 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 163360

[startup+0.100288 s]
/proc/loadavg: 3.81 3.95 3.94 4/181 24912
/proc/meminfo: memFree=28169104/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=163360 CPUtime=0.18 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 1532 0 0 0 18 0 0 0 20 0 3 0 332006678 167280640 1479 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40840 1479 204 433 0 40404 0
[pid=24912/tid=24913] ppid=24910 vsize=163360 CPUtime=0.08 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 305 0 0 0 8 0 0 0 20 0 3 0 332006678 167280640 1479 33554432000 4194304 5964478 140733592328352 139942859896632 4222464 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=163360 CPUtime=0.08 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 469 0 0 0 8 0 0 0 20 0 3 0 332006678 167280640 1479 33554432000 4194304 5964478 140733592328352 139942849407336 4399854 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 163360

[startup+0.300281 s]
/proc/loadavg: 3.81 3.95 3.94 4/181 24912
/proc/meminfo: memFree=28169104/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=163360 CPUtime=0.59 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 2053 0 0 0 57 2 0 0 20 0 3 0 332006678 167280640 2000 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40840 2000 204 433 0 40404 0
[pid=24912/tid=24913] ppid=24910 vsize=163360 CPUtime=0.28 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 665 0 0 0 28 0 0 0 20 0 3 0 332006678 167280640 2000 33554432000 4194304 5964478 140733592328352 139942859896632 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=163360 CPUtime=0.28 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 630 0 0 0 26 2 0 0 20 0 3 0 332006678 167280640 2000 33554432000 4194304 5964478 140733592328352 139942849407336 4409255 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 163360

[startup+0.700283 s]
/proc/loadavg: 3.81 3.95 3.94 4/181 24912
/proc/meminfo: memFree=28169104/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=163360 CPUtime=1.38 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 3054 0 0 0 136 2 0 0 20 0 3 0 332006678 167280640 3001 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40840 3002 204 433 0 40404 0
[pid=24912/tid=24913] ppid=24910 vsize=163360 CPUtime=0.68 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 1381 0 0 0 68 0 0 0 20 0 3 0 332006678 167280640 3002 33554432000 4194304 5964478 140733592328352 139942859896824 5130994 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=163360 CPUtime=0.68 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 916 0 0 0 66 2 0 0 20 0 3 0 332006678 167280640 3002 33554432000 4194304 5964478 140733592328352 139942849407288 4400106 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 163360

[startup+1.5003 s]
/proc/loadavg: 3.81 3.95 3.94 5/184 24915
/proc/meminfo: memFree=28155424/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=163648 CPUtime=2.99 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 4190 0 0 0 295 4 0 0 20 0 3 0 332006678 167575552 4137 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40912 4137 204 433 0 40476 0
[pid=24912/tid=24913] ppid=24910 vsize=163648 CPUtime=1.48 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 2008 0 0 0 148 0 0 0 20 0 3 0 332006678 167575552 4137 33554432000 4194304 5964478 140733592328352 139942859896760 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=163648 CPUtime=1.48 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 1424 0 0 0 145 3 0 0 20 0 3 0 332006678 167575552 4137 33554432000 4194304 5964478 140733592328352 139942849407288 4399915 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 163648

[startup+3.10029 s]
/proc/loadavg: 3.81 3.95 3.94 5/184 24915
/proc/meminfo: memFree=28150472/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=163504 CPUtime=6.18 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 4723 0 0 0 614 4 0 0 20 0 3 0 332006678 167428096 4644 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40876 4644 204 433 0 40440 0
[pid=24912/tid=24913] ppid=24910 vsize=163504 CPUtime=3.07 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 2421 0 0 0 307 0 0 0 20 0 3 0 332006678 167428096 4644 33554432000 4194304 5964478 140733592328352 139942859897784 4400542 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=163504 CPUtime=3.07 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 1544 0 0 0 304 3 0 0 20 0 3 0 332006678 167428096 4644 33554432000 4194304 5964478 140733592328352 139942849407096 4392717 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 163504

[startup+6.30032 s]
/proc/loadavg: 3.90 3.97 3.94 5/184 24915
/proc/meminfo: memFree=28141792/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=163792 CPUtime=12.58 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 6839 0 0 0 1253 5 0 0 20 0 3 0 332006678 167723008 6760 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 40948 6760 204 433 0 40512 0
[pid=24912/tid=24913] ppid=24910 vsize=163792 CPUtime=6.26 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 4072 0 0 0 625 1 0 0 20 0 3 0 332006678 167723008 6760 33554432000 4194304 5964478 140733592328352 139942859896824 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=163792 CPUtime=6.26 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 2009 0 0 0 622 4 0 0 20 0 3 0 332006678 167723008 6760 33554432000 4194304 5964478 140733592328352 139942849407096 4400115 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 163792

[startup+12.7003 s]
/proc/loadavg: 3.91 3.97 3.94 5/184 24915
/proc/meminfo: memFree=28112188/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=164140 CPUtime=25.38 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 14040 0 0 0 2527 11 0 0 20 0 3 0 332006678 168079360 13961 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 41035 13961 204 433 0 40599 0
[pid=24912/tid=24913] ppid=24910 vsize=164140 CPUtime=12.65 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 9982 0 0 0 1260 5 0 0 20 0 3 0 332006678 168079360 13961 33554432000 4194304 5964478 140733592328352 139942859896824 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=164140 CPUtime=12.65 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 3300 0 0 0 1259 6 0 0 20 0 3 0 332006678 168079360 13961 33554432000 4194304 5964478 140733592328352 139942849407288 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 164140

[startup+25.5004 s]
/proc/loadavg: 3.93 3.97 3.94 5/184 24915
/proc/meminfo: memFree=28078700/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=164872 CPUtime=50.98 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 19220 0 0 0 5076 22 0 0 20 0 3 0 332006678 168828928 19141 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 41218 19141 204 433 0 40782 0
[pid=24912/tid=24913] ppid=24910 vsize=164872 CPUtime=25.42 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 14301 0 0 0 2530 12 0 0 20 0 3 0 332006678 168828928 19141 33554432000 4194304 5964478 140733592328352 139942859896632 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=164872 CPUtime=25.41 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 4161 0 0 0 2533 8 0 0 20 0 3 0 332006678 168828928 19141 33554432000 4194304 5964478 140733592328352 139942849407048 4221120 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 164872

[startup+51.1004 s]
/proc/loadavg: 3.95 3.97 3.94 5/183 24915
/proc/meminfo: memFree=28043196/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=231004 CPUtime=102.17 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 25160 0 0 0 10187 30 0 0 20 0 3 0 332006678 236548096 25081 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 57751 25081 204 433 0 57315 0
[pid=24912/tid=24913] ppid=24910 vsize=231004 CPUtime=50.95 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 18965 0 0 0 5075 20 0 0 20 0 3 0 332006678 236548096 25081 33554432000 4194304 5964478 140733592328352 139942859896632 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=231004 CPUtime=50.95 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 5437 0 0 0 5086 9 0 0 20 0 3 0 332006678 236548096 25081 33554432000 4194304 5964478 140733592328352 139942849407048 4403343 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.17
Current children cumulated vsize (KiB) 231004

[startup+102.307 s]
/proc/loadavg: 3.98 3.97 3.94 5/183 24915
/proc/meminfo: memFree=27953108/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=233768 CPUtime=204.55 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 37155 0 0 0 20406 49 0 0 20 0 3 0 332006678 239378432 37326 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 58442 37326 204 433 0 58006 0
[pid=24912/tid=24913] ppid=24910 vsize=233768 CPUtime=102.01 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 29013 0 0 0 10166 35 0 0 20 0 3 0 332006678 239378432 37326 33554432000 4194304 5964478 140733592328352 139942859896632 4400069 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=233768 CPUtime=102.02 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 7384 0 0 0 10187 15 0 0 20 0 3 0 332006678 239378432 37326 33554432000 4194304 5964478 140733592328352 139942849407336 4400091 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 204.55
Current children cumulated vsize (KiB) 233768

[startup+162.3 s]
/proc/loadavg: 3.99 3.97 3.94 5/183 24915
/proc/meminfo: memFree=27853816/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=302272 CPUtime=324.46 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 48515 0 0 0 32375 71 0 0 20 0 3 0 332006678 309526528 49114 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 75568 49114 204 433 0 75132 0
[pid=24912/tid=24913] ppid=24910 vsize=302272 CPUtime=161.8 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 37983 0 0 0 16126 54 0 0 20 0 3 0 332006678 309526528 49114 33554432000 4194304 5964478 140733592328352 139942859896632 4403692 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=302272 CPUtime=161.86 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 9774 0 0 0 16166 20 0 0 20 0 3 0 332006678 309526528 49114 33554432000 4194304 5964478 140733592328352 139942849407288 4400042 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 324.46
Current children cumulated vsize (KiB) 302272

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.94 5/183 24916
/proc/meminfo: memFree=27766772/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=308664 CPUtime=444.42 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 56021 0 0 0 44360 82 0 0 20 0 3 0 332006678 316071936 57887 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 77166 57887 204 433 0 76730 0
[pid=24912/tid=24913] ppid=24910 vsize=308664 CPUtime=221.64 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 41097 0 0 0 22106 58 0 0 20 0 3 0 332006678 316071936 57887 33554432000 4194304 5964478 140733592328352 139942859896632 4400089 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=308664 CPUtime=221.68 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 14166 0 0 0 22138 30 0 0 20 0 3 0 332006678 316071936 57887 33554432000 4194304 5964478 140733592328352 139942849407288 4379392 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 444.42
Current children cumulated vsize (KiB) 308664

################
# More data... #
################

[pid=24912/tid=24914] ppid=24910 vsize=384208 CPUtime=341.37 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 15194 0 0 0 34103 34 0 0 20 0 3 0 332006678 393428992 71791 33554432000 4194304 5964478 140733592328352 139942849407288 4399915 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 684.38
Current children cumulated vsize (KiB) 384208

[startup+402.3 s]
/proc/loadavg: 3.99 3.97 3.94 5/183 24916
/proc/meminfo: memFree=27585984/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=387924 CPUtime=804.33 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 77214 0 0 0 80313 120 0 0 20 0 3 0 332006678 397234176 79237 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 96981 79237 204 433 0 96545 0
[pid=24912/tid=24913] ppid=24910 vsize=387924 CPUtime=401.15 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 60641 0 0 0 40019 96 0 0 20 0 3 0 332006678 397234176 79237 33554432000 4194304 5964478 140733592328352 139942859896824 4378831 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=387924 CPUtime=401.2 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 15815 0 0 0 40085 35 0 0 20 0 3 0 332006678 397234176 79237 33554432000 4194304 5964478 140733592328352 139942849407096 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 804.33
Current children cumulated vsize (KiB) 387924

[startup+462.3 s]
/proc/loadavg: 3.99 3.97 3.94 5/183 24916
/proc/meminfo: memFree=27586396/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=366000 CPUtime=924.3 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 78639 0 0 0 92307 123 0 0 20 0 3 0 332006678 374784000 76180 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 91500 76180 204 433 0 91064 0
[pid=24912/tid=24913] ppid=24910 vsize=366000 CPUtime=460.98 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 60743 0 0 0 46001 97 0 0 20 0 3 0 332006678 374784000 76180 33554432000 4194304 5964478 140733592328352 139942859897784 4400542 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=366000 CPUtime=461.05 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 17138 0 0 0 46066 39 0 0 20 0 3 0 332006678 374784000 76180 33554432000 4194304 5964478 140733592328352 139942849407048 4403343 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 924.3
Current children cumulated vsize (KiB) 366000

[startup+522.3 s]
/proc/loadavg: 4.04 3.99 3.95 5/183 24917
/proc/meminfo: memFree=27549808/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=366140 CPUtime=1044.28 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 79167 0 0 0 104305 123 0 0 20 0 3 0 332006678 374927360 76706 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 91535 76706 204 433 0 91099 0
[pid=24912/tid=24913] ppid=24910 vsize=366140 CPUtime=520.83 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 60750 0 0 0 51985 98 0 0 20 0 3 0 332006678 374927360 76706 33554432000 4194304 5964478 140733592328352 139942859897784 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=366140 CPUtime=520.89 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 17659 0 0 0 52050 39 0 0 20 0 3 0 332006678 374927360 76706 33554432000 4194304 5964478 140733592328352 139942849407288 4400056 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1044.28
Current children cumulated vsize (KiB) 366140

[startup+582.3 s]
/proc/loadavg: 4.01 3.99 3.95 5/184 24918
/proc/meminfo: memFree=27535120/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=432904 CPUtime=1164.26 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 81000 0 0 0 116300 126 0 0 20 0 3 0 332006678 443293696 78542 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 108226 78542 204 433 0 107790 0
[pid=24912/tid=24913] ppid=24910 vsize=432904 CPUtime=580.68 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 60750 0 0 0 57969 99 0 0 20 0 3 0 332006678 443293696 78542 33554432000 4194304 5964478 140733592328352 139942859897784 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=432904 CPUtime=580.73 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 19492 0 0 0 58030 43 0 0 20 0 3 0 332006678 443293696 78542 33554432000 4194304 5964478 140733592328352 139942849407288 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1164.26
Current children cumulated vsize (KiB) 432904

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/184 24920
/proc/meminfo: memFree=27457276/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=433588 CPUtime=1284.26 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 83676 0 0 0 128295 131 0 0 20 0 3 0 332006678 443994112 81218 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 108397 81218 204 433 0 107961 0
[pid=24912/tid=24913] ppid=24910 vsize=433588 CPUtime=640.53 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 60750 0 0 0 63953 100 0 0 20 0 3 0 332006678 443994112 81218 33554432000 4194304 5964478 140733592328352 139942859897784 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=433588 CPUtime=640.58 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 22168 0 0 0 64010 48 0 0 20 0 3 0 332006678 443994112 81218 33554432000 4194304 5964478 140733592328352 139942849407048 4399946 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1284.26
Current children cumulated vsize (KiB) 433588

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/183 24920
/proc/meminfo: memFree=27426872/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=434068 CPUtime=1404.22 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 83789 0 0 0 140291 131 0 0 20 0 3 0 332006678 444485632 81331 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 108517 81331 204 433 0 108081 0
[pid=24912/tid=24913] ppid=24910 vsize=434068 CPUtime=700.37 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 60750 0 0 0 69936 101 0 0 20 0 3 0 332006678 444485632 81331 33554432000 4194304 5964478 140733592328352 139942859897784 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=434068 CPUtime=700.42 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 22281 0 0 0 69993 49 0 0 20 0 3 0 332006678 444485632 81331 33554432000 4194304 5964478 140733592328352 139942849407048 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1404.22
Current children cumulated vsize (KiB) 434068

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.95 5/183 24920
/proc/meminfo: memFree=27390400/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=434600 CPUtime=1524.22 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 83852 0 0 0 152291 131 0 0 20 0 3 0 332006678 445030400 81394 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 108650 81394 204 433 0 108214 0
[pid=24912/tid=24913] ppid=24910 vsize=434600 CPUtime=760.22 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 60751 0 0 0 75920 102 0 0 20 0 3 0 332006678 445030400 81394 33554432000 4194304 5964478 140733592328352 139942859897784 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=434600 CPUtime=760.27 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 22343 0 0 0 75977 50 0 0 20 0 3 0 332006678 445030400 81394 33554432000 4194304 5964478 140733592328352 139942849407048 4399915 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1524.22
Current children cumulated vsize (KiB) 434600

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/183 24921
/proc/meminfo: memFree=27363492/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=434600 CPUtime=1644.18 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 90605 0 0 0 164269 149 0 0 20 0 3 0 332006678 445030400 88147 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 108650 88147 204 433 0 108214 0
[pid=24912/tid=24913] ppid=24910 vsize=434600 CPUtime=820.06 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 67466 0 0 0 81885 121 0 0 20 0 3 0 332006678 445030400 88147 33554432000 4194304 5964478 140733592328352 139942859896824 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=434600 CPUtime=820.11 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 22381 0 0 0 81960 51 0 0 20 0 3 0 332006678 445030400 88147 33554432000 4194304 5964478 140733592328352 139942849407048 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1644.18
Current children cumulated vsize (KiB) 434600

[startup+882.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/183 24962
/proc/meminfo: memFree=27601120/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=500244 CPUtime=1764.13 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 94695 0 0 0 176255 158 0 0 20 0 3 0 332006678 512249856 92402 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 125061 92402 204 433 0 124625 0
[pid=24912/tid=24913] ppid=24910 vsize=500244 CPUtime=879.88 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 71537 0 0 0 87857 131 0 0 20 0 3 0 332006678 512249856 92402 33554432000 4194304 5964478 140733592328352 139942859896632 4400067 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=500244 CPUtime=879.95 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 22400 0 0 0 87943 52 0 0 20 0 3 0 332006678 512249856 92402 33554432000 4194304 5964478 140733592328352 139942849407336 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1764.13
Current children cumulated vsize (KiB) 500244



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/183 24962
/proc/meminfo: memFree=27515580/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=500244 CPUtime=1800.14 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 94879 0 0 0 179856 158 0 0 20 0 3 0 332006678 512249856 92586 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 125061 92586 204 433 0 124625 0
[pid=24912/tid=24913] ppid=24910 vsize=500244 CPUtime=897.84 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 71721 0 0 0 89653 131 0 0 20 0 3 0 332006678 512249856 92586 33554432000 4194304 5964478 140733592328352 139942859896632 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=500244 CPUtime=897.91 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 22400 0 0 0 89739 52 0 0 20 0 3 0 332006678 512249856 92586 33554432000 4194304 5964478 140733592328352 139942849407336 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800.14
Current children cumulated vsize (KiB) 500244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/183 24962
/proc/meminfo: memFree=27515580/32873844 swapFree=7124/7124
[pid=24912] ppid=24910 vsize=500244 CPUtime=1800.14 cores=1,3,5,7
/proc/24912/stat : 24912 (pwbo2.02) S 24910 24912 22415 0 -1 4202496 94879 0 0 0 179856 158 0 0 20 0 3 0 332006678 512249856 92586 33554432000 4194304 5964478 140733592328352 140733592327872 4546685 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24912/statm: 125061 92586 204 433 0 124625 0
[pid=24912/tid=24913] ppid=24910 vsize=500244 CPUtime=897.84 cores=1,3,5,7
/proc/24912/task/24913/stat : 24913 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 71721 0 0 0 89653 131 0 0 20 0 3 0 332006678 512249856 92586 33554432000 4194304 5964478 140733592328352 139942859896632 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24912/tid=24914] ppid=24910 vsize=500244 CPUtime=897.91 cores=1,3,5,7
/proc/24912/task/24914/stat : 24914 (pwbo2.02) R 24910 24912 22415 0 -1 4202560 22400 0 0 0 89739 52 0 0 20 0 3 0 332006678 512249856 92586 33554432000 4194304 5964478 140733592328352 139942849407336 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800.14
Current children cumulated vsize (KiB) 500244

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24912 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=929281
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=861716
# CPU time returned by wait4() is 1795.79
# while last known CPU time is 1800.14
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.315
CPU time (s): 1800.14
CPU user time (s): 1798.56
CPU system time (s): 1.58
CPU usage (%): 199.945
Max. virtual memory (cumulated for all children) (KiB): 500244

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.93
system time used= 1.86172
maximum resident set size= 370352
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 94881
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 253
involuntary context switches= 2316

runsolver used 3.01154 second user time and 4.76427 second system time

The end

Launcher Data 

Begin job on node134 at 2012-06-02 19:40:13
IDJOB=3726330
IDBENCH=89907
IDSOLVER=2309
FILE ID=node134/3726330-1338658813
RUNJOBID= node134-1338651430-23917
PBS_JOBID= 14636446
Free space on /tmp= 70356 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/kullmann/normalized-sbox_4_shg.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3726330-1338658813/watcher-3726330-1338658813 -o /tmp/evaluation-result-3726330-1338658813/solver-3726330-1338658813 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726330-1338658813.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 175e0a4a6cd805ac131e3fa3fd7ba75e
RANDOM SEED=1931475812

node134.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28169484 kB
Buffers:          457540 kB
Cached:          3272460 kB
SwapCached:           76 kB
Active:          1791140 kB
Inactive:        2021072 kB
Active(anon):      73776 kB
Inactive(anon):    10508 kB
Active(file):    1717364 kB
Inactive(file):  2010564 kB
Unevictable:        7124 kB
Mlocked:            7124 kB
SwapTotal:      67108856 kB
SwapFree:       67107756 kB
Dirty:              5472 kB
Writeback:             0 kB
AnonPages:         88608 kB
Mapped:            11840 kB
Shmem:                96 kB
Slab:             753892 kB
SReclaimable:     195604 kB
SUnreclaim:       558288 kB
KernelStack:        1488 kB
PageTables:         4092 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     162568 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70348 MiB
End job on node134 at 2012-06-02 19:55:15