Trace number 3733985

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.42 523.216

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/golomb-rulers/normalized-OGR_13.opb
MD5SUM292e71503f1e4f136e087e61da3c7ed4
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark117
Best CPU time to get the best result obtained on this benchmark1800.48
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 118
Optimality of the best value was proved NO
Number of variables2470
Total number of constraints4744
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints4744
Minimum length of a constraint16
Maximum length of a constraint33
Number of terms in the objective function 8
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 255
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 256
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 1357
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3733985-1339247502.opb.
0.00/0.00	c Instance file HOME/instance-3733985-1339247502.opb
0.00/0.00	c File size is 1119445 bytes.
0.00/0.51	c Highest Coefficient sum: 1357
0.00/0.51	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.52	c ============================[ Problem Statistics ]=============================
0.00/0.52	c |                                                                             |
0.00/0.52	c |  Parsing time:          0.52         s                                      |
0.00/0.52	c |  Number Variables:      2470                                                |
0.00/0.52	c |  Number Constraints:    4744                                                |
0.00/0.52	c ===============================================================================

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3733985-1339247502/watcher-3733985-1339247502 -o /tmp/evaluation-result-3733985-1339247502/solver-3733985-1339247502 -C 1800 -W 1900 -M 15500 run HOME/instance-3733985-1339247502.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.84 9.13 5.18 10/184 7537
/proc/meminfo: memFree=31070592/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0

[startup+0.0797939 s]
/proc/loadavg: 11.84 9.13 5.18 10/184 7537
/proc/meminfo: memFree=31070592/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100256 s]
/proc/loadavg: 11.84 9.13 5.18 10/184 7537
/proc/meminfo: memFree=31070592/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.30011 s]
/proc/loadavg: 11.84 9.13 5.18 10/184 7537
/proc/meminfo: memFree=31070592/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700249 s]
/proc/loadavg: 11.84 9.13 5.18 10/184 7537
/proc/meminfo: memFree=31070592/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50028 s]
/proc/loadavg: 11.84 9.13 5.18 10/186 7539
/proc/meminfo: memFree=31043352/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=38988 CPUtime=1.49 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 19317 0 0 0 147 2 0 0 20 0 1 0 390874338 39923712 6107 33554432000 134512640 146736320 4289992320 4289986300 135526778 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/7538/statm: 9747 6107 880 2985 0 6681 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 48136

[startup+3.10031 s]
/proc/loadavg: 11.84 9.13 5.18 10/186 7539
/proc/meminfo: memFree=31033308/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=44600 CPUtime=3.09 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 30590 0 0 0 305 4 0 0 20 0 1 0 390874338 45670400 7389 33554432000 134512640 146736320 4289992320 4289987352 144757825 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/7538/statm: 11150 7389 883 2985 0 8084 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 53748

[startup+6.30019 s]
/proc/loadavg: 11.61 9.13 5.20 10/186 7539
/proc/meminfo: memFree=31033556/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=46472 CPUtime=6.29 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 44763 0 0 0 622 7 0 0 20 0 1 0 390874338 47587328 8034 33554432000 134512640 146736320 4289992320 4289986960 136403112 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/7538/statm: 11618 8034 907 2985 0 8552 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 55620

[startup+12.7004 s]
/proc/loadavg: 11.80 9.21 5.25 10/193 7603
/proc/meminfo: memFree=31488432/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=325280 CPUtime=25.55 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 106463 0 0 0 2533 22 0 0 20 0 8 0 390874338 333086720 51744 33554432000 134512640 146736320 4289992320 4289985960 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7538/statm: 81320 51744 938 2985 0 78254 0
[pid=7538/tid=7590] ppid=7537 vsize=325280 CPUtime=1.55 cores=0,2,4,6
/proc/7538/task/7590/stat : 7590 (pb_cplex) R 7537 7537 7175 0 -1 4202560 5535 0 0 0 155 0 0 0 20 0 8 0 390874990 333086720 51744 33554432000 134512640 146736320 4289992320 4085502344 136388081 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7591] ppid=7537 vsize=325280 CPUtime=1.8 cores=0,2,4,6
/proc/7538/task/7591/stat : 7591 (pb_cplex) R 7537 7537 7175 0 -1 4202560 5348 0 0 0 178 2 0 0 20 0 8 0 390874990 333086720 51744 33554432000 134512640 146736320 4289992320 4075017192 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7592] ppid=7537 vsize=325280 CPUtime=3.1 cores=0,2,4,6
/proc/7538/task/7592/stat : 7592 (pb_cplex) R 7537 7537 7175 0 -1 4202560 5651 0 0 0 308 2 0 0 20 0 8 0 390874990 333086720 51744 33554432000 134512640 146736320 4289992320 4064530600 135983252 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7593] ppid=7537 vsize=325280 CPUtime=1.67 cores=0,2,4,6
/proc/7538/task/7593/stat : 7593 (pb_cplex) R 7537 7537 7175 0 -1 4202560 5240 0 0 0 165 2 0 0 20 0 8 0 390874990 333086720 51744 33554432000 134512640 146736320 4289992320 4054045744 135983021 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7594] ppid=7537 vsize=325280 CPUtime=3.15 cores=0,2,4,6
/proc/7538/task/7594/stat : 7594 (pb_cplex) R 7537 7537 7175 0 -1 4202560 5864 0 0 0 313 2 0 0 20 0 8 0 390874990 333086720 51744 33554432000 134512640 146736320 4289992320 4043558964 135450982 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7595] ppid=7537 vsize=325280 CPUtime=1.44 cores=0,2,4,6
/proc/7538/task/7595/stat : 7595 (pb_cplex) R 7537 7537 7175 0 -1 4202560 4905 0 0 0 144 0 0 0 20 0 8 0 390874990 333086720 51744 33554432000 134512640 146736320 4289992320 4033073744 136403116 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7596] ppid=7537 vsize=325280 CPUtime=3.67 cores=0,2,4,6
/proc/7538/task/7596/stat : 7596 (pb_cplex) R 7537 7537 7175 0 -1 4202560 5185 0 0 0 365 2 0 0 20 0 8 0 390874990 333086720 51744 33554432000 134512640 146736320 4289992320 4022587984 136403109 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.55
Current children cumulated vsize (KiB) 334428

[startup+25.5004 s]
/proc/loadavg: 11.09 9.18 5.30 17/193 7617
/proc/meminfo: memFree=31464608/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=346776 CPUtime=60.7 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 143461 0 0 0 6035 35 0 0 20 0 8 0 390874338 355098624 56829 33554432000 134512640 146736320 4289992320 4289985168 136008065 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/7538/statm: 86694 56829 941 2985 0 83628 0
[pid=7538/tid=7590] ppid=7537 vsize=346776 CPUtime=6.91 cores=0,2,4,6
/proc/7538/task/7590/stat : 7590 (pb_cplex) R 7537 7537 7175 0 -1 4202560 12594 0 0 0 687 4 0 0 20 0 8 0 390874990 355098624 56829 33554432000 134512640 146736320 4289992320 4085502160 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7591] ppid=7537 vsize=346776 CPUtime=4.08 cores=0,2,4,6
/proc/7538/task/7591/stat : 7591 (pb_cplex) R 7537 7537 7175 0 -1 4202560 7770 0 0 0 405 3 0 0 20 0 8 0 390874990 355098624 56829 33554432000 134512640 146736320 4289992320 4075016284 135854535 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7592] ppid=7537 vsize=346776 CPUtime=13.56 cores=0,2,4,6
/proc/7538/task/7592/stat : 7592 (pb_cplex) R 7537 7537 7175 0 -1 4202560 10264 0 0 0 1353 3 0 0 20 0 8 0 390874990 355098624 56829 33554432000 134512640 146736320 4289992320 4064530640 136008266 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7593] ppid=7537 vsize=346776 CPUtime=4.07 cores=0,2,4,6
/proc/7538/task/7593/stat : 7593 (pb_cplex) R 7537 7537 7175 0 -1 4202560 8186 0 0 0 404 3 0 0 20 0 8 0 390874990 355098624 56829 33554432000 134512640 146736320 4289992320 4054044868 135844431 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7594] ppid=7537 vsize=346776 CPUtime=5.31 cores=0,2,4,6
/proc/7538/task/7594/stat : 7594 (pb_cplex) R 7537 7537 7175 0 -1 4202560 9317 0 0 0 527 4 0 0 20 0 8 0 390874990 355098624 56829 33554432000 134512640 146736320 4289992320 4043559112 136388619 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7595] ppid=7537 vsize=346776 CPUtime=4.16 cores=0,2,4,6
/proc/7538/task/7595/stat : 7595 (pb_cplex) R 7537 7537 7175 0 -1 4202560 9333 0 0 0 413 3 0 0 20 0 8 0 390874990 355098624 56829 33554432000 134512640 146736320 4289992320 4033073360 136008050 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7596] ppid=7537 vsize=346776 CPUtime=5.99 cores=0,2,4,6
/proc/7538/task/7596/stat : 7596 (pb_cplex) R 7537 7537 7175 0 -1 4202560 9958 0 0 0 596 3 0 0 20 0 8 0 390874990 355098624 56829 33554432000 134512640 146736320 4289992320 4022588292 135850175 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 60.7
Current children cumulated vsize (KiB) 355924

[startup+51.1004 s]
/proc/loadavg: 11.49 9.42 5.49 12/193 7617
/proc/meminfo: memFree=31411724/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=380436 CPUtime=150.94 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 180003 0 0 0 15041 53 0 0 20 0 8 0 390874338 389566464 65095 33554432000 134512640 146736320 4289992320 4289985552 136403112 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7538/statm: 95109 65095 941 2985 0 92043 0
[pid=7538/tid=7590] ppid=7537 vsize=380436 CPUtime=19.96 cores=0,2,4,6
/proc/7538/task/7590/stat : 7590 (pb_cplex) R 7537 7537 7175 0 -1 4202560 17510 0 0 0 1991 5 0 0 20 0 8 0 390874990 389566464 65095 33554432000 134512640 146736320 4289992320 4085502160 136008226 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7591] ppid=7537 vsize=380436 CPUtime=11.01 cores=0,2,4,6
/proc/7538/task/7591/stat : 7591 (pb_cplex) S 7537 7537 7175 0 -1 4202560 10772 0 0 0 1095 6 0 0 20 0 8 0 390874990 389566464 65095 33554432000 134512640 146736320 4289992320 4075019920 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7592] ppid=7537 vsize=380436 CPUtime=30.59 cores=0,2,4,6
/proc/7538/task/7592/stat : 7592 (pb_cplex) R 7537 7537 7175 0 -1 4202560 14508 0 0 0 3053 6 0 0 20 0 8 0 390874990 389566464 65095 33554432000 134512640 146736320 4289992320 4064530544 136384892 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7593] ppid=7537 vsize=380436 CPUtime=12.95 cores=0,2,4,6
/proc/7538/task/7593/stat : 7593 (pb_cplex) S 7537 7537 7175 0 -1 4202560 12534 0 0 0 1290 5 0 0 20 0 8 0 390874990 389566464 65095 33554432000 134512640 146736320 4289992320 4054048400 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7594] ppid=7537 vsize=380436 CPUtime=13.46 cores=0,2,4,6
/proc/7538/task/7594/stat : 7594 (pb_cplex) R 7537 7537 7175 0 -1 4202560 15860 0 0 0 1340 6 0 0 20 0 8 0 390874990 389566464 65095 33554432000 134512640 146736320 4289992320 4043558952 139044550 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7595] ppid=7537 vsize=380436 CPUtime=14.68 cores=0,2,4,6
/proc/7538/task/7595/stat : 7595 (pb_cplex) R 7537 7537 7175 0 -1 4202560 14143 0 0 0 1463 5 0 0 20 0 8 0 390874990 389566464 65095 33554432000 134512640 146736320 4289992320 4033073192 139044572 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7596] ppid=7537 vsize=380436 CPUtime=17.06 cores=0,2,4,6
/proc/7538/task/7596/stat : 7596 (pb_cplex) S 7537 7537 7175 0 -1 4202560 15192 0 0 0 1700 6 0 0 20 0 8 0 390874990 389566464 65095 33554432000 134512640 146736320 4289992320 4022591120 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 150.94
Current children cumulated vsize (KiB) 389584

[startup+102.307 s]
/proc/loadavg: 12.87 10.09 5.91 11/193 7617
/proc/meminfo: memFree=31388108/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=396068 CPUtime=327.08 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 272961 0 0 0 32617 91 0 0 20 0 8 0 390874338 405573632 69371 33554432000 134512640 146736320 4289992320 4289985536 136001193 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7538/statm: 99017 69371 941 2985 0 95951 0
[pid=7538/tid=7590] ppid=7537 vsize=396068 CPUtime=41.53 cores=0,2,4,6
/proc/7538/task/7590/stat : 7590 (pb_cplex) R 7537 7537 7175 0 -1 4202560 34678 0 0 0 4141 12 0 0 20 0 8 0 390874990 405573632 69371 33554432000 134512640 146736320 4289992320 4085502160 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7591] ppid=7537 vsize=396068 CPUtime=25.73 cores=0,2,4,6
/proc/7538/task/7591/stat : 7591 (pb_cplex) R 7537 7537 7175 0 -1 4202560 26857 0 0 0 2562 11 0 0 20 0 8 0 390874990 405573632 69371 33554432000 134512640 146736320 4289992320 4075018196 138443690 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7592] ppid=7537 vsize=396068 CPUtime=56.82 cores=0,2,4,6
/proc/7538/task/7592/stat : 7592 (pb_cplex) R 7537 7537 7175 0 -1 4202560 31424 0 0 0 5670 12 0 0 20 0 8 0 390874990 405573632 69371 33554432000 134512640 146736320 4289992320 4064530708 136004958 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7593] ppid=7537 vsize=396068 CPUtime=31.45 cores=0,2,4,6
/proc/7538/task/7593/stat : 7593 (pb_cplex) R 7537 7537 7175 0 -1 4202560 19437 0 0 0 3136 9 0 0 20 0 8 0 390874990 405573632 69371 33554432000 134512640 146736320 4289992320 4054044880 136008450 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7594] ppid=7537 vsize=396068 CPUtime=41.6 cores=0,2,4,6
/proc/7538/task/7594/stat : 7594 (pb_cplex) R 7537 7537 7175 0 -1 4202560 21111 0 0 0 4152 8 0 0 20 0 8 0 390874990 405573632 69371 33554432000 134512640 146736320 4289992320 4043558952 139044552 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7595] ppid=7537 vsize=396068 CPUtime=39.21 cores=0,2,4,6
/proc/7538/task/7595/stat : 7595 (pb_cplex) R 7537 7537 7175 0 -1 4202560 27337 0 0 0 3910 11 0 0 20 0 8 0 390874990 405573632 69371 33554432000 134512640 146736320 4289992320 4033073360 136008065 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7596] ppid=7537 vsize=396068 CPUtime=33.11 cores=0,2,4,6

################
# More data... #
################

/proc/7538/statm: 84580 57618 979 2985 0 81514 0
[pid=7538/tid=7625] ppid=7537 vsize=338320 CPUtime=67.22 cores=0,2,4,6
/proc/7538/task/7625/stat : 7625 (pb_cplex) R 7537 7537 7175 0 -1 4202560 77805 0 0 0 6698 24 0 0 20 0 8 0 390887590 346439680 57618 33554432000 134512640 146736320 4289992320 4122910928 136008050 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7626] ppid=7537 vsize=338320 CPUtime=68.32 cores=0,2,4,6
/proc/7538/task/7626/stat : 7626 (pb_cplex) R 7537 7537 7175 0 -1 4202560 87628 0 0 0 6803 29 0 0 20 0 8 0 390887590 346439680 57618 33554432000 134512640 146736320 4289992320 4133396688 136008259 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7627] ppid=7537 vsize=338320 CPUtime=68.93 cores=0,2,4,6
/proc/7538/task/7627/stat : 7627 (pb_cplex) R 7537 7537 7175 0 -1 4202560 83565 0 0 0 6867 26 0 0 20 0 8 0 390887590 346439680 57618 33554432000 134512640 146736320 4289992320 4143882444 135846861 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7628] ppid=7537 vsize=338320 CPUtime=64.24 cores=0,2,4,6
/proc/7538/task/7628/stat : 7628 (pb_cplex) R 7537 7537 7175 0 -1 4202560 61588 0 0 0 6403 21 0 0 20 0 8 0 390887590 346439680 57618 33554432000 134512640 146736320 4289992320 4054044880 136008065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7629] ppid=7537 vsize=338320 CPUtime=65.86 cores=0,2,4,6
/proc/7538/task/7629/stat : 7629 (pb_cplex) R 7537 7537 7175 0 -1 4202560 95048 0 0 0 6560 26 0 0 20 0 8 0 390887590 346439680 57618 33554432000 134512640 146736320 4289992320 4037468368 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7630] ppid=7537 vsize=338320 CPUtime=72.59 cores=0,2,4,6
/proc/7538/task/7630/stat : 7630 (pb_cplex) R 7537 7537 7175 0 -1 4202560 97446 0 0 0 7232 27 0 0 20 0 8 0 390887590 346439680 57618 33554432000 134512640 146736320 4289992320 4026982992 136403103 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7631] ppid=7537 vsize=338320 CPUtime=59.94 cores=0,2,4,6
/proc/7538/task/7631/stat : 7631 (pb_cplex) R 7537 7537 7175 0 -1 4202560 108843 0 0 0 5962 32 0 0 20 0 8 0 390887590 346439680 57618 33554432000 134512640 146736320 4289992320 3956269264 136008056 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 926.55
Current children cumulated vsize (KiB) 347468

[startup+342.301 s]
/proc/loadavg: 12.52 11.16 7.27 11/193 7632
/proc/meminfo: memFree=31389480/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=368656 CPUtime=1139.19 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) S 7537 7537 7175 0 -1 4202496 1348748 0 0 0 113502 417 0 0 20 0 8 0 390874338 377503744 66098 33554432000 134512640 146736320 4289992320 4289988688 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7538/statm: 92164 66098 979 2985 0 89098 0
[pid=7538/tid=7625] ppid=7537 vsize=368656 CPUtime=94.49 cores=0,2,4,6
/proc/7538/task/7625/stat : 7625 (pb_cplex) S 7537 7537 7175 0 -1 4202560 121389 0 0 0 9413 36 0 0 20 0 8 0 390887590 377503744 66098 33554432000 134512640 146736320 4289992320 4122914448 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7626] ppid=7537 vsize=368656 CPUtime=91.98 cores=0,2,4,6
/proc/7538/task/7626/stat : 7626 (pb_cplex) S 7537 7537 7175 0 -1 4202560 129525 0 0 0 9156 42 0 0 20 0 8 0 390887590 377503744 66098 33554432000 134512640 146736320 4289992320 4133400208 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7627] ppid=7537 vsize=368656 CPUtime=94.39 cores=0,2,4,6
/proc/7538/task/7627/stat : 7627 (pb_cplex) S 7537 7537 7175 0 -1 4202560 128239 0 0 0 9400 39 0 0 20 0 8 0 390887590 377503744 66098 33554432000 134512640 146736320 4289992320 4143885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7628] ppid=7537 vsize=368656 CPUtime=91.22 cores=0,2,4,6
/proc/7538/task/7628/stat : 7628 (pb_cplex) S 7537 7537 7175 0 -1 4202560 118144 0 0 0 9084 38 0 0 20 0 8 0 390887590 377503744 66098 33554432000 134512640 146736320 4289992320 4054048400 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7629] ppid=7537 vsize=368656 CPUtime=92.96 cores=0,2,4,6
/proc/7538/task/7629/stat : 7629 (pb_cplex) S 7537 7537 7175 0 -1 4202560 130007 0 0 0 9260 36 0 0 20 0 8 0 390887590 377503744 66098 33554432000 134512640 146736320 4289992320 4037471888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7630] ppid=7537 vsize=368656 CPUtime=100.66 cores=0,2,4,6
/proc/7538/task/7630/stat : 7630 (pb_cplex) R 7537 7537 7175 0 -1 4202560 133524 0 0 0 10029 37 0 0 20 0 8 0 390887590 377503744 66098 33554432000 134512640 146736320 4289992320 4026982608 136008050 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7631] ppid=7537 vsize=368656 CPUtime=92.61 cores=0,2,4,6
/proc/7538/task/7631/stat : 7631 (pb_cplex) S 7537 7537 7175 0 -1 4202560 155949 0 0 0 9216 45 0 0 20 0 8 0 390887590 377503744 66098 33554432000 134512640 146736320 4289992320 3956272784 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1139.19
Current children cumulated vsize (KiB) 377804

[startup+402.3 s]
/proc/loadavg: 11.46 11.20 7.53 16/193 7632
/proc/meminfo: memFree=31379240/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=371756 CPUtime=1353.79 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 1573130 0 0 0 134889 490 0 0 20 0 8 0 390874338 380678144 66917 33554432000 134512640 146736320 4289992320 4289985072 136384892 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7538/statm: 92939 66917 979 2985 0 89873 0
[pid=7538/tid=7625] ppid=7537 vsize=371756 CPUtime=119.23 cores=0,2,4,6
/proc/7538/task/7625/stat : 7625 (pb_cplex) R 7537 7537 7175 0 -1 4202560 145505 0 0 0 11879 44 0 0 20 0 8 0 390887590 380678144 66917 33554432000 134512640 146736320 4289992320 4122910792 139042916 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7626] ppid=7537 vsize=371756 CPUtime=120.29 cores=0,2,4,6
/proc/7538/task/7626/stat : 7626 (pb_cplex) R 7537 7537 7175 0 -1 4202560 146684 0 0 0 11981 48 0 0 20 0 8 0 390887590 380678144 66917 33554432000 134512640 146736320 4289992320 4133395628 135454076 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7627] ppid=7537 vsize=371756 CPUtime=121.64 cores=0,2,4,6
/proc/7538/task/7627/stat : 7627 (pb_cplex) R 7537 7537 7175 0 -1 4202560 153698 0 0 0 12115 49 0 0 20 0 8 0 390887590 380678144 66917 33554432000 134512640 146736320 4289992320 4143882448 136008050 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7628] ppid=7537 vsize=371756 CPUtime=120.19 cores=0,2,4,6
/proc/7538/task/7628/stat : 7628 (pb_cplex) R 7537 7537 7175 0 -1 4202560 154916 0 0 0 11971 48 0 0 20 0 8 0 390887590 380678144 66917 33554432000 134512640 146736320 4289992320 4054044744 139042981 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7629] ppid=7537 vsize=371756 CPUtime=118.17 cores=0,2,4,6
/proc/7538/task/7629/stat : 7629 (pb_cplex) R 7537 7537 7175 0 -1 4202560 152609 0 0 0 11773 44 0 0 20 0 8 0 390887590 380678144 66917 33554432000 134512640 146736320 4289992320 4037468368 136008234 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7630] ppid=7537 vsize=371756 CPUtime=125.87 cores=0,2,4,6
/proc/7538/task/7630/stat : 7630 (pb_cplex) R 7537 7537 7175 0 -1 4202560 166920 0 0 0 12541 46 0 0 20 0 8 0 390887590 380678144 66917 33554432000 134512640 146736320 4289992320 4026982952 135983225 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7631] ppid=7537 vsize=371756 CPUtime=114.45 cores=0,2,4,6
/proc/7538/task/7631/stat : 7631 (pb_cplex) R 7537 7537 7175 0 -1 4202560 185888 0 0 0 11390 55 0 0 20 0 8 0 390887590 380678144 66917 33554432000 134512640 146736320 4289992320 3956269500 136400667 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1353.79
Current children cumulated vsize (KiB) 380904

[startup+462.3 s]
/proc/loadavg: 12.05 11.47 7.85 17/193 7632
/proc/meminfo: memFree=31382048/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=373336 CPUtime=1569.46 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 1776748 0 0 0 156389 557 0 0 20 0 8 0 390874338 382296064 67649 33554432000 134512640 146736320 4289992320 4289984960 136019049 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/7538/statm: 93334 67649 979 2985 0 90268 0
[pid=7538/tid=7625] ppid=7537 vsize=373336 CPUtime=139.56 cores=0,2,4,6
/proc/7538/task/7625/stat : 7625 (pb_cplex) R 7537 7537 7175 0 -1 4202560 166367 0 0 0 13904 52 0 0 20 0 8 0 390887590 382296064 67649 33554432000 134512640 146736320 4289992320 4122909672 139044550 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7626] ppid=7537 vsize=373336 CPUtime=143.9 cores=0,2,4,6
/proc/7538/task/7626/stat : 7626 (pb_cplex) R 7537 7537 7175 0 -1 4202560 169861 0 0 0 14332 58 0 0 20 0 8 0 390887590 382296064 67649 33554432000 134512640 146736320 4289992320 4133396688 136008069 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7627] ppid=7537 vsize=373336 CPUtime=148.44 cores=0,2,4,6
/proc/7538/task/7627/stat : 7627 (pb_cplex) R 7537 7537 7175 0 -1 4202560 175837 0 0 0 14786 58 0 0 20 0 8 0 390887590 382296064 67649 33554432000 134512640 146736320 4289992320 4143882448 136008050 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7628] ppid=7537 vsize=373336 CPUtime=149.6 cores=0,2,4,6
/proc/7538/task/7628/stat : 7628 (pb_cplex) R 7537 7537 7175 0 -1 4202560 185477 0 0 0 14901 59 0 0 20 0 8 0 390887590 382296064 67649 33554432000 134512640 146736320 4289992320 4054044880 136008065 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7629] ppid=7537 vsize=373336 CPUtime=145.42 cores=0,2,4,6
/proc/7538/task/7629/stat : 7629 (pb_cplex) R 7537 7537 7175 0 -1 4202560 167728 0 0 0 14492 50 0 0 20 0 8 0 390887590 382296064 67649 33554432000 134512640 146736320 4289992320 4037468328 135983225 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7630] ppid=7537 vsize=373336 CPUtime=159.8 cores=0,2,4,6
/proc/7538/task/7630/stat : 7630 (pb_cplex) R 7537 7537 7175 0 -1 4202560 192494 0 0 0 15926 54 0 0 20 0 8 0 390887590 382296064 67649 33554432000 134512640 146736320 4289992320 4026981520 136008050 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7631] ppid=7537 vsize=373336 CPUtime=141.14 cores=0,2,4,6
/proc/7538/task/7631/stat : 7631 (pb_cplex) R 7537 7537 7175 0 -1 4202560 220834 0 0 0 14047 67 0 0 20 0 8 0 390887590 382296064 67649 33554432000 134512640 146736320 4289992320 3956268224 135468697 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1569.46
Current children cumulated vsize (KiB) 382484

[startup+522.3 s]
/proc/loadavg: 13.08 11.90 8.23 16/194 7635
/proc/meminfo: memFree=31373076/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=375892 CPUtime=1796.81 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 1935267 0 0 0 179063 618 0 0 20 0 8 0 390874338 384913408 68124 33554432000 134512640 146736320 4289992320 4289984900 135523447 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/7538/statm: 93973 68124 979 2985 0 90907 0
[pid=7538/tid=7625] ppid=7537 vsize=375892 CPUtime=172.51 cores=0,2,4,6
/proc/7538/task/7625/stat : 7625 (pb_cplex) R 7537 7537 7175 0 -1 4202560 181755 0 0 0 17192 59 0 0 20 0 8 0 390887590 384913408 68124 33554432000 134512640 146736320 4289992320 4122910928 136008039 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7626] ppid=7537 vsize=375892 CPUtime=169.11 cores=0,2,4,6
/proc/7538/task/7626/stat : 7626 (pb_cplex) R 7537 7537 7175 0 -1 4202560 198625 0 0 0 16844 67 0 0 20 0 8 0 390887590 384913408 68124 33554432000 134512640 146736320 4289992320 4133396392 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=7538/tid=7627] ppid=7537 vsize=375892 CPUtime=183.19 cores=0,2,4,6
/proc/7538/task/7627/stat : 7627 (pb_cplex) R 7537 7537 7175 0 -1 4202560 196959 0 0 0 18254 65 0 0 20 0 8 0 390887590 384913408 68124 33554432000 134512640 146736320 4289992320 4143882448 136008256 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7628] ppid=7537 vsize=375892 CPUtime=171.81 cores=0,2,4,6
/proc/7538/task/7628/stat : 7628 (pb_cplex) R 7537 7537 7175 0 -1 4202560 196687 0 0 0 17115 66 0 0 20 0 8 0 390887590 384913408 68124 33554432000 134512640 146736320 4289992320 4054044880 136008069 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7629] ppid=7537 vsize=375892 CPUtime=178.24 cores=0,2,4,6
/proc/7538/task/7629/stat : 7629 (pb_cplex) R 7537 7537 7175 0 -1 4202560 189974 0 0 0 17766 58 0 0 20 0 8 0 390887590 384913408 68124 33554432000 134512640 146736320 4289992320 4037468232 139042888 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7630] ppid=7537 vsize=375892 CPUtime=182.92 cores=0,2,4,6
/proc/7538/task/7630/stat : 7630 (pb_cplex) S 7537 7537 7175 0 -1 4202560 203919 0 0 0 18232 60 0 0 20 0 8 0 390887590 384913408 68124 33554432000 134512640 146736320 4289992320 4026986128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7631] ppid=7537 vsize=375892 CPUtime=167.79 cores=0,2,4,6
/proc/7538/task/7631/stat : 7631 (pb_cplex) R 7537 7537 7175 0 -1 4202560 243107 0 0 0 16703 76 0 0 20 0 8 0 390887590 384913408 68124 33554432000 134512640 146736320 4289992320 3956269264 136008065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1796.81
Current children cumulated vsize (KiB) 385040



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+523.2 s]
/proc/loadavg: 13.08 11.90 8.23 15/194 7635
/proc/meminfo: memFree=31372332/32873648 swapFree=7376/7376
[pid=7537] ppid=7535 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7537/stat : 7537 (run) S 7535 7537 7175 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390874338 9367552 269 33554432000 4194304 5064252 140735324126000 140735324124912 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7537/statm: 2287 269 229 213 0 72 0
[pid=7538] ppid=7537 vsize=385164 CPUtime=1800.42 cores=0,2,4,6
/proc/7538/stat : 7538 (pb_cplex) R 7537 7537 7175 0 -1 4202496 1938045 0 0 0 179423 619 0 0 20 0 8 0 390874338 394407936 69664 33554432000 134512640 146736320 4289992320 4289984128 135468528 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/7538/statm: 96291 69664 979 2985 0 93225 0
[pid=7538/tid=7625] ppid=7537 vsize=385164 CPUtime=173.02 cores=0,2,4,6
/proc/7538/task/7625/stat : 7625 (pb_cplex) R 7537 7537 7175 0 -1 4202560 181755 0 0 0 17243 59 0 0 20 0 8 0 390887590 394407936 69664 33554432000 134512640 146736320 4289992320 4122910928 136008065 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=7538/tid=7626] ppid=7537 vsize=385164 CPUtime=169.7 cores=0,2,4,6
/proc/7538/task/7626/stat : 7626 (pb_cplex) R 7537 7537 7175 0 -1 4202560 198631 0 0 0 16903 67 0 0 20 0 8 0 390887590 394407936 69664 33554432000 134512640 146736320 4289992320 4133396464 135982938 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7627] ppid=7537 vsize=385164 CPUtime=183.72 cores=0,2,4,6
/proc/7538/task/7627/stat : 7627 (pb_cplex) R 7537 7537 7175 0 -1 4202560 196962 0 0 0 18307 65 0 0 20 0 8 0 390887590 394407936 69664 33554432000 134512640 146736320 4289992320 4143882428 135526785 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7628] ppid=7537 vsize=385164 CPUtime=172.26 cores=0,2,4,6
/proc/7538/task/7628/stat : 7628 (pb_cplex) R 7537 7537 7175 0 -1 4202560 198217 0 0 0 17160 66 0 0 20 0 8 0 390887590 394407936 69664 33554432000 134512640 146736320 4289992320 4054044176 136403109 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=7538/tid=7629] ppid=7537 vsize=385164 CPUtime=178.81 cores=0,2,4,6
/proc/7538/task/7629/stat : 7629 (pb_cplex) S 7537 7537 7175 0 -1 4202560 191212 0 0 0 17822 59 0 0 20 0 8 0 390887590 394407936 69664 33554432000 134512640 146736320 4289992320 4037471888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7630] ppid=7537 vsize=385164 CPUtime=182.92 cores=0,2,4,6
/proc/7538/task/7630/stat : 7630 (pb_cplex) S 7537 7537 7175 0 -1 4202560 203919 0 0 0 18232 60 0 0 20 0 8 0 390887590 394407936 69664 33554432000 134512640 146736320 4289992320 4026986128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7538/tid=7631] ppid=7537 vsize=385164 CPUtime=168.24 cores=0,2,4,6
/proc/7538/task/7631/stat : 7631 (pb_cplex) R 7537 7537 7175 0 -1 4202560 243107 0 0 0 16748 76 0 0 20 0 8 0 390887590 394407936 69664 33554432000 134512640 146736320 4289992320 3956269648 136403112 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.42
Current children cumulated vsize (KiB) 394312

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7537 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.42
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 523.216
CPU time (s): 1800.42
CPU user time (s): 1794.23
CPU system time (s): 6.19
CPU usage (%): 344.106
Max. virtual memory (cumulated for all children) (KiB): 415032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 1076
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 354
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.66075 second user time and 3.22451 second system time

The end

Launcher Data 

Begin job on node149 at 2012-06-09 15:11:42
IDJOB=3733985
IDBENCH=2640
IDSOLVER=2325
FILE ID=node149/3733985-1339247502
RUNJOBID= node149-1339246813-7191
PBS_JOBID= 14644332
Free space on /tmp= 63432 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/golomb-rulers/normalized-OGR_13.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3733985-1339247502/watcher-3733985-1339247502 -o /tmp/evaluation-result-3733985-1339247502/solver-3733985-1339247502 -C 1800 -W 1900 -M 15500  run HOME/instance-3733985-1339247502.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 292e71503f1e4f136e087e61da3c7ed4
RANDOM SEED=836262693

node149.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31070748 kB
Buffers:          134832 kB
Cached:           114092 kB
SwapCached:         2056 kB
Active:           935860 kB
Inactive:          31504 kB
Active(anon):     714796 kB
Inactive(anon):     4100 kB
Active(file):     221064 kB
Inactive(file):    27404 kB
Unevictable:        7376 kB
Mlocked:            7376 kB
SwapTotal:      67108856 kB
SwapFree:       67100100 kB
Dirty:             17856 kB
Writeback:             0 kB
AnonPages:       1029056 kB
Mapped:            11360 kB
Shmem:                 0 kB
Slab:             695064 kB
SReclaimable:     139248 kB
SUnreclaim:       555816 kB
KernelStack:        1600 kB
PageTables:         5456 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    1008672 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    874496 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3733985-1339247502.opb

Free space on /tmp at the end= 63416 MiB
End job on node149 at 2012-06-09 15:20:26