Trace number 3731565

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.26 593.316

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
wnq/normalized-wnq_n100_mw99_7.opb.PB06.opb
MD5SUM3119db8d3d273f04fc4f3b1324a85224
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark396
Best CPU time to get the best result obtained on this benchmark1793.24
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 452
Optimality of the best value was proved NO
Number of variables10000
Total number of constraints656900
Number of constraints which are clauses656900
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint100
Number of terms in the objective function 10000
Biggest coefficient in the objective function 99
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 493167
Number of bits of the sum of numbers in the objective function 19
Biggest number in a constraint 99
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 493167
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3731565-1339246888.opb.
0.00/0.00	c Instance file HOME/instance-3731565-1339246888.opb
0.00/0.00	c File size is 17233680 bytes.
11.69/11.70	c Highest Coefficient sum: 101
11.69/11.70	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
11.99/12.05	c ============================[ Problem Statistics ]=============================
11.99/12.05	c |                                                                             |
11.99/12.05	c |  Parsing time:          11.97        s                                      |
11.99/12.05	c |  Number Variables:      10000                                               |
12.09/12.14	c |  Number Constraints:    656900                                              |
12.09/12.14	c ===============================================================================
1800.02/593.31	c Remaining time 1787.96 sec.
1800.02/593.31	c 
1800.02/593.31	c *** INTERRUPTED ***
1800.02/593.31	s UNKNOWN
1800.02/593.31	c Total CPU time              : 1781.03 s
1800.02/593.31	c Memory used           : 1062.02 MB
1800.02/593.31	c CPU time              : 1781.03 s
1800.02/593.31	c 
1800.02/593.31	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731565-1339246888/watcher-3731565-1339246888 -o /tmp/evaluation-result-3731565-1339246888/solver-3731565-1339246888 -C 1800 -W 1900 -M 15500 run HOME/instance-3731565-1339246888.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 0.49 0.16 3/174 3566
/proc/meminfo: memFree=29544344/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0

[startup+0.087421 s]
/proc/loadavg: 2.02 0.49 0.16 3/174 3566
/proc/meminfo: memFree=29544344/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100269 s]
/proc/loadavg: 2.02 0.49 0.16 3/174 3566
/proc/meminfo: memFree=29544344/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300239 s]
/proc/loadavg: 2.02 0.49 0.16 3/174 3566
/proc/meminfo: memFree=29544344/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70024 s]
/proc/loadavg: 2.02 0.49 0.16 3/174 3566
/proc/meminfo: memFree=29544344/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50029 s]
/proc/loadavg: 2.02 0.49 0.16 3/176 3568
/proc/meminfo: memFree=29542468/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=32000 CPUtime=1.49 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 975 0 0 0 149 0 0 0 20 0 1 0 390817348 32768000 931 33554432000 134512640 146736320 4291771600 4291729484 141028032 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/3567/statm: 8000 931 308 2985 0 726 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 41148

[startup+3.10028 s]
/proc/loadavg: 2.02 0.49 0.16 3/176 3568
/proc/meminfo: memFree=29541972/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=32132 CPUtime=3.09 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 1009 0 0 0 309 0 0 0 20 0 1 0 390817348 32903168 965 33554432000 134512640 146736320 4291771600 4291729616 140665547 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/3567/statm: 8033 965 308 2985 0 759 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 41280

[startup+6.30029 s]
/proc/loadavg: 2.01 0.51 0.17 3/180 3610
/proc/meminfo: memFree=29530656/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=32432 CPUtime=6.29 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 1062 0 0 0 629 0 0 0 20 0 1 0 390817348 33210368 1018 33554432000 134512640 146736320 4291771600 4291729456 141028063 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/3567/statm: 8108 1018 308 2985 0 834 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 41580

[startup+12.7003 s]
/proc/loadavg: 2.01 0.54 0.18 3/180 3610
/proc/meminfo: memFree=29330148/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=307764 CPUtime=12.69 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 66766 0 0 0 1258 11 0 0 20 0 1 0 390817348 315150336 70942 33554432000 134512640 146736320 4291771600 4291769640 138686211 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/3567/statm: 76941 70942 621 2985 0 73875 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 316912

[startup+25.5004 s]
/proc/loadavg: 3.41 0.91 0.31 15/194 3652
/proc/meminfo: memFree=28983248/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=397676 CPUtime=46.56 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) S 3566 3566 3259 0 -1 4202496 118558 0 0 0 4600 56 0 0 20 0 8 0 390817348 407220224 70258 33554432000 134512640 146736320 4291771600 4291767952 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/3567/statm: 99419 70258 955 2985 0 96353 0
[pid=3567/tid=3625] ppid=3566 vsize=397676 CPUtime=3.35 cores=0,2,4,6
/proc/3567/task/3625/stat : 3625 (pb_cplex) S 3566 3566 3259 0 -1 4202560 1319 0 0 0 335 0 0 0 20 0 8 0 390819059 407220224 70258 33554432000 134512640 146736320 4291771600 3988045456 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3626] ppid=3566 vsize=397676 CPUtime=4.38 cores=0,2,4,6
/proc/3567/task/3626/stat : 3626 (pb_cplex) R 3566 3566 3259 0 -1 4202560 1923 0 0 0 436 2 0 0 20 0 8 0 390819059 407220224 70258 33554432000 134512640 146736320 4291771600 4075445240 136475782 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3627] ppid=3566 vsize=397676 CPUtime=3.47 cores=0,2,4,6
/proc/3567/task/3627/stat : 3627 (pb_cplex) R 3566 3566 3259 0 -1 4202560 2289 0 0 0 346 1 0 0 20 0 8 0 390819059 407220224 70258 33554432000 134512640 146736320 4291771600 4093403304 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3628] ppid=3566 vsize=397676 CPUtime=3.5 cores=0,2,4,6
/proc/3567/task/3628/stat : 3628 (pb_cplex) S 3566 3566 3259 0 -1 4202560 1339 0 0 0 349 1 0 0 20 0 8 0 390819059 407220224 70258 33554432000 134512640 146736320 4291771600 4052012688 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3629] ppid=3566 vsize=397676 CPUtime=4.37 cores=0,2,4,6
/proc/3567/task/3629/stat : 3629 (pb_cplex) R 3566 3566 3259 0 -1 4202560 2289 0 0 0 434 3 0 0 20 0 8 0 390819059 407220224 70258 33554432000 134512640 146736320 4291771600 3973828520 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3630] ppid=3566 vsize=397676 CPUtime=3.26 cores=0,2,4,6
/proc/3567/task/3630/stat : 3630 (pb_cplex) S 3566 3566 3259 0 -1 4202560 2621 0 0 0 324 2 0 0 20 0 8 0 390819059 407220224 70258 33554432000 134512640 146736320 4291771600 3963002512 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3631] ppid=3566 vsize=397676 CPUtime=3.49 cores=0,2,4,6
/proc/3567/task/3631/stat : 3631 (pb_cplex) S 3566 3566 3259 0 -1 4202560 1117 0 0 0 348 1 0 0 20 0 8 0 390819059 407220224 70258 33554432000 134512640 146736320 4291771600 3952516752 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 46.56
Current children cumulated vsize (KiB) 406824

[startup+51.1004 s]
/proc/loadavg: 5.13 1.50 0.51 16/193 3708
/proc/meminfo: memFree=28483328/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=664688 CPUtime=116.35 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 251369 0 0 0 11493 142 0 0 20 0 8 0 390817348 680640512 133037 33554432000 134512640 146736320 4291771600 4291765224 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/3567/statm: 166172 133037 961 2985 0 163106 0
[pid=3567/tid=3674] ppid=3566 vsize=664688 CPUtime=7.1 cores=0,2,4,6
/proc/3567/task/3674/stat : 3674 (pb_cplex) R 3566 3566 3259 0 -1 4202560 9165 0 0 0 699 11 0 0 20 0 8 0 390820493 680640512 133037 33554432000 134512640 146736320 4291771600 3845128008 135525911 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3675] ppid=3566 vsize=664688 CPUtime=8.78 cores=0,2,4,6
/proc/3567/task/3675/stat : 3675 (pb_cplex) R 3566 3566 3259 0 -1 4202560 9953 0 0 0 873 5 0 0 20 0 8 0 390820493 680640512 133037 33554432000 134512640 146736320 4291771600 3855614020 136385183 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3676] ppid=3566 vsize=664688 CPUtime=9.47 cores=0,2,4,6
/proc/3567/task/3676/stat : 3676 (pb_cplex) R 3566 3566 3259 0 -1 4202560 8346 0 0 0 943 4 0 0 20 0 8 0 390820493 680640512 133037 33554432000 134512640 146736320 4291771600 3866100712 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3677] ppid=3566 vsize=664688 CPUtime=8.62 cores=0,2,4,6
/proc/3567/task/3677/stat : 3677 (pb_cplex) R 3566 3566 3259 0 -1 4202560 8136 0 0 0 857 5 0 0 20 0 8 0 390820493 680640512 133037 33554432000 134512640 146736320 4291771600 4052009960 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3678] ppid=3566 vsize=664688 CPUtime=6.75 cores=0,2,4,6
/proc/3567/task/3678/stat : 3678 (pb_cplex) S 3566 3566 3259 0 -1 4202560 13558 0 0 0 669 6 0 0 20 0 8 0 390820493 680640512 133037 33554432000 134512640 146736320 4291771600 3668237968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3679] ppid=3566 vsize=664688 CPUtime=6.09 cores=0,2,4,6
/proc/3567/task/3679/stat : 3679 (pb_cplex) R 3566 3566 3259 0 -1 4202560 10315 0 0 0 606 3 0 0 20 0 8 0 390820493 680640512 133037 33554432000 134512640 146736320 4291771600 3657747600 136008065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3680] ppid=3566 vsize=664688 CPUtime=7.65 cores=0,2,4,6
/proc/3567/task/3680/stat : 3680 (pb_cplex) R 3566 3566 3259 0 -1 4202560 8951 0 0 0 760 5 0 0 20 0 8 0 390820493 680640512 133037 33554432000 134512640 146736320 4291771600 3647262720 136018924 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 116.35
Current children cumulated vsize (KiB) 673836

[startup+102.306 s]
/proc/loadavg: 8.08 2.91 1.05 15/193 3708
/proc/meminfo: memFree=28338540/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=746828 CPUtime=269.6 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 499941 0 0 0 26659 301 0 0 20 0 8 0 390817348 764751872 153188 33554432000 134512640 146736320 4291771600 4291761296 136008069 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/3567/statm: 186707 153188 963 2985 0 183641 0
[pid=3567/tid=3674] ppid=3566 vsize=746828 CPUtime=25.54 cores=0,2,4,6
/proc/3567/task/3674/stat : 3674 (pb_cplex) R 3566 3566 3259 0 -1 4202560 37718 0 0 0 2525 29 0 0 20 0 8 0 390820493 764751872 153188 33554432000 134512640 146736320 4291771600 3845126592 144785853 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3675] ppid=3566 vsize=746828 CPUtime=27.1 cores=0,2,4,6
/proc/3567/task/3675/stat : 3675 (pb_cplex) R 3566 3566 3259 0 -1 4202560 43336 0 0 0 2684 26 0 0 20 0 8 0 390820493 764751872 153188 33554432000 134512640 146736320 4291771600 3855610632 135525908 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3676] ppid=3566 vsize=746828 CPUtime=28.42 cores=0,2,4,6
/proc/3567/task/3676/stat : 3676 (pb_cplex) R 3566 3566 3259 0 -1 4202560 33803 0 0 0 2820 22 0 0 20 0 8 0 390820493 764751872 153188 33554432000 134512640 146736320 4291771600 3866096904 137707893 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3677] ppid=3566 vsize=746828 CPUtime=26.6 cores=0,2,4,6
/proc/3567/task/3677/stat : 3677 (pb_cplex) R 3566 3566 3259 0 -1 4202560 39081 0 0 0 2632 28 0 0 20 0 8 0 390820493 764751872 153188 33554432000 134512640 146736320 4291771600 4052005960 136000406 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3678] ppid=3566 vsize=746828 CPUtime=26.84 cores=0,2,4,6
/proc/3567/task/3678/stat : 3678 (pb_cplex) R 3566 3566 3259 0 -1 4202560 42044 0 0 0 2659 25 0 0 20 0 8 0 390820493 764751872 153188 33554432000 134512640 146736320 4291771600 3668232988 136406094 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3679] ppid=3566 vsize=746828 CPUtime=25.81 cores=0,2,4,6
/proc/3567/task/3679/stat : 3679 (pb_cplex) R 3566 3566 3259 0 -1 4202560 53619 0 0 0 2554 27 0 0 20 0 8 0 390820493 764751872 153188 33554432000 134512640 146736320 4291771600 3657747228 136406005 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3680] ppid=3566 vsize=746828 CPUtime=27.28 cores=0,2,4,6
/proc/3567/task/3680/stat : 3680 (pb_cplex) R 3566 3566 3259 0 -1 4202560 51118 0 0 0 2703 25 0 0 20 0 8 0 390820493 764751872 153188 33554432000 134512640 146736320 4291771600 3647259624 139044529 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 269.6
Current children cumulated vsize (KiB) 755976

############
# WARNING:
# current cumulated CPU time (375.58 s) is less than in the last sample (375.82 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (0.240021 s) to the 'lost time'.

[startup+133.6 s]
/proc/loadavg: 10.48 4.00 1.47 8/193 3708
/proc/meminfo: memFree=28256156/32873844 swapFree=7384/7384

################
# More data... #
################

[pid=3567/tid=3734] ppid=3566 vsize=874780 CPUtime=106.18 cores=0,2,4,6
/proc/3567/task/3734/stat : 3734 (pb_cplex) R 3566 3566 3259 0 -1 4202560 222271 0 0 0 10491 127 0 0 20 0 8 0 390831129 895774720 192991 33554432000 134512640 146736320 4291771600 3766871016 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3735] ppid=3566 vsize=874780 CPUtime=102.75 cores=0,2,4,6
/proc/3567/task/3735/stat : 3735 (pb_cplex) R 3566 3566 3259 0 -1 4202560 140008 0 0 0 10167 108 0 0 20 0 8 0 390831129 895774720 192991 33554432000 134512640 146736320 4291771600 3756384896 138711582 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3736] ppid=3566 vsize=874780 CPUtime=101.6 cores=0,2,4,6
/proc/3567/task/3736/stat : 3736 (pb_cplex) R 3566 3566 3259 0 -1 4202560 164657 0 0 0 10047 113 0 0 20 0 8 0 390831129 895774720 192991 33554432000 134512640 146736320 4291771600 3745898716 136389131 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1219.87
Current children cumulated vsize (KiB) 883928

[startup+462.3 s]
/proc/loadavg: 11.32 8.61 4.24 17/193 3765
/proc/meminfo: memFree=27811304/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=946168 CPUtime=1410.24 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 2259562 0 0 0 139493 1531 0 0 20 0 8 0 390817348 968876032 211004 33554432000 134512640 146736320 4291771600 4291765224 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/3567/statm: 236542 211004 1001 2985 0 233476 0
[pid=3567/tid=3730] ppid=3566 vsize=946168 CPUtime=125.77 cores=0,2,4,6
/proc/3567/task/3730/stat : 3730 (pb_cplex) R 3566 3566 3259 0 -1 4202560 254207 0 0 0 12430 147 0 0 20 0 8 0 390831129 968876032 211004 33554432000 134512640 146736320 4291771600 3912229824 137341980 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3731] ppid=3566 vsize=946168 CPUtime=127.29 cores=0,2,4,6
/proc/3567/task/3731/stat : 3731 (pb_cplex) R 3566 3566 3259 0 -1 4202560 169083 0 0 0 12598 131 0 0 20 0 8 0 390831129 968876032 211004 33554432000 134512640 146736320 4291771600 3951882832 136403109 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3732] ppid=3566 vsize=946168 CPUtime=129.3 cores=0,2,4,6
/proc/3567/task/3732/stat : 3732 (pb_cplex) R 3566 3566 3259 0 -1 4202560 175865 0 0 0 12794 136 0 0 20 0 8 0 390831129 968876032 211004 33554432000 134512640 146736320 4291771600 3962367120 136008089 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3733] ppid=3566 vsize=946168 CPUtime=126.35 cores=0,2,4,6
/proc/3567/task/3733/stat : 3733 (pb_cplex) R 3566 3566 3259 0 -1 4202560 148299 0 0 0 12508 127 0 0 20 0 8 0 390831129 968876032 211004 33554432000 134512640 146736320 4291771600 4052009920 137341651 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3734] ppid=3566 vsize=946168 CPUtime=129.68 cores=0,2,4,6
/proc/3567/task/3734/stat : 3734 (pb_cplex) R 3566 3566 3259 0 -1 4202560 222933 0 0 0 12822 146 0 0 20 0 8 0 390831129 968876032 211004 33554432000 134512640 146736320 4291771600 3766871016 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3735] ppid=3566 vsize=946168 CPUtime=127.23 cores=0,2,4,6
/proc/3567/task/3735/stat : 3735 (pb_cplex) R 3566 3566 3259 0 -1 4202560 170020 0 0 0 12586 137 0 0 20 0 8 0 390831129 968876032 211004 33554432000 134512640 146736320 4291771600 3756384296 139044580 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3736] ppid=3566 vsize=946168 CPUtime=125.67 cores=0,2,4,6
/proc/3567/task/3736/stat : 3736 (pb_cplex) R 3566 3566 3259 0 -1 4202560 202535 0 0 0 12420 147 0 0 20 0 8 0 390831129 968876032 211004 33554432000 134512640 146736320 4291771600 3745898564 136385175 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1410.24
Current children cumulated vsize (KiB) 955316

[startup+522.3 s]
/proc/loadavg: 11.40 9.10 4.68 9/194 3768
/proc/meminfo: memFree=27675752/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=1012260 CPUtime=1591.94 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) S 3566 3566 3259 0 -1 4202496 2392940 0 0 0 157488 1706 0 0 20 0 8 0 390817348 1036554240 227482 33554432000 134512640 146736320 4291771600 4291767952 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/3567/statm: 253065 227482 1001 2985 0 249999 0
[pid=3567/tid=3730] ppid=3566 vsize=1012260 CPUtime=146.01 cores=0,2,4,6
/proc/3567/task/3730/stat : 3730 (pb_cplex) S 3566 3566 3259 0 -1 4202560 272026 0 0 0 14433 168 0 0 20 0 8 0 390831129 1036554240 227482 33554432000 134512640 146736320 4291771600 3912232592 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3731] ppid=3566 vsize=1012260 CPUtime=150.37 cores=0,2,4,6
/proc/3567/task/3731/stat : 3731 (pb_cplex) S 3566 3566 3259 0 -1 4202560 172278 0 0 0 14886 151 0 0 20 0 8 0 390831129 1036554240 227482 33554432000 134512640 146736320 4291771600 3951885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3732] ppid=3566 vsize=1012260 CPUtime=151.56 cores=0,2,4,6
/proc/3567/task/3732/stat : 3732 (pb_cplex) R 3566 3566 3259 0 -1 4202560 177991 0 0 0 15002 154 0 0 20 0 8 0 390831129 1036554240 227482 33554432000 134512640 146736320 4291771600 3962370488 136852335 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3733] ppid=3566 vsize=1012260 CPUtime=149.93 cores=0,2,4,6
/proc/3567/task/3733/stat : 3733 (pb_cplex) R 3566 3566 3259 0 -1 4202560 176776 0 0 0 14838 155 0 0 20 0 8 0 390831129 1036554240 227482 33554432000 134512640 146736320 4291771600 4052009168 136008039 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3734] ppid=3566 vsize=1012260 CPUtime=151.13 cores=0,2,4,6
/proc/3567/task/3734/stat : 3734 (pb_cplex) S 3566 3566 3259 0 -1 4202560 228338 0 0 0 14947 166 0 0 20 0 8 0 390831129 1036554240 227482 33554432000 134512640 146736320 4291771600 3766873744 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3735] ppid=3566 vsize=1012260 CPUtime=151.04 cores=0,2,4,6
/proc/3567/task/3735/stat : 3735 (pb_cplex) S 3566 3566 3259 0 -1 4202560 198585 0 0 0 14940 164 0 0 20 0 8 0 390831129 1036554240 227482 33554432000 134512640 146736320 4291771600 3756387984 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3736] ppid=3566 vsize=1012260 CPUtime=148.21 cores=0,2,4,6
/proc/3567/task/3736/stat : 3736 (pb_cplex) S 3566 3566 3259 0 -1 4202560 204963 0 0 0 14655 166 0 0 20 0 8 0 390831129 1036554240 227482 33554432000 134512640 146736320 4291771600 3745902224 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1591.94
Current children cumulated vsize (KiB) 1021408

[startup+582.3 s]
/proc/loadavg: 10.01 9.15 4.98 8/186 3819
/proc/meminfo: memFree=28502524/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=1071736 CPUtime=1760.76 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) R 3566 3566 3259 0 -1 4202496 2469767 0 0 0 174216 1860 0 0 20 0 8 0 390817348 1097457664 242312 33554432000 134512640 146736320 4291771600 4291764316 135854544 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3567/statm: 267934 242312 1001 2985 0 264868 0
[pid=3567/tid=3730] ppid=3566 vsize=1071736 CPUtime=166.85 cores=0,2,4,6
/proc/3567/task/3730/stat : 3730 (pb_cplex) R 3566 3566 3259 0 -1 4202560 276888 0 0 0 16497 188 0 0 20 0 8 0 390831129 1097457664 242312 33554432000 134512640 146736320 4291771600 3912229880 136364014 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3731] ppid=3566 vsize=1071736 CPUtime=169.93 cores=0,2,4,6
/proc/3567/task/3731/stat : 3731 (pb_cplex) R 3566 3566 3259 0 -1 4202560 175681 0 0 0 16825 168 0 0 20 0 8 0 390831129 1097457664 242312 33554432000 134512640 146736320 4291771600 3951883608 137340955 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3732] ppid=3566 vsize=1071736 CPUtime=172.37 cores=0,2,4,6
/proc/3567/task/3732/stat : 3732 (pb_cplex) R 3566 3566 3259 0 -1 4202560 183466 0 0 0 17065 172 0 0 20 0 8 0 390831129 1097457664 242312 33554432000 134512640 146736320 4291771600 3962368456 136000767 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3733] ppid=3566 vsize=1071736 CPUtime=171.84 cores=0,2,4,6
/proc/3567/task/3733/stat : 3733 (pb_cplex) R 3566 3566 3259 0 -1 4202560 179755 0 0 0 17012 172 0 0 20 0 8 0 390831129 1097457664 242312 33554432000 134512640 146736320 4291771600 4052009960 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3734] ppid=3566 vsize=1071736 CPUtime=171.73 cores=0,2,4,6
/proc/3567/task/3734/stat : 3734 (pb_cplex) R 3566 3566 3259 0 -1 4202560 229745 0 0 0 16987 186 0 0 20 0 8 0 390831129 1097457664 242312 33554432000 134512640 146736320 4291771600 3766870108 135855170 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3735] ppid=3566 vsize=1071736 CPUtime=173.16 cores=0,2,4,6
/proc/3567/task/3735/stat : 3735 (pb_cplex) R 3566 3566 3259 0 -1 4202560 205717 0 0 0 17134 182 0 0 20 0 8 0 390831129 1097457664 242312 33554432000 134512640 146736320 4291771600 3756384476 136009327 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3736] ppid=3566 vsize=1071736 CPUtime=168.25 cores=0,2,4,6
/proc/3567/task/3736/stat : 3736 (pb_cplex) R 3566 3566 3259 0 -1 4202560 207258 0 0 0 16640 185 0 0 20 0 8 0 390831129 1097457664 242312 33554432000 134512640 146736320 4291771600 3745899496 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1760.76
Current children cumulated vsize (KiB) 1080884



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+593.3 s]
/proc/loadavg: 8.66 8.90 4.96 8/186 3819
/proc/meminfo: memFree=28485808/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=1087504 CPUtime=1800.02 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) S 3566 3566 3259 0 -1 4202496 2482615 0 0 0 178101 1901 0 0 20 0 8 0 390817348 1113604096 246254 33554432000 134512640 146736320 4291771600 4291767952 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/3567/statm: 271876 246254 1001 2985 0 268810 0
[pid=3567/tid=3730] ppid=3566 vsize=1087504 CPUtime=171.67 cores=0,2,4,6
/proc/3567/task/3730/stat : 3730 (pb_cplex) R 3566 3566 3259 0 -1 4202560 276888 0 0 0 16974 193 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3912230064 137343450 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3731] ppid=3566 vsize=1087504 CPUtime=174.78 cores=0,2,4,6
/proc/3567/task/3731/stat : 3731 (pb_cplex) S 3566 3566 3259 0 -1 4202560 176915 0 0 0 17305 173 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3951885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3732] ppid=3566 vsize=1087504 CPUtime=177.16 cores=0,2,4,6
/proc/3567/task/3732/stat : 3732 (pb_cplex) R 3566 3566 3259 0 -1 4202560 183858 0 0 0 17540 176 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3962368092 135855117 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3733] ppid=3566 vsize=1087504 CPUtime=176.63 cores=0,2,4,6
/proc/3567/task/3733/stat : 3733 (pb_cplex) R 3566 3566 3259 0 -1 4202560 179917 0 0 0 17487 176 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 4052009960 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3734] ppid=3566 vsize=1087504 CPUtime=176.56 cores=0,2,4,6
/proc/3567/task/3734/stat : 3734 (pb_cplex) R 3566 3566 3259 0 -1 4202560 229745 0 0 0 17466 190 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3766871016 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3735] ppid=3566 vsize=1087504 CPUtime=178.05 cores=0,2,4,6
/proc/3567/task/3735/stat : 3735 (pb_cplex) R 3566 3566 3259 0 -1 4202560 205769 0 0 0 17616 189 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3756385256 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3736] ppid=3566 vsize=1087504 CPUtime=173.15 cores=0,2,4,6
/proc/3567/task/3736/stat : 3736 (pb_cplex) R 3566 3566 3259 0 -1 4202560 207287 0 0 0 17125 190 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3745898552 136475808 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1096652

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+593.3 s]
/proc/loadavg: 8.66 8.90 4.96 8/186 3819
/proc/meminfo: memFree=28485808/32873844 swapFree=7384/7384
[pid=3566] ppid=3564 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/3566/stat : 3566 (run) S 3564 3566 3259 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390817348 9367552 269 33554432000 4194304 5064252 140736031314608 140736031313520 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/3566/statm: 2287 269 229 213 0 72 0
[pid=3567] ppid=3566 vsize=1087504 CPUtime=1800.02 cores=0,2,4,6
/proc/3567/stat : 3567 (pb_cplex) S 3566 3566 3259 0 -1 4202496 2482615 0 0 0 178101 1901 0 0 20 0 8 0 390817348 1113604096 246254 33554432000 134512640 146736320 4291771600 4291767952 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/3567/statm: 271876 246254 1001 2985 0 268810 0
[pid=3567/tid=3730] ppid=3566 vsize=1087504 CPUtime=171.67 cores=0,2,4,6
/proc/3567/task/3730/stat : 3730 (pb_cplex) R 3566 3566 3259 0 -1 4202560 276888 0 0 0 16974 193 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3912230064 137343450 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3731] ppid=3566 vsize=1087504 CPUtime=174.78 cores=0,2,4,6
/proc/3567/task/3731/stat : 3731 (pb_cplex) S 3566 3566 3259 0 -1 4202560 176915 0 0 0 17305 173 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3951885968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3732] ppid=3566 vsize=1087504 CPUtime=177.16 cores=0,2,4,6
/proc/3567/task/3732/stat : 3732 (pb_cplex) R 3566 3566 3259 0 -1 4202560 183858 0 0 0 17540 176 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3962368092 135855117 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=3567/tid=3733] ppid=3566 vsize=1087504 CPUtime=176.63 cores=0,2,4,6
/proc/3567/task/3733/stat : 3733 (pb_cplex) R 3566 3566 3259 0 -1 4202560 179917 0 0 0 17487 176 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 4052009960 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=3567/tid=3734] ppid=3566 vsize=1087504 CPUtime=176.56 cores=0,2,4,6
/proc/3567/task/3734/stat : 3734 (pb_cplex) R 3566 3566 3259 0 -1 4202560 229745 0 0 0 17466 190 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3766871016 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=3567/tid=3735] ppid=3566 vsize=1087504 CPUtime=178.05 cores=0,2,4,6
/proc/3567/task/3735/stat : 3735 (pb_cplex) R 3566 3566 3259 0 -1 4202560 205769 0 0 0 17616 189 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3756385256 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=3567/tid=3736] ppid=3566 vsize=1087504 CPUtime=173.15 cores=0,2,4,6
/proc/3567/task/3736/stat : 3736 (pb_cplex) R 3566 3566 3259 0 -1 4202560 207287 0 0 0 17125 190 0 0 20 0 8 0 390831129 1113604096 246254 33554432000 134512640 146736320 4291771600 3745898552 136475808 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1096652

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3566 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 0.240021
#  lost CPU user time (s): 0.290009
#  lost CPU system time (s): -0.05

Real time (s): 593.316
CPU time (s): 1800.26
CPU user time (s): 1781.3
CPU system time (s): 18.96
CPU usage (%): 303.423
Max. virtual memory (cumulated for all children) (KiB): 1096652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1076
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 354
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.44078 second user time and 3.81442 second system time

The end

Launcher Data 

Begin job on node106 at 2012-06-09 15:01:28
IDJOB=3731565
IDBENCH=1965
IDSOLVER=2325
FILE ID=node106/3731565-1339246888
RUNJOBID= node106-1339246834-3276
PBS_JOBID= 14644375
Free space on /tmp= 71000 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/wnq/normalized-wnq_n100_mw99_7.opb.PB06.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731565-1339246888/watcher-3731565-1339246888 -o /tmp/evaluation-result-3731565-1339246888/solver-3731565-1339246888 -C 1800 -W 1900 -M 15500  run HOME/instance-3731565-1339246888.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3119db8d3d273f04fc4f3b1324a85224
RANDOM SEED=2027219552

node106.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29545260 kB
Buffers:          476164 kB
Cached:          1898496 kB
SwapCached:         2376 kB
Active:           639308 kB
Inactive:        1742956 kB
Active(anon):       2720 kB
Inactive(anon):     5560 kB
Active(file):     636588 kB
Inactive(file):  1737396 kB
Unevictable:        7384 kB
Mlocked:            7384 kB
SwapTotal:      67108856 kB
SwapFree:       67100756 kB
Dirty:             33280 kB
Writeback:             4 kB
AnonPages:         12848 kB
Mapped:             9248 kB
Shmem:                 0 kB
Slab:             805688 kB
SReclaimable:     247408 kB
SUnreclaim:       558280 kB
KernelStack:        1472 kB
PageTables:         4068 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     105048 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731565-1339246888.opb

Free space on /tmp at the end= 70992 MiB
End job on node106 at 2012-06-09 15:11:24