Trace number 3731609

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.09 596.323

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
wnq/normalized-wnq_n100_mw99_0.opb.PB06.opb
MD5SUM325852af8542a0f454599a2893f1b120
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark765
Best CPU time to get the best result obtained on this benchmark1800.19
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 434
Optimality of the best value was proved NO
Number of variables10000
Total number of constraints656900
Number of constraints which are clauses656900
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint100
Number of terms in the objective function 10000
Biggest coefficient in the objective function 99
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 495293
Number of bits of the sum of numbers in the objective function 19
Biggest number in a constraint 99
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 495293
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3731609-1339246893.opb.
0.00/0.00	c Instance file HOME/instance-3731609-1339246893.opb
0.00/0.00	c File size is 17233653 bytes.
11.49/11.55	c Highest Coefficient sum: 101
11.49/11.55	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
11.88/11.90	c ============================[ Problem Statistics ]=============================
11.88/11.90	c |                                                                             |
11.88/11.90	c |  Parsing time:          11.80        s                                      |
11.88/11.90	c |  Number Variables:      10000                                               |
11.88/11.99	c |  Number Constraints:    656900                                              |
11.88/11.99	c ===============================================================================
1800.09/596.31	c Remaining time 1788.12 sec.
1800.09/596.31	c 
1800.09/596.31	c *** INTERRUPTED ***
1800.09/596.31	s UNKNOWN
1800.09/596.31	c Total CPU time              : 1781.19 s
1800.09/596.31	c Memory used           : 1137.81 MB
1800.09/596.31	c CPU time              : 1781.19 s
1800.09/596.31	c 
1800.09/596.31	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731609-1339246893/watcher-3731609-1339246893 -o /tmp/evaluation-result-3731609-1339246893/solver-3731609-1339246893 -C 1800 -W 1900 -M 15500 run HOME/instance-3731609-1339246893.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.34 0.58 0.19 8/184 26283
/proc/meminfo: memFree=29637124/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0

[startup+0.0215359 s]
/proc/loadavg: 2.34 0.58 0.19 8/184 26283
/proc/meminfo: memFree=29637124/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100276 s]
/proc/loadavg: 2.34 0.58 0.19 8/184 26283
/proc/meminfo: memFree=29637124/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300237 s]
/proc/loadavg: 2.34 0.58 0.19 8/184 26283
/proc/meminfo: memFree=29637124/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700238 s]
/proc/loadavg: 2.34 0.58 0.19 8/184 26283
/proc/meminfo: memFree=29637124/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50028 s]
/proc/loadavg: 2.34 0.58 0.19 10/186 26285
/proc/meminfo: memFree=29633668/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=32000 CPUtime=1.49 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 976 0 0 0 149 0 0 0 20 0 1 0 390814246 32768000 931 33554432000 134512640 146736320 4289189296 4289147120 140528792 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/26284/statm: 8000 931 308 2985 0 726 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 41148

[startup+3.10028 s]
/proc/loadavg: 2.34 0.58 0.19 10/186 26285
/proc/meminfo: memFree=29633668/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=32132 CPUtime=3.09 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 1010 0 0 0 309 0 0 0 20 0 1 0 390814246 32903168 965 33554432000 134512640 146736320 4289189296 4289147276 140683248 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/26284/statm: 8033 965 308 2985 0 759 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 41280

[startup+6.30028 s]
/proc/loadavg: 2.87 0.72 0.24 3/186 26285
/proc/meminfo: memFree=29631444/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=32432 CPUtime=6.29 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 1063 0 0 0 629 0 0 0 20 0 1 0 390814246 33210368 1018 33554432000 134512640 146736320 4289189296 4289147176 134814118 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/26284/statm: 8108 1018 308 2985 0 834 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 41580

[startup+12.7003 s]
/proc/loadavg: 3.37 0.86 0.29 10/186 26285
/proc/meminfo: memFree=29348464/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=315636 CPUtime=12.69 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 66280 0 0 0 1256 13 0 0 20 0 1 0 390814246 323211264 73008 33554432000 134512640 146736320 4289189296 4289186560 136237228 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/26284/statm: 78909 73008 627 2985 0 75843 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 324784

[startup+25.5065 s]
/proc/loadavg: 4.90 1.32 0.45 9/186 26320
/proc/meminfo: memFree=29356604/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=335436 CPUtime=43.19 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 115703 0 0 0 4254 65 0 0 20 0 1 0 390814246 343486464 65853 33554432000 134512640 146736320 4289189296 4289185920 138711351 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/26284/statm: 83859 65853 977 2985 0 80793 0
Current children cumulated CPU time (s) 43.19
Current children cumulated vsize (KiB) 344584

[startup+51.1004 s]
/proc/loadavg: 6.75 2.03 0.70 17/194 26350
/proc/meminfo: memFree=29121048/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=604592 CPUtime=115.94 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 193050 0 0 0 11452 142 0 0 20 0 8 0 390814246 619102208 122440 33554432000 134512640 146736320 4289189296 4289181568 135237332 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/26284/statm: 151148 122440 977 2985 0 148082 0
[pid=26284/tid=26343] ppid=26283 vsize=604592 CPUtime=7.98 cores=0,2,4,6
/proc/26284/task/26343/stat : 26343 (pb_cplex) S 26283 26283 26012 0 -1 4202560 5699 0 0 0 792 6 0 0 20 0 8 0 390817277 619102208 122440 33554432000 134512640 146736320 4289189296 3877916304 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26344] ppid=26283 vsize=604592 CPUtime=8.35 cores=0,2,4,6
/proc/26284/task/26344/stat : 26344 (pb_cplex) R 26283 26283 26012 0 -1 4202560 2134 0 0 0 829 6 0 0 20 0 8 0 390817277 619102208 122440 33554432000 134512640 146736320 4289189296 3888398404 136385172 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26345] ppid=26283 vsize=604592 CPUtime=8.8 cores=0,2,4,6
/proc/26284/task/26345/stat : 26345 (pb_cplex) R 26283 26283 26012 0 -1 4202560 3174 0 0 0 874 6 0 0 20 0 8 0 390817277 619102208 122440 33554432000 134512640 146736320 4289189296 3898884688 136403117 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26346] ppid=26283 vsize=604592 CPUtime=8.66 cores=0,2,4,6
/proc/26284/task/26346/stat : 26346 (pb_cplex) R 26283 26283 26012 0 -1 4202560 2004 0 0 0 860 6 0 0 20 0 8 0 390817277 619102208 122440 33554432000 134512640 146736320 4289189296 4051794340 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26347] ppid=26283 vsize=604592 CPUtime=8.24 cores=0,2,4,6
/proc/26284/task/26347/stat : 26347 (pb_cplex) R 26283 26283 26012 0 -1 4202560 3090 0 0 0 817 7 0 0 20 0 8 0 390817277 619102208 122440 33554432000 134512640 146736320 4289189296 3742118888 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26348] ppid=26283 vsize=604592 CPUtime=7.11 cores=0,2,4,6
/proc/26284/task/26348/stat : 26348 (pb_cplex) R 26283 26283 26012 0 -1 4202560 7483 0 0 0 705 6 0 0 20 0 8 0 390817277 619102208 122440 33554432000 134512640 146736320 4289189296 3731633128 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=26284/tid=26349] ppid=26283 vsize=604592 CPUtime=9.2 cores=0,2,4,6
/proc/26284/task/26349/stat : 26349 (pb_cplex) R 26283 26283 26012 0 -1 4202560 3557 0 0 0 913 7 0 0 20 0 8 0 390817277 619102208 122440 33554432000 134512640 146736320 4289189296 3721146180 135850160 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 115.94
Current children cumulated vsize (KiB) 613740

[startup+102.3 s]
/proc/loadavg: 10.74 3.80 1.37 11/193 26350
/proc/meminfo: memFree=29008212/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=698768 CPUtime=284.95 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 539025 0 0 0 28169 326 0 0 20 0 8 0 390814246 715538432 144863 33554432000 134512640 146736320 4289189296 4289180824 138686287 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/26284/statm: 174692 144863 986 2985 0 171626 0
[pid=26284/tid=26343] ppid=26283 vsize=698768 CPUtime=27.49 cores=0,2,4,6
/proc/26284/task/26343/stat : 26343 (pb_cplex) S 26283 26283 26012 0 -1 4202560 59697 0 0 0 2716 33 0 0 20 0 8 0 390817277 715538432 144863 33554432000 134512640 146736320 4289189296 3877916304 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26344] ppid=26283 vsize=698768 CPUtime=30.15 cores=0,2,4,6
/proc/26284/task/26344/stat : 26344 (pb_cplex) R 26283 26283 26012 0 -1 4202560 46248 0 0 0 2987 28 0 0 20 0 8 0 390817277 715538432 144863 33554432000 134512640 146736320 4289189296 3888393672 139043558 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26345] ppid=26283 vsize=698768 CPUtime=28.98 cores=0,2,4,6
/proc/26284/task/26345/stat : 26345 (pb_cplex) S 26283 26283 26012 0 -1 4202560 47232 0 0 0 2868 30 0 0 20 0 8 0 390817277 715538432 144863 33554432000 134512640 146736320 4289189296 3898887824 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26346] ppid=26283 vsize=698768 CPUtime=31.44 cores=0,2,4,6
/proc/26284/task/26346/stat : 26346 (pb_cplex) R 26283 26283 26012 0 -1 4202560 37757 0 0 0 3118 26 0 0 20 0 8 0 390817277 715538432 144864 33554432000 134512640 146736320 4289189296 4051787008 136366836 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26347] ppid=26283 vsize=698768 CPUtime=30.49 cores=0,2,4,6
/proc/26284/task/26347/stat : 26347 (pb_cplex) S 26283 26283 26012 0 -1 4202560 29554 0 0 0 3021 28 0 0 20 0 8 0 390817277 715538432 144864 33554432000 134512640 146736320 4289189296 3742121616 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26348] ppid=26283 vsize=698768 CPUtime=28.5 cores=0,2,4,6
/proc/26284/task/26348/stat : 26348 (pb_cplex) R 26283 26283 26012 0 -1 4202560 65438 0 0 0 2819 31 0 0 20 0 8 0 390817277 715538432 144864 33554432000 134512640 146736320 4289189296 3731627588 135844448 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26349] ppid=26283 vsize=698768 CPUtime=29.28 cores=0,2,4,6
/proc/26284/task/26349/stat : 26349 (pb_cplex) S 26283 26283 26012 0 -1 4202560 50706 0 0 0 2896 32 0 0 20 0 8 0 390817277 715538432 144864 33554432000 134512640 146736320 4289189296 3721150096 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 284.95
Current children cumulated vsize (KiB) 707916

[startup+162.3 s]
/proc/loadavg: 10.46 4.96 1.92 15/193 26378
/proc/meminfo: memFree=29081756/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=639408 CPUtime=473.84 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 702864 0 0 0 46873 511 0 0 20 0 8 0 390814246 654753792 127793 33554432000 134512640 146736320 4289189296 4289182160 136008363 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/26284/statm: 159852 127793 993 2985 0 156786 0
[pid=26284/tid=26372] ppid=26283 vsize=639408 CPUtime=22.47 cores=0,2,4,6
/proc/26284/task/26372/stat : 26372 (pb_cplex) S 26283 26283 26012 0 -1 4202560 23246 0 0 0 2229 18 0 0 20 0 8 0 390825293 654753792 127793 33554432000 134512640 146736320 4289189296 3965161104 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26373] ppid=26283 vsize=639408 CPUtime=20.52 cores=0,2,4,6
/proc/26284/task/26373/stat : 26373 (pb_cplex) S 26283 26283 26012 0 -1 4202560 26269 0 0 0 2034 18 0 0 20 0 8 0 390825293 654753792 127793 33554432000 134512640 146736320 4289189296 3975646864 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26374] ppid=26283 vsize=639408 CPUtime=22.28 cores=0,2,4,6
/proc/26284/task/26374/stat : 26374 (pb_cplex) R 26283 26283 26012 0 -1 4202560 11766 0 0 0 2214 14 0 0 20 0 8 0 390825293 654753792 127793 33554432000 134512640 146736320 4289189296 4075230208 137064079 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=26284/tid=26375] ppid=26283 vsize=639408 CPUtime=21.94 cores=0,2,4,6
/proc/26284/task/26375/stat : 26375 (pb_cplex) R 26283 26283 26012 0 -1 4202560 26578 0 0 0 2173 21 0 0 20 0 8 0 390825293 654753792 127793 33554432000 134512640 146736320 4289189296 4051790840 136475862 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26376] ppid=26283 vsize=639408 CPUtime=22.02 cores=0,2,4,6
/proc/26284/task/26376/stat : 26376 (pb_cplex) R 26283 26283 26012 0 -1 4202560 21523 0 0 0 2185 17 0 0 20 0 8 0 390825293 654753792 127793 33554432000 134512640 146736320 4289189296 3769847432 135982689 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26377] ppid=26283 vsize=639408 CPUtime=21.53 cores=0,2,4,6
/proc/26284/task/26377/stat : 26377 (pb_cplex) S 26283 26283 26012 0 -1 4202560 14264 0 0 0 2135 18 0 0 20 0 8 0 390825293 654753792 127793 33554432000 134512640 146736320 4289189296 3759365776 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26378] ppid=26283 vsize=639408 CPUtime=21.24 cores=0,2,4,6
/proc/26284/task/26378/stat : 26378 (pb_cplex) R 26283 26283 26012 0 -1 4202560 12632 0 0 0 2108 16 0 0 20 0 8 0 390825293 654753792 127793 33554432000 134512640 146736320 4289189296 3748877288 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 473.84

################
# More data... #
################

/proc/26284/statm: 233667 205319 995 2985 0 230601 0
[pid=26284/tid=26372] ppid=26283 vsize=934668 CPUtime=114.84 cores=0,2,4,6
/proc/26284/task/26372/stat : 26372 (pb_cplex) S 26283 26283 26012 0 -1 4202560 122210 0 0 0 11369 115 0 0 20 0 8 0 390825293 957100032 205319 33554432000 134512640 146736320 4289189296 3965161104 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26373] ppid=26283 vsize=934668 CPUtime=111.55 cores=0,2,4,6
/proc/26284/task/26373/stat : 26373 (pb_cplex) S 26283 26283 26012 0 -1 4202560 146839 0 0 0 11030 125 0 0 20 0 8 0 390825293 957100032 205319 33554432000 134512640 146736320 4289189296 3975646864 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26374] ppid=26283 vsize=934668 CPUtime=113.94 cores=0,2,4,6
/proc/26284/task/26374/stat : 26374 (pb_cplex) S 26283 26283 26012 0 -1 4202560 116200 0 0 0 11286 108 0 0 20 0 8 0 390825293 957100032 205319 33554432000 134512640 146736320 4289189296 4075232912 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26375] ppid=26283 vsize=934668 CPUtime=113.58 cores=0,2,4,6
/proc/26284/task/26375/stat : 26375 (pb_cplex) S 26283 26283 26012 0 -1 4202560 103175 0 0 0 11249 109 0 0 20 0 8 0 390825293 957100032 205319 33554432000 134512640 146736320 4289189296 4051795600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26376] ppid=26283 vsize=934668 CPUtime=113.05 cores=0,2,4,6
/proc/26284/task/26376/stat : 26376 (pb_cplex) S 26283 26283 26012 0 -1 4202560 160568 0 0 0 11182 123 0 0 20 0 8 0 390825293 957100032 205319 33554432000 134512640 146736320 4289189296 3769851536 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=26284/tid=26377] ppid=26283 vsize=934668 CPUtime=111.44 cores=0,2,4,6
/proc/26284/task/26377/stat : 26377 (pb_cplex) S 26283 26283 26012 0 -1 4202560 90992 0 0 0 11037 107 0 0 20 0 8 0 390825293 957100032 205319 33554432000 134512640 146736320 4289189296 3759365776 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26378] ppid=26283 vsize=934668 CPUtime=112.62 cores=0,2,4,6
/proc/26284/task/26378/stat : 26378 (pb_cplex) R 26283 26283 26012 0 -1 4202560 61209 0 0 0 11156 106 0 0 20 0 8 0 390825293 957100032 205319 33554432000 134512640 146736320 4289189296 3748876508 136009717 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1210.79
Current children cumulated vsize (KiB) 943816

[startup+462.3 s]
/proc/loadavg: 9.96 8.91 4.55 14/193 26379
/proc/meminfo: memFree=28687116/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=1001916 CPUtime=1386.49 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 1706579 0 0 0 137189 1460 0 0 20 0 8 0 390814246 1025961984 222148 33554432000 134512640 146736320 4289189296 4289182952 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/26284/statm: 250479 222148 995 2985 0 247413 0
[pid=26284/tid=26372] ppid=26283 vsize=1001916 CPUtime=137.39 cores=0,2,4,6
/proc/26284/task/26372/stat : 26372 (pb_cplex) R 26283 26283 26012 0 -1 4202560 126877 0 0 0 13603 136 0 0 20 0 8 0 390825293 1025961984 222148 33554432000 134512640 146736320 4289189296 3965158576 137343450 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26373] ppid=26283 vsize=1001916 CPUtime=133.63 cores=0,2,4,6
/proc/26284/task/26373/stat : 26373 (pb_cplex) R 26283 26283 26012 0 -1 4202560 155660 0 0 0 13216 147 0 0 20 0 8 0 390825293 1025961984 222148 33554432000 134512640 146736320 4289189296 3975643176 139044580 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=26284/tid=26374] ppid=26283 vsize=1001916 CPUtime=135.36 cores=0,2,4,6
/proc/26284/task/26374/stat : 26374 (pb_cplex) R 26283 26283 26012 0 -1 4202560 122591 0 0 0 13406 130 0 0 20 0 8 0 390825293 1025961984 222148 33554432000 134512640 146736320 4289189296 4075230976 137334153 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26375] ppid=26283 vsize=1001916 CPUtime=134.4 cores=0,2,4,6
/proc/26284/task/26375/stat : 26375 (pb_cplex) R 26283 26283 26012 0 -1 4202560 112685 0 0 0 13310 130 0 0 20 0 8 0 390825293 1025961984 222148 33554432000 134512640 146736320 4289189296 4051792080 136403109 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26376] ppid=26283 vsize=1001916 CPUtime=134.94 cores=0,2,4,6
/proc/26284/task/26376/stat : 26376 (pb_cplex) R 26283 26283 26012 0 -1 4202560 168307 0 0 0 13349 145 0 0 20 0 8 0 390825293 1025961984 222148 33554432000 134512640 146736320 4289189296 3769848448 139046508 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26377] ppid=26283 vsize=1001916 CPUtime=133.28 cores=0,2,4,6
/proc/26284/task/26377/stat : 26377 (pb_cplex) R 26283 26283 26012 0 -1 4202560 98816 0 0 0 13198 130 0 0 20 0 8 0 390825293 1025961984 222148 33554432000 134512640 146736320 4289189296 3759362116 136385174 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26378] ppid=26283 vsize=1001916 CPUtime=134.32 cores=0,2,4,6
/proc/26284/task/26378/stat : 26378 (pb_cplex) R 26283 26283 26012 0 -1 4202560 69693 0 0 0 13305 127 0 0 20 0 8 0 390825293 1025961984 222148 33554432000 134512640 146736320 4289189296 3748877288 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1386.49
Current children cumulated vsize (KiB) 1011064

[startup+522.3 s]
/proc/loadavg: 9.40 9.08 4.89 9/187 26432
/proc/meminfo: memFree=28669056/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=1074300 CPUtime=1568.24 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) R 26283 26283 26012 0 -1 4202496 1809858 0 0 0 155178 1646 0 0 20 0 8 0 390814246 1100083200 240033 33554432000 134512640 146736320 4289189296 4289182952 144757825 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/26284/statm: 268575 240033 995 2985 0 265509 0
[pid=26284/tid=26372] ppid=26283 vsize=1074300 CPUtime=158.29 cores=0,2,4,6
/proc/26284/task/26372/stat : 26372 (pb_cplex) R 26283 26283 26012 0 -1 4202560 131477 0 0 0 15673 156 0 0 20 0 8 0 390825293 1100083200 240033 33554432000 134512640 146736320 4289189296 3965157424 136384852 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=26284/tid=26373] ppid=26283 vsize=1074300 CPUtime=155.93 cores=0,2,4,6
/proc/26284/task/26373/stat : 26373 (pb_cplex) R 26283 26283 26012 0 -1 4202560 169554 0 0 0 15421 172 0 0 20 0 8 0 390825293 1100083200 240033 33554432000 134512640 146736320 4289189296 3975643356 136389133 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26374] ppid=26283 vsize=1074300 CPUtime=158.73 cores=0,2,4,6
/proc/26284/task/26374/stat : 26374 (pb_cplex) R 26283 26283 26012 0 -1 4202560 129432 0 0 0 15722 151 0 0 20 0 8 0 390825293 1100083200 240033 33554432000 134512640 146736320 4289189296 4075229392 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26375] ppid=26283 vsize=1074300 CPUtime=157.18 cores=0,2,4,6
/proc/26284/task/26375/stat : 26375 (pb_cplex) R 26283 26283 26012 0 -1 4202560 121552 0 0 0 15566 152 0 0 20 0 8 0 390825293 1100083200 240033 33554432000 134512640 146736320 4289189296 4051792080 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26376] ppid=26283 vsize=1074300 CPUtime=158.18 cores=0,2,4,6
/proc/26284/task/26376/stat : 26376 (pb_cplex) R 26283 26283 26012 0 -1 4202560 179005 0 0 0 15647 171 0 0 20 0 8 0 390825293 1100083200 240033 33554432000 134512640 146736320 4289189296 3769847900 135855174 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=26284/tid=26377] ppid=26283 vsize=1074300 CPUtime=156.03 cores=0,2,4,6
/proc/26284/task/26377/stat : 26377 (pb_cplex) R 26283 26283 26012 0 -1 4202560 107131 0 0 0 15449 154 0 0 20 0 8 0 390825293 1100083200 240033 33554432000 134512640 146736320 4289189296 3759363608 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26378] ppid=26283 vsize=1074300 CPUtime=156.28 cores=0,2,4,6
/proc/26284/task/26378/stat : 26378 (pb_cplex) R 26283 26283 26012 0 -1 4202560 79665 0 0 0 15480 148 0 0 20 0 8 0 390825293 1100083200 240033 33554432000 134512640 146736320 4289189296 3748877304 136364241 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1568.24
Current children cumulated vsize (KiB) 1083448

[startup+582.3 s]
/proc/loadavg: 7.61 8.67 5.02 6/186 26433
/proc/meminfo: memFree=28536292/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=1146808 CPUtime=1757.11 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) S 26283 26283 26012 0 -1 4202496 1908395 0 0 0 173865 1846 0 0 20 0 8 0 390814246 1174331392 258236 33554432000 134512640 146736320 4289189296 4289185680 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/26284/statm: 286702 258236 995 2985 0 283636 0
[pid=26284/tid=26372] ppid=26283 vsize=1146808 CPUtime=181.18 cores=0,2,4,6
/proc/26284/task/26372/stat : 26372 (pb_cplex) S 26283 26283 26012 0 -1 4202560 136569 0 0 0 17942 176 0 0 20 0 8 0 390825293 1174331392 258236 33554432000 134512640 146736320 4289189296 3965161104 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=26284/tid=26373] ppid=26283 vsize=1146808 CPUtime=179.81 cores=0,2,4,6
/proc/26284/task/26373/stat : 26373 (pb_cplex) S 26283 26283 26012 0 -1 4202560 176391 0 0 0 17787 194 0 0 20 0 8 0 390825293 1174331392 258236 33554432000 134512640 146736320 4289189296 3975646864 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26374] ppid=26283 vsize=1146808 CPUtime=181.93 cores=0,2,4,6
/proc/26284/task/26374/stat : 26374 (pb_cplex) S 26283 26283 26012 0 -1 4202560 132462 0 0 0 18017 176 0 0 20 0 8 0 390825293 1174331392 258236 33554432000 134512640 146736320 4289189296 4075232912 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26375] ppid=26283 vsize=1146808 CPUtime=180.96 cores=0,2,4,6
/proc/26284/task/26375/stat : 26375 (pb_cplex) R 26283 26283 26012 0 -1 4202560 135064 0 0 0 17919 177 0 0 20 0 8 0 390825293 1174331392 258236 33554432000 134512640 146736320 4289189296 4051793240 137339832 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26376] ppid=26283 vsize=1146808 CPUtime=181.18 cores=0,2,4,6
/proc/26284/task/26376/stat : 26376 (pb_cplex) R 26283 26283 26012 0 -1 4202560 189018 0 0 0 17922 196 0 0 20 0 8 0 390825293 1174331392 258236 33554432000 134512640 146736320 4289189296 3769849728 137083803 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26377] ppid=26283 vsize=1146808 CPUtime=179.66 cores=0,2,4,6
/proc/26284/task/26377/stat : 26377 (pb_cplex) S 26283 26283 26012 0 -1 4202560 110628 0 0 0 17785 181 0 0 20 0 8 0 390825293 1174331392 258236 33554432000 134512640 146736320 4289189296 3759365776 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26378] ppid=26283 vsize=1146808 CPUtime=179.43 cores=0,2,4,6
/proc/26284/task/26378/stat : 26378 (pb_cplex) S 26283 26283 26012 0 -1 4202560 84657 0 0 0 17768 175 0 0 20 0 8 0 390825293 1174331392 258236 33554432000 134512640 146736320 4289189296 3748880016 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1757.11
Current children cumulated vsize (KiB) 1155956



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+596.3 s]
/proc/loadavg: 6.99 8.49 5.01 4/186 26433
/proc/meminfo: memFree=28518312/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=1165116 CPUtime=1800.09 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) S 26283 26283 26012 0 -1 4202496 1929421 0 0 0 178118 1891 0 0 20 0 8 0 390814246 1193078784 262751 33554432000 134512640 146736320 4289189296 4289185680 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/26284/statm: 291279 262751 995 2985 0 288213 0
[pid=26284/tid=26372] ppid=26283 vsize=1165116 CPUtime=186.12 cores=0,2,4,6
/proc/26284/task/26372/stat : 26372 (pb_cplex) S 26283 26283 26012 0 -1 4202560 137486 0 0 0 18431 181 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3965161104 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26373] ppid=26283 vsize=1165116 CPUtime=185.24 cores=0,2,4,6
/proc/26284/task/26373/stat : 26373 (pb_cplex) R 26283 26283 26012 0 -1 4202560 177199 0 0 0 18325 199 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3975641536 144785853 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26374] ppid=26283 vsize=1165116 CPUtime=186.84 cores=0,2,4,6
/proc/26284/task/26374/stat : 26374 (pb_cplex) S 26283 26283 26012 0 -1 4202560 133480 0 0 0 18504 180 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 4075232912 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26375] ppid=26283 vsize=1165116 CPUtime=185.89 cores=0,2,4,6
/proc/26284/task/26375/stat : 26375 (pb_cplex) S 26283 26283 26012 0 -1 4202560 136313 0 0 0 18406 183 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 4051795600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26376] ppid=26283 vsize=1165116 CPUtime=186.16 cores=0,2,4,6
/proc/26284/task/26376/stat : 26376 (pb_cplex) S 26283 26283 26012 0 -1 4202560 189241 0 0 0 18414 202 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3769851536 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26377] ppid=26283 vsize=1165116 CPUtime=185.84 cores=0,2,4,6
/proc/26284/task/26377/stat : 26377 (pb_cplex) S 26283 26283 26012 0 -1 4202560 111504 0 0 0 18398 186 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3759365776 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26378] ppid=26283 vsize=1165116 CPUtime=185.61 cores=0,2,4,6
/proc/26284/task/26378/stat : 26378 (pb_cplex) S 26283 26283 26012 0 -1 4202560 86365 0 0 0 18379 182 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3748880016 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 1174264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+596.3 s]
/proc/loadavg: 6.99 8.49 5.01 4/186 26433
/proc/meminfo: memFree=28518312/32873844 swapFree=7632/7632
[pid=26283] ppid=26281 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26283/stat : 26283 (run) S 26281 26283 26012 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390814246 9367552 270 33554432000 4194304 5064252 140733437834720 140733437833632 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26283/statm: 2287 270 229 213 0 72 0
[pid=26284] ppid=26283 vsize=1165116 CPUtime=1800.09 cores=0,2,4,6
/proc/26284/stat : 26284 (pb_cplex) S 26283 26283 26012 0 -1 4202496 1929421 0 0 0 178118 1891 0 0 20 0 8 0 390814246 1193078784 262751 33554432000 134512640 146736320 4289189296 4289185680 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/26284/statm: 291279 262751 995 2985 0 288213 0
[pid=26284/tid=26372] ppid=26283 vsize=1165116 CPUtime=186.12 cores=0,2,4,6
/proc/26284/task/26372/stat : 26372 (pb_cplex) S 26283 26283 26012 0 -1 4202560 137486 0 0 0 18431 181 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3965161104 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26373] ppid=26283 vsize=1165116 CPUtime=185.24 cores=0,2,4,6
/proc/26284/task/26373/stat : 26373 (pb_cplex) R 26283 26283 26012 0 -1 4202560 177199 0 0 0 18325 199 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3975641536 144785853 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26374] ppid=26283 vsize=1165116 CPUtime=186.84 cores=0,2,4,6
/proc/26284/task/26374/stat : 26374 (pb_cplex) S 26283 26283 26012 0 -1 4202560 133480 0 0 0 18504 180 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 4075232912 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=26284/tid=26375] ppid=26283 vsize=1165116 CPUtime=185.89 cores=0,2,4,6
/proc/26284/task/26375/stat : 26375 (pb_cplex) S 26283 26283 26012 0 -1 4202560 136313 0 0 0 18406 183 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 4051795600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=26284/tid=26376] ppid=26283 vsize=1165116 CPUtime=186.16 cores=0,2,4,6
/proc/26284/task/26376/stat : 26376 (pb_cplex) S 26283 26283 26012 0 -1 4202560 189241 0 0 0 18414 202 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3769851536 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26377] ppid=26283 vsize=1165116 CPUtime=185.84 cores=0,2,4,6
/proc/26284/task/26377/stat : 26377 (pb_cplex) S 26283 26283 26012 0 -1 4202560 111504 0 0 0 18398 186 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3759365776 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=26284/tid=26378] ppid=26283 vsize=1165116 CPUtime=185.61 cores=0,2,4,6
/proc/26284/task/26378/stat : 26378 (pb_cplex) S 26283 26283 26012 0 -1 4202560 86365 0 0 0 18379 182 0 0 20 0 8 0 390825293 1193078784 262751 33554432000 134512640 146736320 4289189296 3748880016 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 1174264

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26283 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 596.323
CPU time (s): 1800.09
CPU user time (s): 1781.18
CPU system time (s): 18.91
CPU usage (%): 301.865
Max. virtual memory (cumulated for all children) (KiB): 1174600

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 356
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.40079 second user time and 4.07538 second system time

The end

Launcher Data 

Begin job on node144 at 2012-06-09 15:01:34
IDJOB=3731609
IDBENCH=1969
IDSOLVER=2325
FILE ID=node144/3731609-1339246893
RUNJOBID= node144-1339246834-26029
PBS_JOBID= 14644337
Free space on /tmp= 68388 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/wnq/normalized-wnq_n100_mw99_0.opb.PB06.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731609-1339246893/watcher-3731609-1339246893 -o /tmp/evaluation-result-3731609-1339246893/solver-3731609-1339246893 -C 1800 -W 1900 -M 15500  run HOME/instance-3731609-1339246893.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 325852af8542a0f454599a2893f1b120
RANDOM SEED=2008729106

node144.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.39
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29638040 kB
Buffers:         1131228 kB
Cached:          1089580 kB
SwapCached:          460 kB
Active:          2187916 kB
Inactive:         117568 kB
Active(anon):      69044 kB
Inactive(anon):    11384 kB
Active(file):    2118872 kB
Inactive(file):   106184 kB
Unevictable:        7632 kB
Mlocked:            7632 kB
SwapTotal:      67108856 kB
SwapFree:       67108396 kB
Dirty:             49740 kB
Writeback:             4 kB
AnonPages:         84864 kB
Mapped:            14280 kB
Shmem:               172 kB
Slab:             791052 kB
SReclaimable:     232584 kB
SUnreclaim:       558468 kB
KernelStack:        1504 kB
PageTables:         4164 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     249180 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     12288 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731609-1339246893.opb

Free space on /tmp at the end= 68368 MiB
End job on node144 at 2012-06-09 15:11:30