Trace number 3739734

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.34 668.316

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j12039_7-sat.opb
MD5SUM0f318fc75cd8d877b44870fe2fa76e77
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables25410
Total number of constraints83992
Number of constraints which are clauses83576
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints416
Minimum length of a constraint1
Maximum length of a constraint120
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 49
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 732
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3739734-1339249169.opb.
0.00/0.00	c Instance file HOME/instance-3739734-1339249169.opb
0.00/0.00	c File size is 2777152 bytes.
0.00/0.90	c Highest Coefficient sum: 732
0.00/0.90	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.95	c ============================[ Problem Statistics ]=============================
0.00/0.95	c |                                                                             |
0.00/0.95	c |  Parsing time:          0.94         s                                      |
0.00/0.95	c |  Number Variables:      25410                                               |
0.00/0.97	c |  Number Constraints:    83992                                               |
0.00/0.97	c ===============================================================================

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3739734-1339249169/watcher-3739734-1339249169 -o /tmp/evaluation-result-3739734-1339249169/solver-3739734-1339249169 -C 1800 -W 1900 -M 15500 run HOME/instance-3739734-1339249169.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 13.12 10.70 7.88 10/184 11823
/proc/meminfo: memFree=29395216/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0

[startup+0.0364291 s]
/proc/loadavg: 13.12 10.70 7.88 10/184 11823
/proc/meminfo: memFree=29395216/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100268 s]
/proc/loadavg: 13.12 10.70 7.88 10/184 11823
/proc/meminfo: memFree=29395216/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300254 s]
/proc/loadavg: 13.12 10.70 7.88 10/184 11823
/proc/meminfo: memFree=29395216/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70022 s]
/proc/loadavg: 13.12 10.70 7.88 10/184 11823
/proc/meminfo: memFree=29395216/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50028 s]
/proc/loadavg: 12.79 10.68 7.89 10/186 11825
/proc/meminfo: memFree=29347468/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=81708 CPUtime=1.49 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 26111 0 0 0 145 4 0 0 20 0 1 0 391044144 83668992 13940 33554432000 134512640 146736320 4293733472 4293728272 136008167 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 20427 13940 724 2985 0 17361 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 90856

[startup+3.10028 s]
/proc/loadavg: 12.79 10.68 7.89 9/186 11825
/proc/meminfo: memFree=29338540/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=82728 CPUtime=3.09 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 26431 0 0 0 305 4 0 0 20 0 1 0 391044144 84713472 14260 33554432000 134512640 146736320 4293733472 4293727956 136017845 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 20682 14260 724 2985 0 17616 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 91876

[startup+6.30029 s]
/proc/loadavg: 12.79 10.68 7.89 8/186 11825
/proc/meminfo: memFree=29339904/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=82884 CPUtime=6.29 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 26543 0 0 0 625 4 0 0 20 0 1 0 391044144 84873216 14372 33554432000 134512640 146736320 4293733472 4293728656 136403109 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 20721 14372 724 2985 0 17655 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 92032

[startup+12.7003 s]
/proc/loadavg: 11.80 10.54 7.87 5/186 11825
/proc/meminfo: memFree=29340044/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=82952 CPUtime=12.68 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 26579 0 0 0 1264 4 0 0 20 0 1 0 391044144 84942848 14408 33554432000 134512640 146736320 4293733472 4293728156 135855165 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 20738 14408 724 2985 0 17672 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 92100

[startup+25.5003 s]
/proc/loadavg: 10.30 10.26 7.81 10/186 11825
/proc/meminfo: memFree=29338816/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=83616 CPUtime=25.48 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 37690 0 0 0 2542 6 0 0 20 0 1 0 391044144 85622784 14956 33554432000 134512640 146736320 4293733472 4293727552 136382629 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 20904 14956 838 2985 0 17838 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 92764

[startup+51.1003 s]
/proc/loadavg: 9.85 10.15 7.84 10/187 11828
/proc/meminfo: memFree=29337656/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=83944 CPUtime=51.08 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 40229 0 0 0 5101 7 0 0 20 0 1 0 391044144 85958656 15164 33554432000 134512640 146736320 4293733472 4293728080 136403116 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 20986 15164 840 2985 0 17920 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 93092

[startup+102.306 s]
/proc/loadavg: 8.32 9.64 7.79 10/186 11828
/proc/meminfo: memFree=29319616/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=85272 CPUtime=102.28 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 51214 0 0 0 10219 9 0 0 20 0 1 0 391044144 87318528 15573 33554432000 134512640 146736320 4293733472 4293727696 136403109 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 21318 15573 843 2985 0 18252 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 94420

[startup+162.3 s]
/proc/loadavg: 5.13 8.55 7.54 3/179 11879
/proc/meminfo: memFree=29250280/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=85272 CPUtime=162.25 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 51457 0 0 0 16216 9 0 0 20 0 1 0 391044144 87318528 15823 33554432000 134512640 146736320 4293733472 4293726196 135451425 0 0 4096 16387 0 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 21318 15823 843 2985 0 18252 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 94420

[startup+222.3 s]
/proc/loadavg: 3.15 7.35 7.19 3/185 11886
/proc/meminfo: memFree=29195936/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=222812 CPUtime=222.24 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 83589 0 0 0 22211 13 0 0 20 0 8 0 391044144 228159488 26358 33554432000 134512640 146736320 4293733472 4293726736 136403116 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 55703 26358 880 2985 0 52637 0
[pid=11824/tid=11880] ppid=11823 vsize=222812 CPUtime=0 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) S 11823 11823 10692 0 -1 4202560 5 0 0 0 0 0 0 0 20 0 8 0 391065924 228159488 26358 33554432000 134512640 146736320 4293733472 4115275408 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=222812 CPUtime=0 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) S 11823 11823 10692 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391065924 228159488 26358 33554432000 134512640 146736320 4293733472 4104789648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=222812 CPUtime=0 cores=0,2,4,6
/proc/11824/task/11882/stat : 11882 (pb_cplex) S 11823 11823 10692 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391065924 228159488 26358 33554432000 134512640 146736320 4293733472 4094303888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11883] ppid=11823 vsize=222812 CPUtime=0 cores=0,2,4,6
/proc/11824/task/11883/stat : 11883 (pb_cplex) S 11823 11823 10692 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 8 0 391065924 228159488 26358 33554432000 134512640 146736320 4293733472 4083818128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11884] ppid=11823 vsize=222812 CPUtime=0 cores=0,2,4,6
/proc/11824/task/11884/stat : 11884 (pb_cplex) S 11823 11823 10692 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391065924 228159488 26358 33554432000 134512640 146736320 4293733472 4073332368 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11885] ppid=11823 vsize=222812 CPUtime=0 cores=0,2,4,6
/proc/11824/task/11885/stat : 11885 (pb_cplex) S 11823 11823 10692 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391065924 228159488 26358 33554432000 134512640 146736320 4293733472 4062846608 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11886] ppid=11823 vsize=222812 CPUtime=0 cores=0,2,4,6
/proc/11824/task/11886/stat : 11886 (pb_cplex) S 11823 11823 10692 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391065924 228159488 26358 33554432000 134512640 146736320 4293733472 4052360848 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 231960

[startup+282.3 s]
/proc/loadavg: 4.81 6.94 7.05 10/185 11886
/proc/meminfo: memFree=29102988/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=306364 CPUtime=353.13 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 139661 0 0 0 35283 30 0 0 20 0 8 0 391044144 313716736 43418 33554432000 134512640 146736320 4293733472 4293726216 139042890 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11824/statm: 76591 43418 880 2985 0 73525 0
[pid=11824/tid=11880] ppid=11823 vsize=306364 CPUtime=11.52 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) R 11823 11823 10692 0 -1 4202560 9854 0 0 0 1150 2 0 0 20 0 8 0 391065924 313716736 43418 33554432000 134512640 146736320 4293733472 4115272272 136403117 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=306364 CPUtime=11.51 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) R 11823 11823 10692 0 -1 4202560 3090 0 0 0 1149 2 0 0 20 0 8 0 391065924 313716736 43418 33554432000 134512640 146736320 4293733472 4104785992 139042876 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=306364 CPUtime=11.44 cores=0,2,4,6

################
# More data... #
################

/proc/11824/statm: 81909 51544 881 2985 0 78843 0
[pid=11824/tid=11880] ppid=11823 vsize=327636 CPUtime=81.64 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) R 11823 11823 10692 0 -1 4202560 31747 0 0 0 8154 10 0 0 20 0 8 0 391065924 335499264 51544 33554432000 134512640 146736320 4293733472 4115272680 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=327636 CPUtime=92.55 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) R 11823 11823 10692 0 -1 4202560 23599 0 0 0 9247 8 0 0 20 0 8 0 391065924 335499264 51544 33554432000 134512640 146736320 4293733472 4104786128 136008441 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=327636 CPUtime=98.09 cores=0,2,4,6
/proc/11824/task/11882/stat : 11882 (pb_cplex) R 11823 11823 10692 0 -1 4202560 46646 0 0 0 9794 15 0 0 20 0 8 0 391065924 335499264 51544 33554432000 134512640 146736320 4293733472 4094300252 135855165 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11883] ppid=11823 vsize=327636 CPUtime=97.11 cores=0,2,4,6
/proc/11824/task/11883/stat : 11883 (pb_cplex) R 11823 11823 10692 0 -1 4202560 36549 0 0 0 9700 11 0 0 20 0 8 0 391065924 335499264 51544 33554432000 134512640 146736320 4293733472 4083814608 136008017 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11884] ppid=11823 vsize=327636 CPUtime=111.19 cores=0,2,4,6
/proc/11824/task/11884/stat : 11884 (pb_cplex) R 11823 11823 10692 0 -1 4202560 6319 0 0 0 11116 3 0 0 20 0 8 0 391065924 335499264 51544 33554432000 134512640 146736320 4293733472 4073327704 136007616 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11885] ppid=11823 vsize=327636 CPUtime=98.5 cores=0,2,4,6
/proc/11824/task/11885/stat : 11885 (pb_cplex) R 11823 11823 10692 0 -1 4202560 23283 0 0 0 9842 8 0 0 20 0 8 0 391065924 335499264 51544 33554432000 134512640 146736320 4293733472 4062843088 136008056 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11886] ppid=11823 vsize=327636 CPUtime=103.01 cores=0,2,4,6
/proc/11824/task/11886/stat : 11886 (pb_cplex) R 11823 11823 10692 0 -1 4202560 32269 0 0 0 10290 11 0 0 20 0 8 0 391065924 335499264 51544 33554432000 134512640 146736320 4293733472 4052356860 139023058 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1035.48
Current children cumulated vsize (KiB) 336784

[startup+522.3 s]
/proc/loadavg: 8.79 7.82 7.36 10/186 11888
/proc/meminfo: memFree=29049696/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=328724 CPUtime=1274.61 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 399287 0 0 0 127351 110 0 0 20 0 8 0 391044144 336613376 53614 33554432000 134512640 146736320 4293733472 4293726600 136000350 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11824/statm: 82181 53614 884 2985 0 79115 0
[pid=11824/tid=11880] ppid=11823 vsize=328724 CPUtime=111.57 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) R 11823 11823 10692 0 -1 4202560 32504 0 0 0 11146 11 0 0 20 0 8 0 391065924 336613376 53614 33554432000 134512640 146736320 4293733472 4115271772 135855127 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=328724 CPUtime=122.56 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) R 11823 11823 10692 0 -1 4202560 25883 0 0 0 12247 9 0 0 20 0 8 0 391065924 336613376 53614 33554432000 134512640 146736320 4293733472 4104786128 136008165 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=328724 CPUtime=128.01 cores=0,2,4,6
/proc/11824/task/11882/stat : 11882 (pb_cplex) R 11823 11823 10692 0 -1 4202560 68243 0 0 0 12781 20 0 0 20 0 8 0 391065924 336613376 53614 33554432000 134512640 146736320 4293733472 4094300052 136017797 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11883] ppid=11823 vsize=328724 CPUtime=126.72 cores=0,2,4,6
/proc/11824/task/11883/stat : 11883 (pb_cplex) R 11823 11823 10692 0 -1 4202560 57803 0 0 0 12654 18 0 0 20 0 8 0 391065924 336613376 53614 33554432000 134512640 146736320 4293733472 4083814992 136403117 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11884] ppid=11823 vsize=328724 CPUtime=141.06 cores=0,2,4,6
/proc/11824/task/11884/stat : 11884 (pb_cplex) R 11823 11823 10692 0 -1 4202560 6390 0 0 0 14101 5 0 0 20 0 8 0 391065924 336613376 53614 33554432000 134512640 146736320 4293733472 4073328848 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11885] ppid=11823 vsize=328724 CPUtime=128.28 cores=0,2,4,6
/proc/11824/task/11885/stat : 11885 (pb_cplex) R 11823 11823 10692 0 -1 4202560 24397 0 0 0 12820 8 0 0 20 0 8 0 391065924 336613376 53614 33554432000 134512640 146736320 4293733472 4062842044 135526863 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11886] ppid=11823 vsize=328724 CPUtime=132.84 cores=0,2,4,6
/proc/11824/task/11886/stat : 11886 (pb_cplex) R 11823 11823 10692 0 -1 4202560 35074 0 0 0 13271 13 0 0 20 0 8 0 391065924 336613376 53614 33554432000 134512640 146736320 4293733472 4052357512 136388111 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1274.61
Current children cumulated vsize (KiB) 337872

[startup+582.3 s]
/proc/loadavg: 6.77 7.53 7.30 3/186 11888
/proc/meminfo: memFree=29047260/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=336612 CPUtime=1464.43 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) S 11823 11823 10692 0 -1 4202496 469358 0 0 0 146314 129 0 0 20 0 8 0 391044144 344690688 54416 33554432000 134512640 146736320 4293733472 4293729872 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11824/statm: 84153 54416 884 2985 0 81087 0
[pid=11824/tid=11880] ppid=11823 vsize=336612 CPUtime=128.79 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) S 11823 11823 10692 0 -1 4202560 32751 0 0 0 12868 11 0 0 20 0 8 0 391065924 344690688 54416 33554432000 134512640 146736320 4293733472 4115275408 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=336612 CPUtime=152.3 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) S 11823 11823 10692 0 -1 4202560 46220 0 0 0 15215 15 0 0 20 0 8 0 391065924 344690688 54416 33554432000 134512640 146736320 4293733472 4104789648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=336612 CPUtime=143.06 cores=0,2,4,6
/proc/11824/task/11882/stat : 11882 (pb_cplex) S 11823 11823 10692 0 -1 4202560 78697 0 0 0 14282 24 0 0 20 0 8 0 391065924 344690688 54416 33554432000 134512640 146736320 4293733472 4094303888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11883] ppid=11823 vsize=336612 CPUtime=154.79 cores=0,2,4,6
/proc/11824/task/11883/stat : 11883 (pb_cplex) S 11823 11823 10692 0 -1 4202560 77941 0 0 0 15456 23 0 0 20 0 8 0 391065924 344690688 54416 33554432000 134512640 146736320 4293733472 4083818128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11884] ppid=11823 vsize=336612 CPUtime=183.93 cores=0,2,4,6
/proc/11824/task/11884/stat : 11884 (pb_cplex) R 11823 11823 10692 0 -1 4202560 6396 0 0 0 18388 5 0 0 20 0 8 0 391065924 344690688 54416 33554432000 134512640 146736320 4293733472 4073328848 136008042 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11885] ppid=11823 vsize=336612 CPUtime=144.31 cores=0,2,4,6
/proc/11824/task/11885/stat : 11885 (pb_cplex) S 11823 11823 10692 0 -1 4202560 24468 0 0 0 14420 11 0 0 20 0 8 0 391065924 344690688 54416 33554432000 134512640 146736320 4293733472 4062846608 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11886] ppid=11823 vsize=336612 CPUtime=154.32 cores=0,2,4,6
/proc/11824/task/11886/stat : 11886 (pb_cplex) S 11823 11823 10692 0 -1 4202560 47820 0 0 0 15417 15 0 0 20 0 8 0 391065924 344690688 54416 33554432000 134512640 146736320 4293733472 4052360848 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1464.43
Current children cumulated vsize (KiB) 345760

[startup+642.3 s]
/proc/loadavg: 8.18 7.80 7.40 10/187 11891
/proc/meminfo: memFree=29049560/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=329144 CPUtime=1696.73 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 527067 0 0 0 169524 149 0 0 20 0 8 0 391044144 337043456 53825 33554432000 134512640 146736320 4293733472 4293726352 136008356 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11824/statm: 82286 53825 884 2985 0 79220 0
[pid=11824/tid=11880] ppid=11823 vsize=329144 CPUtime=157.53 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) R 11823 11823 10692 0 -1 4202560 33024 0 0 0 15740 13 0 0 20 0 8 0 391065924 337043456 53825 33554432000 134512640 146736320 4293733472 4115271880 136388565 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=329144 CPUtime=181.06 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) R 11823 11823 10692 0 -1 4202560 46567 0 0 0 18091 15 0 0 20 0 8 0 391065924 337043456 53825 33554432000 134512640 146736320 4293733472 4104785988 136385179 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=329144 CPUtime=170.94 cores=0,2,4,6
/proc/11824/task/11882/stat : 11882 (pb_cplex) R 11823 11823 10692 0 -1 4202560 98656 0 0 0 17064 30 0 0 20 0 8 0 391065924 337043456 53825 33554432000 134512640 146736320 4293733472 4094300752 136403114 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11883] ppid=11823 vsize=329144 CPUtime=183.49 cores=0,2,4,6
/proc/11824/task/11883/stat : 11883 (pb_cplex) R 11823 11823 10692 0 -1 4202560 98220 0 0 0 18320 29 0 0 20 0 8 0 391065924 337043456 53825 33554432000 134512640 146736320 4293733472 4083814992 136403116 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11884] ppid=11823 vsize=329144 CPUtime=214.74 cores=0,2,4,6
/proc/11824/task/11884/stat : 11884 (pb_cplex) R 11823 11823 10692 0 -1 4202560 6396 0 0 0 21467 7 0 0 20 0 8 0 391065924 337043456 53825 33554432000 134512640 146736320 4293733472 4073328732 135855170 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11885] ppid=11823 vsize=329144 CPUtime=172.39 cores=0,2,4,6
/proc/11824/task/11885/stat : 11885 (pb_cplex) R 11823 11823 10692 0 -1 4202560 24747 0 0 0 17227 12 0 0 20 0 8 0 391065924 337043456 53825 33554432000 134512640 146736320 4293733472 4062843504 136385269 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11886] ppid=11823 vsize=329144 CPUtime=184.37 cores=0,2,4,6
/proc/11824/task/11886/stat : 11886 (pb_cplex) R 11823 11823 10692 0 -1 4202560 63718 0 0 0 18418 19 0 0 20 0 8 0 391065924 337043456 53825 33554432000 134512640 146736320 4293733472 4052357336 136008617 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1696.73
Current children cumulated vsize (KiB) 338292



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+668.3 s]
/proc/loadavg: 8.46 7.89 7.44 10/187 11891
/proc/meminfo: memFree=29049824/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=329144 CPUtime=1800.34 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 546452 0 0 0 179880 154 0 0 20 0 8 0 391044144 337043456 53826 33554432000 134512640 146736320 4293733472 4293726784 139046546 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11824/statm: 82286 53826 884 2985 0 79220 0
[pid=11824/tid=11880] ppid=11823 vsize=329144 CPUtime=170.37 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) R 11823 11823 10692 0 -1 4202560 33728 0 0 0 17023 14 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4115271496 135525920 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=329144 CPUtime=193.9 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) R 11823 11823 10692 0 -1 4202560 46697 0 0 0 19374 16 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4104786560 139046530 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=329144 CPUtime=183.91 cores=0,2,4,6
/proc/11824/task/11882/stat : 11882 (pb_cplex) R 11823 11823 10692 0 -1 4202560 107718 0 0 0 18359 32 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4094300368 136008441 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11883] ppid=11823 vsize=329144 CPUtime=196.46 cores=0,2,4,6
/proc/11824/task/11883/stat : 11883 (pb_cplex) R 11823 11823 10692 0 -1 4202560 107060 0 0 0 19615 31 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4083814468 136385184 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11884] ppid=11823 vsize=329144 CPUtime=227.7 cores=0,2,4,6
/proc/11824/task/11884/stat : 11884 (pb_cplex) R 11823 11823 10692 0 -1 4202560 6396 0 0 0 22763 7 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4073328744 136384778 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11885] ppid=11823 vsize=329144 CPUtime=185.36 cores=0,2,4,6
/proc/11824/task/11885/stat : 11885 (pb_cplex) R 11823 11823 10692 0 -1 4202560 25006 0 0 0 18524 12 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4062842724 136389732 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11886] ppid=11823 vsize=329144 CPUtime=197.34 cores=0,2,4,6
/proc/11824/task/11886/stat : 11886 (pb_cplex) R 11823 11823 10692 0 -1 4202560 64108 0 0 0 19714 20 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4052357328 136008044 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.34
Current children cumulated vsize (KiB) 338292

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+668.3 s]
/proc/loadavg: 8.46 7.89 7.44 10/187 11891
/proc/meminfo: memFree=29049824/32873648 swapFree=7376/7376
[pid=11823] ppid=11821 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11823/stat : 11823 (run) S 11821 11823 10692 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 391044144 9367552 270 33554432000 4194304 5064252 140733376752112 140733376751024 213866145358 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/11823/statm: 2287 270 229 213 0 72 0
[pid=11824] ppid=11823 vsize=329144 CPUtime=1800.34 cores=0,2,4,6
/proc/11824/stat : 11824 (pb_cplex) R 11823 11823 10692 0 -1 4202496 546452 0 0 0 179880 154 0 0 20 0 8 0 391044144 337043456 53826 33554432000 134512640 146736320 4293733472 4293726784 139046546 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/11824/statm: 82286 53826 884 2985 0 79220 0
[pid=11824/tid=11880] ppid=11823 vsize=329144 CPUtime=170.37 cores=0,2,4,6
/proc/11824/task/11880/stat : 11880 (pb_cplex) R 11823 11823 10692 0 -1 4202560 33728 0 0 0 17023 14 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4115271496 135525920 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11881] ppid=11823 vsize=329144 CPUtime=193.9 cores=0,2,4,6
/proc/11824/task/11881/stat : 11881 (pb_cplex) R 11823 11823 10692 0 -1 4202560 46697 0 0 0 19374 16 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4104786560 139046530 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11824/tid=11882] ppid=11823 vsize=329144 CPUtime=183.91 cores=0,2,4,6
/proc/11824/task/11882/stat : 11882 (pb_cplex) R 11823 11823 10692 0 -1 4202560 107718 0 0 0 18359 32 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4094300368 136008441 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11824/tid=11883] ppid=11823 vsize=329144 CPUtime=196.46 cores=0,2,4,6
/proc/11824/task/11883/stat : 11883 (pb_cplex) R 11823 11823 10692 0 -1 4202560 107060 0 0 0 19615 31 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4083814468 136385184 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11884] ppid=11823 vsize=329144 CPUtime=227.7 cores=0,2,4,6
/proc/11824/task/11884/stat : 11884 (pb_cplex) R 11823 11823 10692 0 -1 4202560 6396 0 0 0 22763 7 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4073328744 136384778 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11824/tid=11885] ppid=11823 vsize=329144 CPUtime=185.36 cores=0,2,4,6
/proc/11824/task/11885/stat : 11885 (pb_cplex) R 11823 11823 10692 0 -1 4202560 25006 0 0 0 18524 12 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4062842724 136389732 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11824/tid=11886] ppid=11823 vsize=329144 CPUtime=197.34 cores=0,2,4,6
/proc/11824/task/11886/stat : 11886 (pb_cplex) R 11823 11823 10692 0 -1 4202560 64108 0 0 0 19714 20 0 0 20 0 8 0 391065924 337043456 53826 33554432000 134512640 146736320 4293733472 4052357328 136008044 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.34
Current children cumulated vsize (KiB) 338292

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11823 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.34
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 668.316
CPU time (s): 1800.34
CPU user time (s): 1798.8
CPU system time (s): 1.54
CPU usage (%): 269.384
Max. virtual memory (cumulated for all children) (KiB): 346432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 355
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.9427 second user time and 3.78342 second system time

The end

Launcher Data 

Begin job on node112 at 2012-06-09 15:39:29
IDJOB=3739734
IDBENCH=74369
IDSOLVER=2325
FILE ID=node112/3739734-1339249169
RUNJOBID= node112-1339246834-10708
PBS_JOBID= 14644369
Free space on /tmp= 70244 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j12039_7-sat.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3739734-1339249169/watcher-3739734-1339249169 -o /tmp/evaluation-result-3739734-1339249169/solver-3739734-1339249169 -C 1800 -W 1900 -M 15500  run HOME/instance-3739734-1339249169.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0f318fc75cd8d877b44870fe2fa76e77
RANDOM SEED=1424915229

node112.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.763
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29396000 kB
Buffers:          347816 kB
Cached:          2035108 kB
SwapCached:         2144 kB
Active:          1797940 kB
Inactive:         791292 kB
Active(anon):     203000 kB
Inactive(anon):     3164 kB
Active(file):    1594940 kB
Inactive(file):   788128 kB
Unevictable:        7376 kB
Mlocked:            7376 kB
SwapTotal:      67108856 kB
SwapFree:       67099428 kB
Dirty:             19024 kB
Writeback:             0 kB
AnonPages:        270816 kB
Mapped:            12556 kB
Shmem:                 0 kB
Slab:             748936 kB
SReclaimable:     193064 kB
SUnreclaim:       555872 kB
KernelStack:        1600 kB
PageTables:         4724 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     345184 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    149504 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3739734-1339249169.opb

Free space on /tmp at the end= 70220 MiB
End job on node112 at 2012-06-09 15:50:37