Trace number 4100819

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.09 1802.41

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-reduced-mps-v2-20-10-grow22.opb
MD5SUM16450e6196a99d1fc33b5d9a0f64103d
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 0
Optimality of the best value was proved NO
Number of variables25124
Total number of constraints1320
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1320
Minimum length of a constraint22
Maximum length of a constraint491
Number of terms in the objective function 1958
Biggest coefficient in the objective function 8399
Number of bits for the biggest coefficient in the objective function 14
Sum of the numbers in the objective function 525721
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 256781
Number of bits of the biggest number in a constraint 18
Biggest sum of numbers in a constraint 525721
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4100819-1466220835/watcher-4100819-1466220835 -o /tmp/evaluation-result-4100819-1466220835/solver-4100819-1466220835 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node114-1466206099-12165 --watchdog 1960 naps-1.02 HOME/instance-4100819-1466220835.opb 

pid=15010
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.29 2.21 2.18 3/176 15013
/proc/meminfo: memFree=29785716/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=7264 CPUtime=0 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 483 0 0 0 0 0 0 0 20 0 1 0 24132772 7438336 358 33554432000 4194304 5796924 140735659573472 140736713171960 4659057 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 1816 359 124 392 0 1415 0

[startup+0.100152 s]
/proc/loadavg: 2.29 2.21 2.18 3/176 15013
/proc/meminfo: memFree=29785716/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=13476 CPUtime=0.09 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 2027 0 0 0 9 0 0 0 20 0 1 0 24132772 13799424 1860 33554432000 4194304 5796924 140735659573472 140736713171960 4643307 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 3369 1860 124 392 0 2968 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 13476

[startup+0.200325 s]
/proc/loadavg: 2.29 2.21 2.18 3/176 15013
/proc/meminfo: memFree=29785716/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=18216 CPUtime=0.19 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 3300 0 0 0 19 0 0 0 20 0 1 0 24132772 18653184 3050 33554432000 4194304 5796924 140735659573472 140736713171960 5095032 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 4554 3050 124 392 0 4153 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 18216

[startup+0.300296 s]
/proc/loadavg: 2.29 2.21 2.18 3/176 15013
/proc/meminfo: memFree=29785716/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=22020 CPUtime=0.28 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 4152 0 0 0 28 0 0 0 20 0 1 0 24132772 22548480 3902 33554432000 4194304 5796924 140735659573472 140736713171960 5183584 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 5505 3902 124 392 0 5104 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 22020

[startup+0.700238 s]
/proc/loadavg: 2.29 2.21 2.18 3/176 15013
/proc/meminfo: memFree=29785716/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=35048 CPUtime=0.69 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 7420 0 0 0 68 1 0 0 20 0 1 0 24132772 35889152 7170 33554432000 4194304 5796924 140735659573472 140736713171960 4404544 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 8762 7170 124 392 0 8361 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 35048

[startup+1.50025 s]
/proc/loadavg: 2.27 2.21 2.18 3/177 15014
/proc/meminfo: memFree=29744756/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=60184 CPUtime=1.48 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 13920 0 0 0 146 2 0 0 20 0 1 0 24132772 61628416 13473 33554432000 4194304 5796924 140735659573472 140735659572632 5092509 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 15046 13473 136 392 0 14645 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 60184

[startup+3.10023 s]
/proc/loadavg: 2.27 2.21 2.18 3/177 15014
/proc/meminfo: memFree=29729440/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=60272 CPUtime=3.08 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 13963 0 0 0 306 2 0 0 20 0 1 0 24132772 61718528 13516 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 15068 13516 140 392 0 14667 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 60272

[startup+6.30023 s]
/proc/loadavg: 2.27 2.21 2.18 3/177 15014
/proc/meminfo: memFree=29727476/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=60276 CPUtime=6.28 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 13964 0 0 0 626 2 0 0 20 0 1 0 24132772 61722624 13517 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 15069 13517 140 392 0 14668 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 60276

[startup+12.7002 s]
/proc/loadavg: 2.30 2.21 2.18 3/177 15014
/proc/meminfo: memFree=29720556/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=60292 CPUtime=12.69 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 13968 0 0 0 1266 3 0 0 20 0 1 0 24132772 61739008 13521 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 15073 13521 140 392 0 14672 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 60292

[startup+25.5003 s]
/proc/loadavg: 2.25 2.21 2.18 3/177 15014
/proc/meminfo: memFree=29714036/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=63600 CPUtime=25.49 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 14588 0 0 0 2546 3 0 0 20 0 1 0 24132772 65126400 14141 33554432000 4194304 5796924 140735659573472 140735659569688 4865443 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 15900 14141 140 392 0 15499 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 63600

[startup+51.1003 s]
/proc/loadavg: 2.21 2.20 2.18 3/176 15014
/proc/meminfo: memFree=29695740/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=64916 CPUtime=51.09 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 15389 0 0 0 5106 3 0 0 20 0 1 0 24132772 66473984 14612 33554432000 4194304 5796924 140735659573472 140735659569688 5087632 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 16229 14612 140 392 0 15828 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 64916

[startup+102.3 s]
/proc/loadavg: 2.22 2.20 2.18 3/177 15016
/proc/meminfo: memFree=29704164/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=70940 CPUtime=102.27 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 17029 0 0 0 10224 3 0 0 20 0 1 0 24132772 72642560 16138 33554432000 4194304 5796924 140735659573472 140735659569688 4865192 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 17735 16138 140 392 0 17334 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 70940

[startup+162.3 s]
/proc/loadavg: 2.20 2.19 2.18 4/177 15017
/proc/meminfo: memFree=29696820/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=74752 CPUtime=162.25 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 17976 0 0 0 16222 3 0 0 20 0 1 0 24132772 76546048 17085 33554432000 4194304 5796924 140735659573472 140735659569688 5087766 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 18688 17085 140 392 0 18287 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 74752

[startup+222.307 s]
/proc/loadavg: 2.22 2.20 2.18 3/177 15018
/proc/meminfo: memFree=29652940/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=84352 CPUtime=222.25 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 19001 0 0 0 22221 4 0 0 20 0 1 0 24132772 86376448 19347 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 21088 19347 140 392 0 20687 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 84352

[startup+282.3 s]
/proc/loadavg: 2.13 2.18 2.17 3/177 15019
/proc/meminfo: memFree=29671512/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=90876 CPUtime=282.23 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 20400 0 0 0 28219 4 0 0 20 0 1 0 24132772 93057024 20746 33554432000 4194304 5796924 140735659573472 140735659569688 5096666 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 22719 20746 140 392 0 22318 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 90876

[startup+342.3 s]
/proc/loadavg: 2.17 2.17 2.17 3/177 15020
/proc/meminfo: memFree=29670780/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=93492 CPUtime=342.23 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 21380 0 0 0 34218 5 0 0 20 0 1 0 24132772 95735808 21726 33554432000 4194304 5796924 140735659573472 140735659569688 5087497 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 23373 21726 140 392 0 22972 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 93492

[startup+402.3 s]
/proc/loadavg: 2.22 2.18 2.18 3/178 15025
/proc/meminfo: memFree=29620252/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=110740 CPUtime=402.21 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 22868 0 0 0 40216 5 0 0 20 0 1 0 24132772 113397760 25688 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 27685 25688 140 392 0 27284 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 110740

[startup+462.3 s]
/proc/loadavg: 2.16 2.18 2.18 4/177 15026
/proc/meminfo: memFree=29633100/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=113340 CPUtime=462.2 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 23520 0 0 0 46215 5 0 0 20 0 1 0 24132772 116060160 26340 33554432000 4194304 5796924 140735659573472 140735659569688 5087747 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 28335 26340 140 392 0 27934 0
Current children cumulated CPU time (s) 462.2
Current children cumulated vsize (KiB) 113340

[startup+522.3 s]
/proc/loadavg: 2.28 2.21 2.19 3/177 15027
/proc/meminfo: memFree=29555644/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=159096 CPUtime=522.2 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 33911 0 0 0 52214 6 0 0 20 0 1 0 24132772 162914304 37242 33554432000 4194304 5796924 140735659573472 140735659569688 4805771 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 39774 37242 140 392 0 39373 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 159096

[startup+582.3 s]
/proc/loadavg: 2.20 2.20 2.18 3/177 15028
/proc/meminfo: memFree=29537904/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=202084 CPUtime=582.18 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 38428 0 0 0 58211 7 0 0 20 0 1 0 24132772 206934016 47217 33554432000 4194304 5796924 140735659573472 140735659569688 4809080 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 50521 47217 140 392 0 50120 0
Current children cumulated CPU time (s) 582.18
Current children cumulated vsize (KiB) 202084


################
# More data... #
################

[pid=15013] ppid=15010 vsize=359012 CPUtime=1062.08 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 60308 0 0 0 106195 13 0 0 20 0 1 0 24132772 367628288 85060 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 89753 85060 147 392 0 89352 0
Current children cumulated CPU time (s) 1062.08
Current children cumulated vsize (KiB) 359012

[startup+1122.3 s]
/proc/loadavg: 2.28 2.23 2.19 3/177 15088
/proc/meminfo: memFree=23105984/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=361256 CPUtime=1122.07 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 60890 0 0 0 112194 13 0 0 20 0 1 0 24132772 369926144 87175 33554432000 4194304 5796924 140735659573472 140735659569688 5094706 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 90314 87175 147 392 0 89913 0
Current children cumulated CPU time (s) 1122.07
Current children cumulated vsize (KiB) 361256

[startup+1182.3 s]
/proc/loadavg: 2.23 2.21 2.18 3/177 15089
/proc/meminfo: memFree=22605104/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=373532 CPUtime=1182.05 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 63969 0 0 0 118192 13 0 0 20 0 1 0 24132772 382496768 91276 33554432000 4194304 5796924 140735659573472 140735659569688 5092558 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 93383 91276 147 392 0 92982 0
Current children cumulated CPU time (s) 1182.05
Current children cumulated vsize (KiB) 373532

[startup+1242.3 s]
/proc/loadavg: 2.21 2.20 2.18 4/177 15090
/proc/meminfo: memFree=22374108/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=527712 CPUtime=1242.05 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 74936 0 0 0 124187 18 0 0 20 0 1 0 24132772 540377088 124076 33554432000 4194304 5796924 140735659573472 140735659570456 4805675 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 131928 124076 147 392 0 131527 0
Current children cumulated CPU time (s) 1242.05
Current children cumulated vsize (KiB) 527712

[startup+1302.3 s]
/proc/loadavg: 2.25 2.21 2.18 3/177 15092
/proc/meminfo: memFree=22336908/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=535500 CPUtime=1302.04 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 76868 0 0 0 130186 18 0 0 20 0 1 0 24132772 548352000 126519 33554432000 4194304 5796924 140735659573472 140735659524984 5096633 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 133875 126519 147 392 0 133474 0
Current children cumulated CPU time (s) 1302.04
Current children cumulated vsize (KiB) 535500

[startup+1362.3 s]
/proc/loadavg: 2.18 2.20 2.18 3/177 15093
/proc/meminfo: memFree=22318980/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=542100 CPUtime=1362.02 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 78525 0 0 0 136184 18 0 0 20 0 1 0 24132772 555110400 129198 33554432000 4194304 5796924 140735659573472 140735659570456 4806912 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 135525 129198 147 392 0 135124 0
Current children cumulated CPU time (s) 1362.02
Current children cumulated vsize (KiB) 542100

[startup+1422.3 s]
/proc/loadavg: 2.15 2.19 2.18 3/177 15094
/proc/meminfo: memFree=19610360/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=548700 CPUtime=1422.03 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 80181 0 0 0 142184 19 0 0 20 0 1 0 24132772 561868800 131876 33554432000 4194304 5796924 140735659573472 140735659570456 5096633 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 137175 131876 147 392 0 136774 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 548700

[startup+1482.3 s]
/proc/loadavg: 2.12 2.18 2.17 4/177 15095
/proc/meminfo: memFree=19965504/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=549756 CPUtime=1482.01 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 80457 0 0 0 148182 19 0 0 20 0 1 0 24132772 562950144 132663 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 137439 132663 147 392 0 137038 0
Current children cumulated CPU time (s) 1482.01
Current children cumulated vsize (KiB) 549756

[startup+1542.31 s]
/proc/loadavg: 2.13 2.17 2.17 3/177 15096
/proc/meminfo: memFree=19961896/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=549756 CPUtime=1542.01 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 80458 0 0 0 154182 19 0 0 20 0 1 0 24132772 562950144 133175 33554432000 4194304 5796924 140735659573472 140735659569688 5087490 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 137439 133175 147 392 0 137038 0
Current children cumulated CPU time (s) 1542.01
Current children cumulated vsize (KiB) 549756

[startup+1602.3 s]
/proc/loadavg: 2.24 2.20 2.18 4/178 15101
/proc/meminfo: memFree=19949176/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=549824 CPUtime=1601.99 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 80478 0 0 0 160180 19 0 0 20 0 1 0 24132772 563019776 134728 33554432000 4194304 5796924 140735659573472 140735659569688 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 137456 134728 147 392 0 137055 0
Current children cumulated CPU time (s) 1601.99
Current children cumulated vsize (KiB) 549824

[startup+1662.3 s]
/proc/loadavg: 2.36 2.24 2.19 3/178 15125
/proc/meminfo: memFree=18868096/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=608552 CPUtime=1661.99 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 83734 0 0 0 166179 20 0 0 20 0 1 0 24132772 623157248 139006 33554432000 4194304 5796924 140735659573472 140735659569688 5087743 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 152138 139006 147 392 0 151737 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 608552

[startup+1722.3 s]
/proc/loadavg: 2.27 2.23 2.19 3/177 15126
/proc/meminfo: memFree=18808896/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=621752 CPUtime=1721.98 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 87287 0 0 0 172177 21 0 0 20 0 1 0 24132772 636674048 144092 33554432000 4194304 5796924 140735659573472 140735659569688 5092450 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 155438 144092 147 392 0 155037 0
Current children cumulated CPU time (s) 1721.98
Current children cumulated vsize (KiB) 621752

[startup+1782.3 s]
/proc/loadavg: 2.20 2.22 2.18 3/177 15127
/proc/meminfo: memFree=18796716/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=625448 CPUtime=1781.97 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 88235 0 0 0 178176 21 0 0 20 0 1 0 24132772 640458752 146573 33554432000 4194304 5796924 140735659573472 140735659569688 5087682 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 156362 146573 147 392 0 155961 0
Current children cumulated CPU time (s) 1781.97
Current children cumulated vsize (KiB) 625448



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.29 2.24 2.19 3/177 15127
/proc/meminfo: memFree=18794172/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=626108 CPUtime=1800.06 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) R 15010 15013 12149 0 -1 4202496 88379 0 0 0 179985 21 0 0 20 0 1 0 24132772 641134592 147228 33554432000 4194304 5796924 140735659573472 140735659569688 5092467 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 156527 147228 147 392 0 156126 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 626108

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -15013
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15013 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.29 2.24 2.19 2/177 15127
/proc/meminfo: memFree=18794296/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=626108 CPUtime=1800.06 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) S 15010 15013 12149 0 -1 4194304 88380 0 0 0 179985 21 0 0 20 0 1 0 24132772 641134592 147229 33554432000 4194304 5796924 140735659573472 140735659566152 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 156527 147229 148 392 0 156126 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 626108

[startup+1802 s]
/proc/loadavg: 2.27 2.24 2.19 2/177 15127
/proc/meminfo: memFree=18794296/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=626108 CPUtime=1800.06 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) S 15010 15013 12149 0 -1 4194304 88380 0 0 0 179985 21 0 0 20 0 1 0 24132772 641134592 147229 33554432000 4194304 5796924 140735659573472 140735659566152 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 156527 147229 148 392 0 156126 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 626108

[startup+1802.4 s]
/proc/loadavg: 2.27 2.24 2.19 2/177 15127
/proc/meminfo: memFree=18794296/32872528 swapFree=1074772/1156532
[pid=15013] ppid=15010 vsize=626108 CPUtime=1800.06 cores=0,2,4,6
/proc/15013/stat : 15013 (naps-1.02) S 15010 15013 12149 0 -1 4194304 88380 0 0 0 179985 21 0 0 20 0 1 0 24132772 641134592 147229 33554432000 4194304 5796924 140735659573472 140735659566152 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 4 0 0 0 0 0
/proc/15013/statm: 156527 147229 148 392 0 156126 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 626108

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.41
CPU time (s): 1800.09
CPU user time (s): 1799.86
CPU system time (s): 0.228965
CPU usage (%): 99.8708
Max. virtual memory (cumulated for all children) (KiB): 626108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.86
system time used= 0.228965
maximum resident set size= 588916
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 88380
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 87
involuntary context switches= 1853

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.2532 second user time and 7.45387 second system time

The end

Launcher Data 

Begin job on node114 at 2016-06-18 05:33:55
IDJOB=4100819
IDBENCH=1665
IDSOLVER=2544
FILE ID=node114/4100819-1466220835
RUNJOBID= node114-1466206099-12165
PBS_JOBID= 19918162
Free space on /tmp= 71728 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-reduced-mps-v2-20-10-grow22.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4100819-1466220835/watcher-4100819-1466220835 -o /tmp/evaluation-result-4100819-1466220835/solver-4100819-1466220835 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node114-1466206099-12165 --watchdog 1960  naps-1.02 HOME/instance-4100819-1466220835.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 16450e6196a99d1fc33b5d9a0f64103d
RANDOM SEED=1176946502

node114.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.761
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29785848 kB
Buffers:           97956 kB
Cached:           113836 kB
SwapCached:          808 kB
Active:          1044380 kB
Inactive:         147660 kB
Active(anon):     981436 kB
Inactive(anon):     1176 kB
Active(file):      62944 kB
Inactive(file):   146484 kB
Unevictable:     1156532 kB
Mlocked:         1074772 kB
SwapTotal:      67108856 kB
SwapFree:       67100508 kB
Dirty:              5580 kB
Writeback:            24 kB
AnonPages:       2136068 kB
Mapped:             8976 kB
Shmem:                 0 kB
Slab:             603768 kB
SReclaimable:      47716 kB
SUnreclaim:       556052 kB
KernelStack:        1448 kB
PageTables:         8356 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2335936 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1003520 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71720 MiB
End job on node114 at 2016-06-18 06:03:58