Trace number 4100811

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.03 1802.41

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-reduced-mps-v2-20-10-grow15.opb
MD5SUM85af08260bc54f31465e48eb0563bdd8
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 0
Optimality of the best value was proved NO
Number of variables17130
Total number of constraints900
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints900
Minimum length of a constraint22
Maximum length of a constraint491
Number of terms in the objective function 1335
Biggest coefficient in the objective function 12744
Number of bits for the biggest coefficient in the objective function 14
Sum of the numbers in the objective function 525285
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 256781
Number of bits of the biggest number in a constraint 18
Biggest sum of numbers in a constraint 525285
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4100811-1466220742/watcher-4100811-1466220742 -o /tmp/evaluation-result-4100811-1466220742/solver-4100811-1466220742 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node115-1466206100-11873 --watchdog 1960 naps-1.02 HOME/instance-4100811-1466220742.opb 

pid=15318
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.20 2.16 2.18 2/176 15321
/proc/meminfo: memFree=28969032/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=6964 CPUtime=0 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 444 0 0 0 0 0 0 0 20 0 1 0 24123212 7131136 319 33554432000 4194304 5796924 140736669579632 140736174961192 5096706 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 1741 319 124 392 0 1340 0

[startup+0.100161 s]
/proc/loadavg: 2.20 2.16 2.18 2/176 15321
/proc/meminfo: memFree=28969032/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=12992 CPUtime=0.09 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 1946 0 0 0 9 0 0 0 20 0 1 0 24123212 13303808 1779 33554432000 4194304 5796924 140736669579632 140736174961192 4805675 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 3248 1779 124 392 0 2847 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12992

[startup+0.200321 s]
/proc/loadavg: 2.20 2.16 2.18 2/176 15321
/proc/meminfo: memFree=28969032/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=16696 CPUtime=0.19 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 2829 0 0 0 19 0 0 0 20 0 1 0 24123212 17096704 2662 33554432000 4194304 5796924 140736669579632 140736174961192 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 4174 2662 124 392 0 3773 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 16696

[startup+0.300281 s]
/proc/loadavg: 2.20 2.16 2.18 2/176 15321
/proc/meminfo: memFree=28969032/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=20016 CPUtime=0.29 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 3664 0 0 0 29 0 0 0 20 0 1 0 24123212 20496384 3497 33554432000 4194304 5796924 140736669579632 140736174961192 5096609 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 5004 3497 124 392 0 4603 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 20016

[startup+0.700234 s]
/proc/loadavg: 2.20 2.16 2.18 2/176 15321
/proc/meminfo: memFree=28969032/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=32892 CPUtime=0.69 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 6884 0 0 0 69 0 0 0 20 0 1 0 24123212 33681408 6717 33554432000 4194304 5796924 140736669579632 140736669578792 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 8223 6717 124 392 0 7822 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 32892

[startup+1.50023 s]
/proc/loadavg: 2.20 2.16 2.18 3/177 15322
/proc/meminfo: memFree=28932188/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=42864 CPUtime=1.49 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 9509 0 0 0 148 1 0 0 20 0 1 0 24123212 43892736 9208 33554432000 4194304 5796924 140736669579632 140736669578792 5087632 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 10716 9208 136 392 0 10315 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 42864

[startup+3.10023 s]
/proc/loadavg: 2.18 2.16 2.17 3/177 15322
/proc/meminfo: memFree=28931940/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=42952 CPUtime=3.09 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 9552 0 0 0 308 1 0 0 20 0 1 0 24123212 43982848 9251 33554432000 4194304 5796924 140736669579632 140736669575848 4809389 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 10738 9251 140 392 0 10337 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 42952

[startup+6.30023 s]
/proc/loadavg: 2.18 2.16 2.17 3/177 15322
/proc/meminfo: memFree=28929792/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=42956 CPUtime=6.29 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 9553 0 0 0 628 1 0 0 20 0 1 0 24123212 43986944 9252 33554432000 4194304 5796924 140736669579632 140736669575848 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 10739 9252 140 392 0 10338 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 42956

[startup+12.7002 s]
/proc/loadavg: 2.15 2.15 2.17 3/177 15322
/proc/meminfo: memFree=28928848/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=43656 CPUtime=12.69 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 9697 0 0 0 1268 1 0 0 20 0 1 0 24123212 44703744 9396 33554432000 4194304 5796924 140736669579632 140736669575848 5087774 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 10914 9396 140 392 0 10513 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 43656

[startup+25.5003 s]
/proc/loadavg: 2.21 2.16 2.18 3/177 15322
/proc/meminfo: memFree=28918156/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=45456 CPUtime=25.49 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 10270 0 0 0 2548 1 0 0 20 0 1 0 24123212 46546944 9804 33554432000 4194304 5796924 140736669579632 140736669575848 4809286 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 11364 9804 140 392 0 10963 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 45456

[startup+51.1003 s]
/proc/loadavg: 2.14 2.15 2.17 3/177 15322
/proc/meminfo: memFree=28910864/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=48120 CPUtime=51.08 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 10821 0 0 0 5107 1 0 0 20 0 1 0 24123212 49274880 10536 33554432000 4194304 5796924 140736669579632 140736669575848 4313110 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 12030 10536 140 392 0 11629 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 48120

[startup+102.3 s]
/proc/loadavg: 2.21 2.17 2.18 3/177 15323
/proc/meminfo: memFree=28897212/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=54264 CPUtime=102.28 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 12422 0 0 0 10227 1 0 0 20 0 1 0 24123212 55566336 11989 33554432000 4194304 5796924 140736669579632 140736669575848 5096620 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 13566 11989 140 392 0 13165 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 54264

[startup+162.3 s]
/proc/loadavg: 2.23 2.18 2.18 3/177 15324
/proc/meminfo: memFree=28878764/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=58088 CPUtime=162.27 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 13425 0 0 0 16225 2 0 0 20 0 1 0 24123212 59482112 12992 33554432000 4194304 5796924 140736669579632 140736669575848 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 14522 12992 140 392 0 14121 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 58088

[startup+222.307 s]
/proc/loadavg: 2.25 2.19 2.18 4/177 15326
/proc/meminfo: memFree=28845928/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=68456 CPUtime=222.26 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 15236 0 0 0 22224 2 0 0 20 0 1 0 24123212 70098944 15529 33554432000 4194304 5796924 140736669579632 140736669575848 5087558 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 17114 15529 140 392 0 16713 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 68456

[startup+282.3 s]
/proc/loadavg: 2.13 2.17 2.18 3/177 15327
/proc/meminfo: memFree=28824996/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=73944 CPUtime=282.25 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 16100 0 0 0 28222 3 0 0 20 0 1 0 24123212 75718656 16904 33554432000 4194304 5796924 140736669579632 140736669575848 4865184 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 18486 16904 140 392 0 18085 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 73944

[startup+342.3 s]
/proc/loadavg: 2.16 2.16 2.17 3/177 15328
/proc/meminfo: memFree=28794968/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=87752 CPUtime=342.23 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 17118 0 0 0 34220 3 0 0 20 0 1 0 24123212 89858048 20396 33554432000 4194304 5796924 140736669579632 140736669575848 4861328 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 21938 20396 140 392 0 21537 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 87752

[startup+402.3 s]
/proc/loadavg: 2.11 2.15 2.17 3/177 15329
/proc/meminfo: memFree=28815688/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=142304 CPUtime=402.23 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 29047 0 0 0 40217 6 0 0 20 0 1 0 24123212 145719296 32836 33554432000 4194304 5796924 140736669579632 140736669575848 5087579 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 35576 32836 140 392 0 35175 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 142304

[startup+462.3 s]
/proc/loadavg: 2.08 2.13 2.16 3/178 15333
/proc/meminfo: memFree=28724252/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=225684 CPUtime=462.22 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 43802 0 0 0 46213 9 0 0 20 0 1 0 24123212 231100416 53049 33554432000 4194304 5796924 140736669579632 140736669576616 5087504 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 56421 53049 147 392 0 56020 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 225684

[startup+522.3 s]
/proc/loadavg: 2.19 2.15 2.17 3/177 15335
/proc/meminfo: memFree=28699900/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=230568 CPUtime=522.21 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 45044 0 0 0 52212 9 0 0 20 0 1 0 24123212 236101632 55313 33554432000 4194304 5796924 140736669579632 140736669576616 4806925 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 57642 55313 147 392 0 57241 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 230568

[startup+582.3 s]
/proc/loadavg: 2.24 2.17 2.17 3/177 15382
/proc/meminfo: memFree=30433920/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=236772 CPUtime=582.2 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 46578 0 0 0 58210 10 0 0 20 0 1 0 24123212 242454528 57358 33554432000 4194304 5796924 140736669579632 140736669576616 4808087 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 59193 57358 147 392 0 58792 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 236772


################
# More data... #
################

[pid=15321] ppid=15318 vsize=368228 CPUtime=1062.09 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 62111 0 0 0 106194 15 0 0 20 0 1 0 24123212 377065472 89390 33554432000 4194304 5796924 140736669579632 140736669575848 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 92057 89390 147 392 0 91656 0
Current children cumulated CPU time (s) 1062.09
Current children cumulated vsize (KiB) 368228

[startup+1122.3 s]
/proc/loadavg: 2.02 2.09 2.14 3/177 15396
/proc/meminfo: memFree=29969856/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=399432 CPUtime=1122.08 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 62529 0 0 0 112193 15 0 0 20 0 1 0 24123212 409018368 90830 33554432000 4194304 5796924 140736669579632 140736669575848 4295718 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 99858 90830 147 392 0 99457 0
Current children cumulated CPU time (s) 1122.08
Current children cumulated vsize (KiB) 399432

[startup+1182.3 s]
/proc/loadavg: 2.05 2.09 2.13 4/177 15397
/proc/meminfo: memFree=29851600/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=495808 CPUtime=1182.07 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 66431 0 0 0 118189 18 0 0 20 0 1 0 24123212 507707392 116565 33554432000 4194304 5796924 140736669579632 140736669575848 5096633 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 123952 116565 147 392 0 123551 0
Current children cumulated CPU time (s) 1182.07
Current children cumulated vsize (KiB) 495808

[startup+1242.3 s]
/proc/loadavg: 2.02 2.07 2.12 3/177 15398
/proc/meminfo: memFree=29747216/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=495808 CPUtime=1242.06 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 66434 0 0 0 124188 18 0 0 20 0 1 0 24123212 507707392 118101 33554432000 4194304 5796924 140736669579632 140736669575848 5092416 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 123952 118101 147 392 0 123551 0
Current children cumulated CPU time (s) 1242.06
Current children cumulated vsize (KiB) 495808

[startup+1302.3 s]
/proc/loadavg: 2.00 2.06 2.11 3/177 15399
/proc/meminfo: memFree=29679192/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=499504 CPUtime=1302.05 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 67360 0 0 0 130187 18 0 0 20 0 1 0 24123212 511492096 120049 33554432000 4194304 5796924 140736669579632 140736669575848 4806949 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 124876 120049 147 392 0 124475 0
Current children cumulated CPU time (s) 1302.05
Current children cumulated vsize (KiB) 499504

[startup+1362.3 s]
/proc/loadavg: 2.05 2.06 2.10 3/177 15400
/proc/meminfo: memFree=29659028/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=509404 CPUtime=1362.03 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 69818 0 0 0 136185 18 0 0 20 0 1 0 24123212 521629696 124040 33554432000 4194304 5796924 140736669579632 140736669575848 5096680 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 127351 124040 147 392 0 126950 0
Current children cumulated CPU time (s) 1362.03
Current children cumulated vsize (KiB) 509404

[startup+1422.3 s]
/proc/loadavg: 2.19 2.09 2.11 4/177 15402
/proc/meminfo: memFree=29620080/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=537256 CPUtime=1422.03 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 76791 0 0 0 142183 20 0 0 20 0 1 0 24123212 550150144 132035 33554432000 4194304 5796924 140736669579632 140736669575848 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 134314 132035 147 392 0 133913 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 537256

[startup+1482.3 s]
/proc/loadavg: 2.17 2.10 2.11 3/177 15403
/proc/meminfo: memFree=29588140/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=595324 CPUtime=1482.02 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 80162 0 0 0 148181 21 0 0 20 0 1 0 24123212 609611776 136428 33554432000 4194304 5796924 140736669579632 140736669575848 5087664 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 148831 136428 147 392 0 148430 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 595324

[startup+1542.31 s]
/proc/loadavg: 2.11 2.09 2.10 3/177 15404
/proc/meminfo: memFree=29542524/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=606808 CPUtime=1542.02 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 83017 0 0 0 154180 22 0 0 20 0 1 0 24123212 621371392 140816 33554432000 4194304 5796924 140736669579632 140736669575848 4805602 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 151702 140816 147 392 0 151301 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 606808

[startup+1602.3 s]
/proc/loadavg: 2.16 2.10 2.10 4/177 15405
/proc/meminfo: memFree=29504968/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=626940 CPUtime=1602.01 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 88060 0 0 0 160178 23 0 0 20 0 1 0 24123212 641986560 146881 33554432000 4194304 5796924 140736669579632 140736669575848 5092526 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 156735 146881 147 392 0 156334 0
Current children cumulated CPU time (s) 1602.01
Current children cumulated vsize (KiB) 626940

[startup+1662.3 s]
/proc/loadavg: 2.12 2.10 2.09 3/178 15409
/proc/meminfo: memFree=29473828/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=640404 CPUtime=1661.99 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 91433 0 0 0 166176 23 0 0 20 0 1 0 24123212 655773696 152294 33554432000 4194304 5796924 140736669579632 140736669575848 4806981 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 160101 152294 147 392 0 159700 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 640404

[startup+1722.3 s]
/proc/loadavg: 2.04 2.08 2.09 3/178 15434
/proc/meminfo: memFree=29406348/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=654200 CPUtime=1721.96 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 94938 0 0 0 172172 24 0 0 20 0 1 0 24123212 669900800 157291 33554432000 4194304 5796924 140736669579632 140736669575848 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 163550 157291 147 392 0 163149 0
Current children cumulated CPU time (s) 1721.96
Current children cumulated vsize (KiB) 654200

[startup+1782.3 s]
/proc/loadavg: 2.11 2.09 2.09 3/177 15435
/proc/meminfo: memFree=29196200/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=850248 CPUtime=1781.92 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 102875 0 0 0 178161 31 0 0 20 0 1 0 24123212 870653952 208347 33554432000 4194304 5796924 140736669579632 140736669575848 5092487 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 212562 208347 147 392 0 212161 0
Current children cumulated CPU time (s) 1781.92
Current children cumulated vsize (KiB) 850248



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.08 2.08 2.09 3/177 15435
/proc/meminfo: memFree=29188952/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=855528 CPUtime=1800.02 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) R 15318 15321 11857 0 -1 4202496 104209 0 0 0 179971 31 0 0 20 0 1 0 24123212 876060672 210192 33554432000 4194304 5796924 140736669579632 140736669575848 4809358 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 213882 210192 147 392 0 213481 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 855528

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -15321
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15321 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.08 2.08 2.09 2/177 15435
/proc/meminfo: memFree=29188952/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=855528 CPUtime=1800.02 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) S 15318 15321 11857 0 -1 4194304 104210 0 0 0 179971 31 0 0 20 0 1 0 24123212 876060672 210193 33554432000 4194304 5796924 140736669579632 140736669572424 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 213882 210193 148 392 0 213481 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 855528

[startup+1802 s]
/proc/loadavg: 2.00 2.07 2.08 2/177 15435
/proc/meminfo: memFree=29188952/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=855528 CPUtime=1800.02 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) S 15318 15321 11857 0 -1 4194304 104210 0 0 0 179971 31 0 0 20 0 1 0 24123212 876060672 210193 33554432000 4194304 5796924 140736669579632 140736669572424 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 213882 210193 148 392 0 213481 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 855528

[startup+1802.4 s]
/proc/loadavg: 2.00 2.07 2.08 2/177 15435
/proc/meminfo: memFree=29188952/32872528 swapFree=1103996/1183712
[pid=15321] ppid=15318 vsize=855528 CPUtime=1800.02 cores=0,2,4,6
/proc/15321/stat : 15321 (naps-1.02) S 15318 15321 11857 0 -1 4194304 104210 0 0 0 179971 31 0 0 20 0 1 0 24123212 876060672 210193 33554432000 4194304 5796924 140736669579632 140736669572424 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/15321/statm: 213882 210193 148 392 0 213481 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 855528

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.41
CPU time (s): 1800.03
CPU user time (s): 1799.71
CPU system time (s): 0.318951
CPU usage (%): 99.8682
Max. virtual memory (cumulated for all children) (KiB): 1016336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.71
system time used= 0.318951
maximum resident set size= 997404
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 104210
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 152
involuntary context switches= 1973

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.21521 second user time and 7.42387 second system time

The end

Launcher Data 

Begin job on node115 at 2016-06-18 05:32:22
IDJOB=4100811
IDBENCH=1664
IDSOLVER=2544
FILE ID=node115/4100811-1466220742
RUNJOBID= node115-1466206100-11873
PBS_JOBID= 19918161
Free space on /tmp= 71736 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-reduced-mps-v2-20-10-grow15.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4100811-1466220742/watcher-4100811-1466220742 -o /tmp/evaluation-result-4100811-1466220742/solver-4100811-1466220742 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node115-1466206100-11873 --watchdog 1960  naps-1.02 HOME/instance-4100811-1466220742.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 85af08260bc54f31465e48eb0563bdd8
RANDOM SEED=234313455

node115.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.103
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28969752 kB
Buffers:          103484 kB
Cached:           121556 kB
SwapCached:         2472 kB
Active:          1811684 kB
Inactive:         152472 kB
Active(anon):    1739188 kB
Inactive(anon):     2168 kB
Active(file):      72496 kB
Inactive(file):   150304 kB
Unevictable:     1183712 kB
Mlocked:         1103996 kB
SwapTotal:      67108856 kB
SwapFree:       67099632 kB
Dirty:              5052 kB
Writeback:             0 kB
AnonPages:       2944088 kB
Mapped:             9340 kB
Shmem:                 0 kB
Slab:             611320 kB
SReclaimable:      55280 kB
SUnreclaim:       556040 kB
KernelStack:        1472 kB
PageTables:         9640 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3261436 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    976896 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71732 MiB
End job on node115 at 2016-06-18 06:02:25