Trace number 4103495

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.1 1802.4

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-fit1p.opb
MD5SUM85f7c2e2894ed59f685fa11d94ed0974
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 10627584
Optimality of the best value was proved NO
Number of variables45485
Total number of constraints1026
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1026
Minimum length of a constraint17
Maximum length of a constraint619
Number of terms in the objective function 30780
Biggest coefficient in the objective function 1610612736
Number of bits for the biggest coefficient in the objective function 31
Sum of the numbers in the objective function 1591285381686
Number of bits of the sum of numbers in the objective function 41
Biggest number in a constraint 59431609958400
Number of bits of the biggest number in a constraint 46
Biggest sum of numbers in a constraint 209844586667159
Number of bits of the biggest sum of numbers48
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103495-1466258209/watcher-4103495-1466258209 -o /tmp/evaluation-result-4103495-1466258209/solver-4103495-1466258209 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node133-1466241101-19194 --watchdog 1960 naps-1.02 HOME/instance-4103495-1466258209.opb 

pid=20981
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.16 2.07 2.01 3/178 20984
/proc/meminfo: memFree=31194688/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=6824 CPUtime=0 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 373 0 0 0 0 0 0 0 20 0 1 0 27866807 6987776 248 33554432000 4194304 5796924 140736166670912 140737451489208 4350334 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 1706 249 114 392 0 1305 0

[startup+0.100167 s]
/proc/loadavg: 2.16 2.07 2.01 3/178 20984
/proc/meminfo: memFree=31194688/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=18600 CPUtime=0.09 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 3346 0 0 0 9 0 0 0 20 0 1 0 27866807 19046400 3035 33554432000 4194304 5796924 140736166670912 140737451489208 4404063 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 4650 3035 124 392 0 4249 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 18600

[startup+0.200358 s]
/proc/loadavg: 2.16 2.07 2.01 3/178 20984
/proc/meminfo: memFree=31194688/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=21548 CPUtime=0.19 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 3944 0 0 0 19 0 0 0 20 0 1 0 27866807 22065152 3622 33554432000 4194304 5796924 140736166670912 140737451489208 5096680 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 5387 3622 128 392 0 4986 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 21548

[startup+0.300306 s]
/proc/loadavg: 2.16 2.07 2.01 3/178 20984
/proc/meminfo: memFree=31194688/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=24112 CPUtime=0.29 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 4547 0 0 0 29 0 0 0 20 0 1 0 27866807 24690688 4225 33554432000 4194304 5796924 140736166670912 140737451489208 5095032 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 6028 4225 128 392 0 5627 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 24112

[startup+0.700232 s]
/proc/loadavg: 2.16 2.07 2.01 3/178 20984
/proc/meminfo: memFree=31194688/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=35304 CPUtime=0.68 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 7351 0 0 0 68 0 0 0 20 0 1 0 27866807 36151296 7029 33554432000 4194304 5796924 140736166670912 140736166664600 5092545 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 8826 7029 128 392 0 8425 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 35304

[startup+1.50023 s]
/proc/loadavg: 2.16 2.07 2.01 3/179 20985
/proc/meminfo: memFree=31155736/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=58164 CPUtime=1.48 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 13040 0 0 0 147 1 0 0 20 0 1 0 27866807 59559936 12718 33554432000 4194304 5796924 140736166670912 140736166664600 5095032 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 14541 12718 128 392 0 14140 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 58164

[startup+3.10023 s]
/proc/loadavg: 2.16 2.07 2.01 3/179 20985
/proc/meminfo: memFree=31123992/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=105676 CPUtime=3.09 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 24958 0 0 0 306 3 0 0 20 0 1 0 27866807 108212224 24471 33554432000 4194304 5796924 140736166670912 140736166670072 5095032 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 26419 24471 128 392 0 26018 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 105676

[startup+6.30023 s]
/proc/loadavg: 2.15 2.07 2.01 3/179 20985
/proc/meminfo: memFree=31090660/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=111028 CPUtime=6.29 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 26693 0 0 0 626 3 0 0 20 0 1 0 27866807 113692672 25850 33554432000 4194304 5796924 140736166670912 140736166667128 5092545 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 27757 25850 144 392 0 27356 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 111028

[startup+12.7002 s]
/proc/loadavg: 2.14 2.07 2.01 3/179 20985
/proc/meminfo: memFree=31090732/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=111036 CPUtime=12.69 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 26695 0 0 0 1266 3 0 0 20 0 1 0 27866807 113700864 25852 33554432000 4194304 5796924 140736166670912 140736166667128 4839563 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 27759 25852 144 392 0 27358 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 111036

[startup+25.5003 s]
/proc/loadavg: 2.11 2.06 2.01 3/179 20985
/proc/meminfo: memFree=31091192/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=111044 CPUtime=25.48 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 26697 0 0 0 2545 3 0 0 20 0 1 0 27866807 113709056 25854 33554432000 4194304 5796924 140736166670912 140736166667128 5087606 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 27761 25854 144 392 0 27360 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 111044

[startup+51.1003 s]
/proc/loadavg: 2.14 2.07 2.01 3/179 20985
/proc/meminfo: memFree=31087968/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=114792 CPUtime=51.08 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 27619 0 0 0 5105 3 0 0 20 0 1 0 27866807 117547008 26776 33554432000 4194304 5796924 140736166670912 140736166667128 5092526 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 28698 26776 144 392 0 28297 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 114792

[startup+102.3 s]
/proc/loadavg: 2.14 2.07 2.01 3/179 20986
/proc/meminfo: memFree=31082468/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=119868 CPUtime=102.28 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 28507 0 0 0 10225 3 0 0 20 0 1 0 27866807 122744832 28027 33554432000 4194304 5796924 140736166670912 140736166667128 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 29967 28027 144 392 0 29566 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 119868

[startup+162.3 s]
/proc/loadavg: 2.13 2.07 2.01 3/179 20987
/proc/meminfo: memFree=31078444/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=123388 CPUtime=162.26 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 29427 0 0 0 16223 3 0 0 20 0 1 0 27866807 126349312 28947 33554432000 4194304 5796924 140736166670912 140736166667128 4313090 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 30847 28947 144 392 0 30446 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 123388

[startup+222.307 s]
/proc/loadavg: 2.10 2.07 2.01 3/180 20991
/proc/meminfo: memFree=30866144/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=335876 CPUtime=222.26 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 81173 0 0 0 22215 11 0 0 20 0 1 0 27866807 343937024 81930 33554432000 4194304 5796924 140736166670912 140736166665400 5087771 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 83969 81930 145 392 0 83568 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 335876

[startup+282.3 s]
/proc/loadavg: 2.13 2.09 2.02 3/180 21016
/proc/meminfo: memFree=30793116/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=412168 CPUtime=282.25 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 96917 0 0 0 28211 14 0 0 20 0 1 0 27866807 422060032 100148 33554432000 4194304 5796924 140736166670912 140736166667896 5092886 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 103042 100148 151 392 0 102641 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 412168

[startup+342.3 s]
/proc/loadavg: 2.13 2.09 2.02 3/179 21017
/proc/meminfo: memFree=30790708/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=412168 CPUtime=342.23 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 97110 0 0 0 34209 14 0 0 20 0 1 0 27866807 422060032 100523 33554432000 4194304 5796924 140736166670912 140736166667896 5092681 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 103042 100523 151 392 0 102641 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 412168

[startup+402.3 s]
/proc/loadavg: 2.12 2.08 2.02 3/179 21018
/proc/meminfo: memFree=30789988/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=412168 CPUtime=402.21 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 97127 0 0 0 40207 14 0 0 20 0 1 0 27866807 422060032 100523 33554432000 4194304 5796924 140736166670912 140736166667128 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 103042 100523 151 392 0 102641 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 412168

[startup+462.3 s]
/proc/loadavg: 2.04 2.07 2.01 3/179 21019
/proc/meminfo: memFree=30789768/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=412168 CPUtime=462.19 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 97132 0 0 0 46205 14 0 0 20 0 1 0 27866807 422060032 100523 33554432000 4194304 5796924 140736166670912 140736166667128 5092425 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 103042 100523 151 392 0 102641 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 412168

[startup+522.3 s]
/proc/loadavg: 2.09 2.07 2.01 3/179 21020
/proc/meminfo: memFree=30787024/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=414500 CPUtime=522.18 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 97762 0 0 0 52204 14 0 0 20 0 1 0 27866807 424448000 101146 33554432000 4194304 5796924 140736166670912 140736166667896 5087532 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 103625 101146 191 392 0 103224 0
Current children cumulated CPU time (s) 522.18
Current children cumulated vsize (KiB) 414500

[startup+582.3 s]
/proc/loadavg: 2.03 2.05 2.01 3/179 21022
/proc/meminfo: memFree=30787484/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=414500 CPUtime=582.17 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 97762 0 0 0 58203 14 0 0 20 0 1 0 27866807 424448000 101337 33554432000 4194304 5796924 140736166670912 140736166667128 5092416 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 103625 101337 191 392 0 103224 0
Current children cumulated CPU time (s) 582.17
Current children cumulated vsize (KiB) 414500


################
# More data... #
################

[pid=20984] ppid=20981 vsize=421920 CPUtime=1062.1 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 98316 0 0 0 106195 15 0 0 20 0 1 0 27866807 432046080 102913 33554432000 4194304 5796924 140736166670912 140736166667896 5092735 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 105480 102913 191 392 0 105079 0
Current children cumulated CPU time (s) 1062.1
Current children cumulated vsize (KiB) 421920

[startup+1122.3 s]
/proc/loadavg: 2.05 2.06 2.00 3/179 21081
/proc/meminfo: memFree=30787012/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=421920 CPUtime=1122.09 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 98316 0 0 0 112194 15 0 0 20 0 1 0 27866807 432046080 102913 33554432000 4194304 5796924 140736166670912 140736166667896 5087766 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 105480 102913 191 392 0 105079 0
Current children cumulated CPU time (s) 1122.09
Current children cumulated vsize (KiB) 421920

[startup+1182.3 s]
/proc/loadavg: 2.10 2.06 2.01 3/179 21083
/proc/meminfo: memFree=30786880/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=421920 CPUtime=1182.08 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 98316 0 0 0 118193 15 0 0 20 0 1 0 27866807 432046080 102913 33554432000 4194304 5796924 140736166670912 140736166667896 4199760 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 105480 102913 191 392 0 105079 0
Current children cumulated CPU time (s) 1182.08
Current children cumulated vsize (KiB) 421920

[startup+1242.3 s]
/proc/loadavg: 2.03 2.05 2.00 3/179 21084
/proc/meminfo: memFree=30785904/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=425484 CPUtime=1242.07 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 99197 0 0 0 124192 15 0 0 20 0 1 0 27866807 435695616 104305 33554432000 4194304 5796924 140736166670912 140736166667896 5095032 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 106371 104306 191 392 0 105970 0
Current children cumulated CPU time (s) 1242.07
Current children cumulated vsize (KiB) 425484

[startup+1302.3 s]
/proc/loadavg: 2.01 2.04 2.00 3/179 21085
/proc/meminfo: memFree=30763296/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=441924 CPUtime=1302.06 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 103285 0 0 0 130190 16 0 0 20 0 1 0 27866807 452530176 108393 33554432000 4194304 5796924 140736166670912 140736166665400 5096591 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 110481 108393 191 392 0 110080 0
Current children cumulated CPU time (s) 1302.06
Current children cumulated vsize (KiB) 441924

[startup+1362.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/179 21086
/proc/meminfo: memFree=30741548/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=463012 CPUtime=1362.05 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104121 0 0 0 136189 16 0 0 20 0 1 0 27866807 474124288 113665 33554432000 4194304 5796924 140736166670912 140736166667896 5092526 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 115753 113665 191 392 0 115352 0
Current children cumulated CPU time (s) 1362.05
Current children cumulated vsize (KiB) 463012

[startup+1422.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/180 21090
/proc/meminfo: memFree=30741240/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=463012 CPUtime=1422.04 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104121 0 0 0 142188 16 0 0 20 0 1 0 27866807 474124288 113665 33554432000 4194304 5796924 140736166670912 140736166667128 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 115753 113665 191 392 0 115352 0
Current children cumulated CPU time (s) 1422.04
Current children cumulated vsize (KiB) 463012

[startup+1482.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/179 21092
/proc/meminfo: memFree=30741524/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=463012 CPUtime=1482.03 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104121 0 0 0 148187 16 0 0 20 0 1 0 27866807 474124288 113665 33554432000 4194304 5796924 140736166670912 140736166667128 5087501 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 115753 113665 191 392 0 115352 0
Current children cumulated CPU time (s) 1482.03
Current children cumulated vsize (KiB) 463012

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 21093
/proc/meminfo: memFree=30741424/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=463012 CPUtime=1542.03 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104121 0 0 0 154187 16 0 0 20 0 1 0 27866807 474124288 113665 33554432000 4194304 5796924 140736166670912 140736166667896 4808064 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 115753 113665 191 392 0 115352 0
Current children cumulated CPU time (s) 1542.03
Current children cumulated vsize (KiB) 463012

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 21094
/proc/meminfo: memFree=30741244/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=463012 CPUtime=1602.01 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104121 0 0 0 160185 16 0 0 20 0 1 0 27866807 474124288 113665 33554432000 4194304 5796924 140736166670912 140736166667896 4806768 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 115753 113665 191 392 0 115352 0
Current children cumulated CPU time (s) 1602.01
Current children cumulated vsize (KiB) 463012

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 21095
/proc/meminfo: memFree=30741372/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=464036 CPUtime=1662 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104446 0 0 0 166184 16 0 0 20 0 1 0 27866807 475172864 113990 33554432000 4194304 5796924 140736166670912 140736166667896 5096709 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 116009 113990 191 392 0 115608 0
Current children cumulated CPU time (s) 1662
Current children cumulated vsize (KiB) 464036

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 21096
/proc/meminfo: memFree=30740872/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=464036 CPUtime=1721.99 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104448 0 0 0 172183 16 0 0 20 0 1 0 27866807 475172864 113992 33554432000 4194304 5796924 140736166670912 140736166667896 5087650 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 116009 113992 191 392 0 115608 0
Current children cumulated CPU time (s) 1721.99
Current children cumulated vsize (KiB) 464036

[startup+1782.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/179 21098
/proc/meminfo: memFree=30741004/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=464036 CPUtime=1781.98 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104448 0 0 0 178182 16 0 0 20 0 1 0 27866807 475172864 113992 33554432000 4194304 5796924 140736166670912 140736166667896 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 116009 113992 191 392 0 115608 0
Current children cumulated CPU time (s) 1781.98
Current children cumulated vsize (KiB) 464036



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.03 2.01 2.00 3/179 21098
/proc/meminfo: memFree=30740384/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=464036 CPUtime=1800.08 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) R 20981 20984 19177 0 -1 4202496 104605 0 0 0 179992 16 0 0 20 0 1 0 27866807 475172864 114149 33554432000 4194304 5796924 140736166670912 140736166667896 4863552 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 116009 114149 191 392 0 115608 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 464036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -20984
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 20984 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.03 2.01 2.00 2/179 21099
/proc/meminfo: memFree=30740120/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=464036 CPUtime=1800.08 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) S 20981 20984 19177 0 -1 4194304 104606 0 0 0 179992 16 0 0 20 0 1 0 27866807 475172864 114150 33554432000 4194304 5796924 140736166670912 140736166664456 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 116009 114150 192 392 0 115608 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 464036

[startup+1802 s]
/proc/loadavg: 2.03 2.01 2.00 2/179 21099
/proc/meminfo: memFree=30740120/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=464036 CPUtime=1800.08 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) S 20981 20984 19177 0 -1 4194304 104606 0 0 0 179992 16 0 0 20 0 1 0 27866807 475172864 114150 33554432000 4194304 5796924 140736166670912 140736166664456 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 116009 114150 192 392 0 115608 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 464036

[startup+1802.4 s]
/proc/loadavg: 2.03 2.01 2.00 2/179 21099
/proc/meminfo: memFree=30740120/32872528 swapFree=7780/7780
[pid=20984] ppid=20981 vsize=464036 CPUtime=1800.08 cores=1,3,5,7
/proc/20984/stat : 20984 (naps-1.02) S 20981 20984 19177 0 -1 4194304 104606 0 0 0 179992 16 0 0 20 0 1 0 27866807 475172864 114150 33554432000 4194304 5796924 140736166670912 140736166664456 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 3 0 0 0 0 0
/proc/20984/statm: 116009 114150 192 392 0 115608 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 464036

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.4
CPU time (s): 1800.1
CPU user time (s): 1799.93
CPU system time (s): 0.171973
CPU usage (%): 99.872
Max. virtual memory (cumulated for all children) (KiB): 484104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.93
system time used= 0.171973
maximum resident set size= 475752
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 104606
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 40
involuntary context switches= 1985

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.54216 second user time and 6.71398 second system time

The end

Launcher Data 

Begin job on node133 at 2016-06-18 15:56:49
IDJOB=4103495
IDBENCH=2377
IDSOLVER=2544
FILE ID=node133/4103495-1466258209
RUNJOBID= node133-1466241101-19194
PBS_JOBID= 19918201
Free space on /tmp= 71704 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-fit1p.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103495-1466258209/watcher-4103495-1466258209 -o /tmp/evaluation-result-4103495-1466258209/solver-4103495-1466258209 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node133-1466241101-19194 --watchdog 1960  naps-1.02 HOME/instance-4103495-1466258209.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 85f7c2e2894ed59f685fa11d94ed0974
RANDOM SEED=813583458

node133.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        31194952 kB
Buffers:          121720 kB
Cached:           187736 kB
SwapCached:         1324 kB
Active:           708456 kB
Inactive:         224620 kB
Active(anon):     624040 kB
Inactive(anon):     1904 kB
Active(file):      84416 kB
Inactive(file):   222716 kB
Unevictable:        7780 kB
Mlocked:            7780 kB
SwapTotal:      67108856 kB
SwapFree:       67099968 kB
Dirty:              8940 kB
Writeback:             0 kB
AnonPages:        630252 kB
Mapped:             8904 kB
Shmem:                 0 kB
Slab:             606256 kB
SReclaimable:      49048 kB
SUnreclaim:       557208 kB
KernelStack:        1512 kB
PageTables:         5588 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:     804664 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341987908 kB
HardwareCorrupted:     0 kB
AnonHugePages:    600064 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71704 MiB
End job on node133 at 2016-06-18 16:26:51