Trace number 4101259

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.08 1802.36

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-reduced-mps-v2-20-10-fit2p.opb
MD5SUMea34bf390bf77663918ceca8ccc177b4
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark208
Best CPU time to get the best result obtained on this benchmark1800.36
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1059
Optimality of the best value was proved NO
Number of variables293602
Total number of constraints10500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints10500
Minimum length of a constraint13
Maximum length of a constraint612
Number of terms in the objective function 246163
Biggest coefficient in the objective function 130
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 748663
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 261428
Number of bits of the biggest number in a constraint 18
Biggest sum of numbers in a constraint 748663
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4101259-1466226411/watcher-4101259-1466226411 -o /tmp/evaluation-result-4101259-1466226411/solver-4101259-1466226411 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node121-1466206085-402 --watchdog 1960 naps-1.02 HOME/instance-4101259-1466226411.opb 

pid=4277
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.21 2.25 2.22 3/174 4280
/proc/meminfo: memFree=28383344/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=7140 CPUtime=0 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 440 0 0 0 0 0 0 0 20 0 1 0 24688071 7311360 314 33554432000 4194304 5796924 140733203590448 140736601751592 5183584 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 1785 314 114 392 0 1384 0

[startup+0.100122 s]
/proc/loadavg: 2.21 2.25 2.22 3/174 4280
/proc/meminfo: memFree=28383344/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=39612 CPUtime=0.08 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 7617 0 0 0 7 1 0 0 20 0 1 0 24688071 40562688 7329 33554432000 4194304 5796924 140733203590448 140736601751592 5095032 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 9903 7331 114 392 0 9502 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 39612

[startup+0.200309 s]
/proc/loadavg: 2.21 2.25 2.22 3/174 4280
/proc/meminfo: memFree=28383344/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=70544 CPUtime=0.19 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 15050 0 0 0 16 3 0 0 20 0 1 0 24688071 72237056 15027 33554432000 4194304 5796924 140733203590448 140736601751592 5113464 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 17636 15029 114 392 0 17235 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 70544

[startup+0.300293 s]
/proc/loadavg: 2.21 2.25 2.22 3/174 4280
/proc/meminfo: memFree=28383344/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=84316 CPUtime=0.29 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 17770 0 0 0 25 4 0 0 20 0 1 0 24688071 86339584 17747 33554432000 4194304 5796924 140733203590448 140736601751592 4352965 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 21079 17747 116 392 0 20678 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 84316

[startup+0.700242 s]
/proc/loadavg: 2.21 2.25 2.22 3/174 4280
/proc/meminfo: memFree=28383344/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=102864 CPUtime=0.69 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 23605 0 0 0 64 5 0 0 20 0 1 0 24688071 105332736 23101 33554432000 4194304 5796924 140733203590448 140736601751592 4802791 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 25716 23101 124 392 0 25315 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 102864

[startup+1.50024 s]
/proc/loadavg: 2.21 2.25 2.22 3/175 4281
/proc/meminfo: memFree=28276140/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=126280 CPUtime=1.48 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 28710 0 0 0 143 5 0 0 20 0 1 0 24688071 129310720 28628 33554432000 4194304 5796924 140733203590448 140733203589608 4810733 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 31570 28628 128 392 0 31169 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 126280

[startup+3.10022 s]
/proc/loadavg: 2.21 2.25 2.22 3/175 4281
/proc/meminfo: memFree=28251712/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=169920 CPUtime=3.08 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 39590 0 0 0 301 7 0 0 20 0 1 0 24688071 173998080 39508 33554432000 4194304 5796924 140733203590448 140733203587944 5096620 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 42480 39508 128 392 0 42079 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 169920

[startup+6.30018 s]
/proc/loadavg: 2.19 2.24 2.22 3/175 4281
/proc/meminfo: memFree=28152628/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=263148 CPUtime=6.28 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 62922 0 0 0 616 12 0 0 20 0 1 0 24688071 269463552 62840 33554432000 4194304 5796924 140733203590448 140733203589672 4199797 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 65787 62840 128 392 0 65386 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 263148

[startup+12.7002 s]
/proc/loadavg: 2.18 2.24 2.21 3/175 4281
/proc/meminfo: memFree=27958552/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=448532 CPUtime=12.69 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 109254 0 0 0 1250 19 0 0 20 0 1 0 24688071 459296768 109172 33554432000 4194304 5796924 140733203590448 140733203589608 4865573 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 112133 109172 128 392 0 111732 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 448532

[startup+25.5002 s]
/proc/loadavg: 2.29 2.26 2.22 3/175 4281
/proc/meminfo: memFree=27853392/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=532072 CPUtime=25.48 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 136854 0 0 0 2526 22 0 0 20 0 1 0 24688071 544841728 130075 33554432000 4194304 5796924 140733203590448 140733203586664 5092487 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 133018 130075 144 392 0 132617 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 532072

[startup+51.1003 s]
/proc/loadavg: 2.25 2.25 2.22 3/175 4281
/proc/meminfo: memFree=27929176/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=535952 CPUtime=51.07 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 137765 0 0 0 5085 22 0 0 20 0 1 0 24688071 548814848 130986 33554432000 4194304 5796924 140733203590448 140733203586664 5092651 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 133988 130986 144 392 0 133587 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 535952

[startup+102.3 s]
/proc/loadavg: 2.20 2.24 2.21 3/175 4282
/proc/meminfo: memFree=27891392/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=546300 CPUtime=102.28 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 138873 0 0 0 10205 23 0 0 20 0 1 0 24688071 559411200 133627 33554432000 4194304 5796924 140733203590448 140733203586664 5087664 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 136575 133627 144 392 0 136174 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 546300

[startup+162.3 s]
/proc/loadavg: 2.17 2.22 2.21 3/175 4283
/proc/meminfo: memFree=27851096/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=549948 CPUtime=162.26 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 139269 0 0 0 16203 23 0 0 20 0 1 0 24688071 563146752 134534 33554432000 4194304 5796924 140733203590448 140733203586664 4863673 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 137487 134534 144 392 0 137086 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 549948

[startup+222.307 s]
/proc/loadavg: 2.11 2.20 2.20 3/176 4334
/proc/meminfo: memFree=29585732/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=565960 CPUtime=222.26 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 140215 0 0 0 22202 24 0 0 20 0 1 0 24688071 579543040 138546 33554432000 4194304 5796924 140733203590448 140733203586664 4806912 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 141490 138546 144 392 0 141089 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 565960

[startup+282.3 s]
/proc/loadavg: 2.20 2.22 2.20 3/175 4335
/proc/meminfo: memFree=29582828/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=565960 CPUtime=282.24 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 140215 0 0 0 28200 24 0 0 20 0 1 0 24688071 579543040 139141 33554432000 4194304 5796924 140733203590448 140733203586664 5092622 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 141490 139141 144 392 0 141089 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 565960

[startup+342.3 s]
/proc/loadavg: 2.17 2.20 2.19 3/175 4336
/proc/meminfo: memFree=29406952/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=576928 CPUtime=342.24 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 141006 0 0 0 34199 25 0 0 20 0 1 0 24688071 590774272 141895 33554432000 4194304 5796924 140733203590448 140733203586664 5087743 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 144232 141895 144 392 0 143831 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 576928

[startup+402.3 s]
/proc/loadavg: 2.11 2.18 2.18 3/175 4337
/proc/meminfo: memFree=29281152/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=589232 CPUtime=402.23 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 141340 0 0 0 40198 25 0 0 20 0 1 0 24688071 603373568 144784 33554432000 4194304 5796924 140733203590448 140733203586664 5096553 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 147308 144784 144 392 0 146907 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 589232

[startup+462.3 s]
/proc/loadavg: 2.08 2.16 2.17 3/175 4338
/proc/meminfo: memFree=29214932/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=589232 CPUtime=462.21 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 141340 0 0 0 46196 25 0 0 20 0 1 0 24688071 603373568 144792 33554432000 4194304 5796924 140733203590448 140733203586664 5092423 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 147308 144792 144 392 0 146907 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 589232

[startup+522.3 s]
/proc/loadavg: 2.18 2.17 2.18 3/175 4339
/proc/meminfo: memFree=29182660/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=596060 CPUtime=522.2 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 141770 0 0 0 52195 25 0 0 20 0 1 0 24688071 610365440 145217 33554432000 4194304 5796924 140733203590448 140733203586664 5092423 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 149015 145217 144 392 0 148614 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 596060

[startup+582.3 s]
/proc/loadavg: 2.12 2.15 2.17 3/175 4341
/proc/meminfo: memFree=29167720/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=599240 CPUtime=582.19 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 142806 0 0 0 58193 26 0 0 20 0 1 0 24688071 613621760 146770 33554432000 4194304 5796924 140733203590448 140733203586664 4805602 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 149810 146770 144 392 0 149409 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 599240


################
# More data... #
################

[pid=4280] ppid=4277 vsize=722568 CPUtime=1122.11 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 154057 0 0 0 112179 32 0 0 20 0 1 0 24688071 739909632 176440 33554432000 4194304 5796924 140733203590448 140733203586664 4805651 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 180642 176440 144 392 0 180241 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 722568

[startup+1182.3 s]
/proc/loadavg: 2.09 2.17 2.17 3/175 4357
/proc/meminfo: memFree=28379656/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=729516 CPUtime=1182.1 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 155794 0 0 0 118178 32 0 0 20 0 1 0 24688071 747024384 178688 33554432000 4194304 5796924 140733203590448 140733203586664 4809136 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 182379 178688 144 392 0 181978 0
Current children cumulated CPU time (s) 1182.1
Current children cumulated vsize (KiB) 729516

[startup+1242.3 s]
/proc/loadavg: 2.14 2.17 2.17 3/175 4358
/proc/meminfo: memFree=28362164/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=736344 CPUtime=1242.09 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 157522 0 0 0 124177 32 0 0 20 0 1 0 24688071 754016256 181438 33554432000 4194304 5796924 140733203590448 140733203586664 4865685 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 184086 181438 144 392 0 183685 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 736344

[startup+1302.3 s]
/proc/loadavg: 2.11 2.15 2.16 3/175 4359
/proc/meminfo: memFree=28345904/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=764060 CPUtime=1302.08 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 159763 0 0 0 130175 33 0 0 20 0 1 0 24688071 782397440 184190 33554432000 4194304 5796924 140733203590448 140733203586664 5087650 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 191015 184190 144 392 0 190614 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 764060

[startup+1362.3 s]
/proc/loadavg: 2.12 2.15 2.16 3/175 4360
/proc/meminfo: memFree=28319408/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=800636 CPUtime=1362.08 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 168916 0 0 0 136173 35 0 0 20 0 1 0 24688071 819851264 194365 33554432000 4194304 5796924 140733203590448 140733203143240 5087772 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 200159 194365 144 392 0 199758 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 800636

[startup+1422.3 s]
/proc/loadavg: 2.15 2.15 2.16 3/176 4364
/proc/meminfo: memFree=27958736/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1056320 CPUtime=1422.07 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 205513 0 0 0 142164 43 0 0 20 0 1 0 24688071 1081671680 257905 33554432000 4194304 5796924 140733203590448 140733203587432 5087632 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 264080 257905 191 392 0 263679 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 1056320

[startup+1482.3 s]
/proc/loadavg: 2.14 2.15 2.16 3/175 4366
/proc/meminfo: memFree=27886232/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1142240 CPUtime=1482.05 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 215867 0 0 0 148160 45 0 0 20 0 1 0 24688071 1169653760 275413 33554432000 4194304 5796924 140733203590448 140733203587432 5077891 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 285560 275413 191 392 0 285159 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 1142240

[startup+1542.31 s]
/proc/loadavg: 2.17 2.16 2.16 3/175 4367
/proc/meminfo: memFree=27637536/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1357692 CPUtime=1542.05 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 228095 0 0 0 154152 53 0 0 20 0 1 0 24688071 1390276608 334884 33554432000 4194304 5796924 140733203590448 140733203587432 5087747 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 339423 334884 191 392 0 339022 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 1357692

[startup+1602.3 s]
/proc/loadavg: 2.31 2.19 2.17 3/175 4368
/proc/meminfo: memFree=27527936/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1496180 CPUtime=1602.04 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 245737 0 0 0 160148 56 0 0 20 0 1 0 24688071 1532088320 359680 33554432000 4194304 5796924 140733203590448 140733203587432 5092467 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 374045 359680 191 392 0 373644 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 1496180

[startup+1662.3 s]
/proc/loadavg: 2.23 2.19 2.17 3/175 4369
/proc/meminfo: memFree=27372900/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1551488 CPUtime=1662.03 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 259572 0 0 0 166144 59 0 0 20 0 1 0 24688071 1588723712 379647 33554432000 4194304 5796924 140733203590448 140733203587432 5096576 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 387872 379647 191 392 0 387471 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 1551488

[startup+1722.3 s]
/proc/loadavg: 2.22 2.19 2.18 4/175 4370
/proc/meminfo: memFree=27265360/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1711376 CPUtime=1722.01 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 273861 0 0 0 172138 63 0 0 20 0 1 0 24688071 1752449024 400068 33554432000 4194304 5796924 140733203590448 140733203587432 5087682 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 427844 400068 191 392 0 427443 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 1711376

[startup+1782.3 s]
/proc/loadavg: 2.28 2.22 2.18 4/175 4372
/proc/meminfo: memFree=27171012/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1758104 CPUtime=1782.01 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 285565 0 0 0 178135 66 0 0 20 0 1 0 24688071 1800298496 418926 33554432000 4194304 5796924 140733203590448 140733203500360 4808163 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 439526 418926 191 392 0 439125 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 1758104



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.20 2.20 2.18 3/175 4372
/proc/meminfo: memFree=27119488/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1799420 CPUtime=1800.01 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) R 4277 4280 386 0 -1 4202496 295876 0 0 0 179933 68 0 0 20 0 1 0 24688071 1842606080 430770 33554432000 4194304 5796924 140733203590448 140733203587432 5077866 0 0 4096 17954 0 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 449855 430770 191 392 0 449454 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1799420

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -4280
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 4280 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.20 2.20 2.18 2/175 4372
/proc/meminfo: memFree=27119488/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1799420 CPUtime=1800.01 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) S 4277 4280 386 0 -1 4194304 295877 0 0 0 179933 68 0 0 20 0 1 0 24688071 1842606080 430771 33554432000 4194304 5796924 140733203590448 140733203586632 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 449855 430771 192 392 0 449454 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1799420

[startup+1802 s]
/proc/loadavg: 2.20 2.20 2.18 2/175 4372
/proc/meminfo: memFree=27117440/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1799420 CPUtime=1800.01 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) S 4277 4280 386 0 -1 4194304 295877 0 0 0 179933 68 0 0 20 0 1 0 24688071 1842606080 430771 33554432000 4194304 5796924 140733203590448 140733203586632 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 449855 430771 192 392 0 449454 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1799420

[startup+1802.2 s]
/proc/loadavg: 2.20 2.20 2.18 2/175 4372
/proc/meminfo: memFree=27117440/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1799420 CPUtime=1800.01 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) S 4277 4280 386 0 -1 4194304 295877 0 0 0 179933 68 0 0 20 0 1 0 24688071 1842606080 430771 33554432000 4194304 5796924 140733203590448 140733203586632 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 449855 430771 192 392 0 449454 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1799420

[startup+1802.3 s]
/proc/loadavg: 2.20 2.20 2.18 2/175 4372
/proc/meminfo: memFree=27117440/32872528 swapFree=1316768/1463936
[pid=4280] ppid=4277 vsize=1799420 CPUtime=1800.01 cores=0,2,4,6
/proc/4280/stat : 4280 (naps-1.02) S 4277 4280 386 0 -1 4194304 295877 0 0 0 179933 68 0 0 20 0 1 0 24688071 1842606080 430771 33554432000 4194304 5796924 140733203590448 140733203586632 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 0 0 0 0 0 0
/proc/4280/statm: 449855 430771 192 392 0 449454 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1799420

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.36
CPU time (s): 1800.08
CPU user time (s): 1799.34
CPU system time (s): 0.739887
CPU usage (%): 99.8733
Max. virtual memory (cumulated for all children) (KiB): 1799420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.34
system time used= 0.739887
maximum resident set size= 1723084
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 295877
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11
involuntary context switches= 3261

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.89426 second user time and 7.35388 second system time

The end

Launcher Data 

Begin job on node121 at 2016-06-18 07:06:51
IDJOB=4101259
IDBENCH=1720
IDSOLVER=2544
FILE ID=node121/4101259-1466226411
RUNJOBID= node121-1466206085-402
PBS_JOBID= 19918156
Free space on /tmp= 71696 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-reduced-mps-v2-20-10-fit2p.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4101259-1466226411/watcher-4101259-1466226411 -o /tmp/evaluation-result-4101259-1466226411/solver-4101259-1466226411 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node121-1466206085-402 --watchdog 1960  naps-1.02 HOME/instance-4101259-1466226411.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ea34bf390bf77663918ceca8ccc177b4
RANDOM SEED=2038864160

node121.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28384508 kB
Buffers:          111788 kB
Cached:           182464 kB
SwapCached:         1900 kB
Active:          2071148 kB
Inactive:         204752 kB
Active(anon):    1981192 kB
Inactive(anon):     2792 kB
Active(file):      89956 kB
Inactive(file):   201960 kB
Unevictable:     1463936 kB
Mlocked:         1316768 kB
SwapTotal:      67108856 kB
SwapFree:       67101124 kB
Dirty:             23052 kB
Writeback:             0 kB
AnonPages:       3446172 kB
Mapped:             9720 kB
Shmem:                 0 kB
Slab:             610104 kB
SReclaimable:      54204 kB
SUnreclaim:       555900 kB
KernelStack:        1416 kB
PageTables:        10760 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3855704 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    765952 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71684 MiB
End job on node121 at 2016-06-18 07:36:54