Trace number 4082241

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.08 1800.4

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-blend.opb
MD5SUMeff6ad715055e79721cc364806b971f0
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1295806500506
Best CPU time to get the best result obtained on this benchmark1800.11
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 0
Optimality of the best value was proved NO
Number of variables2490
Total number of constraints74
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints74
Minimum length of a constraint30
Maximum length of a constraint780
Number of terms in the objective function 660
Biggest coefficient in the objective function 14388140441600
Number of bits for the biggest coefficient in the objective function 44
Sum of the numbers in the objective function 203610440670021
Number of bits of the sum of numbers in the objective function 48
Biggest number in a constraint 78436840243200
Number of bits of the biggest number in a constraint 47
Biggest sum of numbers in a constraint 789015556311444
Number of bits of the biggest sum of numbers50
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.
1800.07/1800.40	c 
1800.07/1800.40	c *** TERMINATED *** by signal 15
1800.07/1800.40	s UNKNOWN
1800.07/1800.40	c _____________________________________________________________________________
1800.07/1800.40	c 
1800.07/1800.40	c std/band forms        : 10,37
1800.07/1800.40	c 2cl/3cl ITE-codings   : 0,0
1800.07/1800.40	c BDD/srt/adr Max costs : 87393,136031,4190
1800.07/1800.40	c BDDraw/bin/mul/srt/adr: 8,0,26,9,3
1800.07/1800.40	c BDD nodes             : 2000502
1800.07/1800.40	c Es1/CC detections     : 0,0
1800.07/1800.40	c SAT/UNSAT calls       : 0,0
1800.07/1800.40	c restarts              : 0
1800.07/1800.40	c conflicts             : 0              (0 /sec)
1800.07/1800.40	c decisions             : 0              (0 /sec)
1800.07/1800.40	c propagations          : 0              (0 /sec)
1800.07/1800.40	c inspects              : 0              (0 /sec)
1800.07/1800.40	c CPU time (solving tm) : 1800 s        (0 s)
1800.07/1800.40	c Time for Opt-base     : 1713 s
1800.07/1800.40	c _____________________________________________________________________________

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4082241-1465240312/watcher-4082241-1465240312 -o /tmp/evaluation-result-4082241-1465240312/solver-4082241-1465240312 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1465240311-14492 --watchdog 1960 naps-1.02 HOME/instance-4082241-1465240312.opb 

pid=14518
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.05 1.04 1.26 3/176 14521
/proc/meminfo: memFree=31866384/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=6840 CPUtime=0 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 410 0 0 0 0 0 0 0 20 0 1 0 105966490 7004160 285 33554432000 4194304 5796924 140734392754704 140733955602072 4404174 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/14521/statm: 1710 285 128 392 0 1309 0

[startup+0.100161 s]
/proc/loadavg: 1.05 1.04 1.26 3/176 14521
/proc/meminfo: memFree=31866384/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=9788 CPUtime=0.09 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 1111 0 0 0 9 0 0 0 20 0 1 0 105966490 10022912 986 33554432000 4194304 5796924 140734392754704 140733955602072 5095032 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/14521/statm: 2447 986 128 392 0 2046 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9788

[startup+0.200293 s]
/proc/loadavg: 1.05 1.04 1.26 3/176 14521
/proc/meminfo: memFree=31866384/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=10476 CPUtime=0.19 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 1309 0 0 0 19 0 0 0 20 0 1 0 105966490 10727424 1169 33554432000 4194304 5796924 140734392754704 140733955602072 4806764 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/14521/statm: 2619 1169 140 392 0 2218 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 10476

[startup+0.3003 s]
/proc/loadavg: 1.05 1.04 1.26 3/176 14521
/proc/meminfo: memFree=31866384/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=10476 CPUtime=0.29 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 1329 0 0 0 29 0 0 0 20 0 1 0 105966490 10727424 1189 33554432000 4194304 5796924 140734392754704 140733955602072 5100490 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/14521/statm: 2619 1189 140 392 0 2218 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 10476

[startup+0.70024 s]
/proc/loadavg: 1.05 1.04 1.26 3/176 14521
/proc/meminfo: memFree=31866384/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=10928 CPUtime=0.68 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 1414 0 0 0 68 0 0 0 20 0 1 0 105966490 11190272 1274 33554432000 4194304 5796924 140734392754704 140734392748424 4313403 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/14521/statm: 2732 1274 140 392 0 2331 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 10928

[startup+1.50023 s]
/proc/loadavg: 1.05 1.04 1.26 3/177 14522
/proc/meminfo: memFree=31832724/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=10928 CPUtime=1.48 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 1419 0 0 0 148 0 0 0 20 0 1 0 105966490 11190272 1279 33554432000 4194304 5796924 140734392754704 140734392748424 5087488 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/14521/statm: 2732 1279 140 392 0 2331 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 10928

[startup+3.10023 s]
/proc/loadavg: 1.13 1.06 1.26 3/177 14522
/proc/meminfo: memFree=31829004/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=10928 CPUtime=3.08 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 1432 0 0 0 308 0 0 0 20 0 1 0 105966490 11190272 1292 33554432000 4194304 5796924 140734392754704 140734392748424 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 2732 1292 140 392 0 2331 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 10928

[startup+6.30023 s]
/proc/loadavg: 1.13 1.06 1.26 3/177 14522
/proc/meminfo: memFree=31811720/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=10928 CPUtime=6.28 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 1441 0 0 0 628 0 0 0 20 0 1 0 105966490 11190272 1301 33554432000 4194304 5796924 140734392754704 140734392748424 5087664 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 2732 1301 140 392 0 2331 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 10928

[startup+12.7002 s]
/proc/loadavg: 1.26 1.09 1.27 3/177 14522
/proc/meminfo: memFree=31513452/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=254108 CPUtime=12.67 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 62464 0 0 0 1261 6 0 0 20 0 1 0 105966490 260206592 62067 33554432000 4194304 5796924 140734392754704 140734392483048 4805616 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 63527 62067 145 392 0 63126 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 254108

[startup+25.5003 s]
/proc/loadavg: 1.37 1.12 1.28 3/177 14522
/proc/meminfo: memFree=31452288/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=258484 CPUtime=25.47 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 63325 0 0 0 2540 7 0 0 20 0 1 0 105966490 264687616 62928 33554432000 4194304 5796924 140734392754704 140734392749272 5087766 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 64621 62928 145 392 0 64220 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 258484

[startup+51.1003 s]
/proc/loadavg: 1.59 1.19 1.30 3/177 14522
/proc/meminfo: memFree=31452548/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=259400 CPUtime=51.07 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 63594 0 0 0 5100 7 0 0 20 0 1 0 105966490 265625600 63197 33554432000 4194304 5796924 140734392754704 140734392750920 4805636 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 64850 63197 151 392 0 64449 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 259400

[startup+102.3 s]
/proc/loadavg: 1.83 1.32 1.33 3/177 14523
/proc/meminfo: memFree=31443212/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=267352 CPUtime=102.26 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 64405 0 0 0 10219 7 0 0 20 0 1 0 105966490 273768448 65030 33554432000 4194304 5796924 140734392754704 140734392749320 5096553 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 66838 65030 151 392 0 66437 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 267352

[startup+162.3 s]
/proc/loadavg: 1.93 1.43 1.37 3/177 14525
/proc/meminfo: memFree=31451716/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=256228 CPUtime=162.25 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 64405 0 0 0 16218 7 0 0 20 0 1 0 105966490 262377472 62504 33554432000 4194304 5796924 140734392754704 140734392750920 5092487 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 64057 62504 151 392 0 63656 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 256228

[startup+222.307 s]
/proc/loadavg: 1.97 1.54 1.41 3/177 14526
/proc/meminfo: memFree=31444596/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=263408 CPUtime=222.24 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 65380 0 0 0 22217 7 0 0 20 0 1 0 105966490 269729792 64224 33554432000 4194304 5796924 140734392754704 140734392750920 5087650 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 65852 64224 151 392 0 65451 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 263408

[startup+282.3 s]
/proc/loadavg: 1.99 1.62 1.44 3/177 14527
/proc/meminfo: memFree=31444592/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=263408 CPUtime=282.22 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 65606 0 0 0 28215 7 0 0 20 0 1 0 105966490 269729792 64439 33554432000 4194304 5796924 140734392754704 140734392750920 4865620 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 65852 64439 151 392 0 65451 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 263408

[startup+342.3 s]
/proc/loadavg: 1.99 1.69 1.47 3/177 14528
/proc/meminfo: memFree=31443320/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=263408 CPUtime=342.2 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 65703 0 0 0 34212 8 0 0 20 0 1 0 105966490 269729792 64518 33554432000 4194304 5796924 140734392754704 140734392750920 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 65852 64518 191 392 0 65451 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 263408

[startup+402.3 s]
/proc/loadavg: 1.99 1.74 1.50 3/177 14529
/proc/meminfo: memFree=31444456/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=266188 CPUtime=402.19 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 65911 0 0 0 40211 8 0 0 20 0 1 0 105966490 272576512 64713 33554432000 4194304 5796924 140734392754704 140734391679672 4805613 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 66547 64713 191 392 0 66146 0
Current children cumulated CPU time (s) 402.19
Current children cumulated vsize (KiB) 266188

[startup+462.3 s]
/proc/loadavg: 2.07 1.80 1.54 3/177 14531
/proc/meminfo: memFree=31412516/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=297228 CPUtime=462.18 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 69675 0 0 0 46209 9 0 0 20 0 1 0 105966490 304361472 72484 33554432000 4194304 5796924 140734392754704 140734392749192 4295774 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 74307 72484 191 392 0 73906 0
Current children cumulated CPU time (s) 462.18
Current children cumulated vsize (KiB) 297228

[startup+522.3 s]
/proc/loadavg: 2.03 1.83 1.56 3/178 14535
/proc/meminfo: memFree=31340852/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=367660 CPUtime=522.16 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 91689 0 0 0 52204 12 0 0 20 0 1 0 105966490 376483840 90275 33554432000 4194304 5796924 140734392754704 140734392749272 5096706 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 91915 90275 191 392 0 91514 0
Current children cumulated CPU time (s) 522.16
Current children cumulated vsize (KiB) 367660

[startup+582.3 s]
/proc/loadavg: 2.06 1.88 1.59 3/177 14536
/proc/meminfo: memFree=31330804/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=377024 CPUtime=582.15 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93190 0 0 0 58203 12 0 0 20 0 1 0 105966490 386072576 92798 33554432000 4194304 5796924 140734392754704 140734392749192 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 94256 92798 191 392 0 93855 0
Current children cumulated CPU time (s) 582.15
Current children cumulated vsize (KiB) 377024


################
# More data... #
################


[startup+882.307 s]
/proc/loadavg: 2.07 1.96 1.70 3/177 14542
/proc/meminfo: memFree=31323812/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=385216 CPUtime=882.11 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93412 0 0 0 88199 12 0 0 20 0 1 0 105966490 394461184 94553 33554432000 4194304 5796924 140734392754704 140734392749272 5100093 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 96304 94553 191 392 0 95903 0
Current children cumulated CPU time (s) 882.11
Current children cumulated vsize (KiB) 385216

[startup+942.3 s]
/proc/loadavg: 2.16 2.00 1.72 3/177 14543
/proc/meminfo: memFree=31323452/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=385216 CPUtime=942.09 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93412 0 0 0 94197 12 0 0 20 0 1 0 105966490 394461184 94553 33554432000 4194304 5796924 140734392754704 140734392749272 5087637 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 96304 94553 191 392 0 95903 0
Current children cumulated CPU time (s) 942.09
Current children cumulated vsize (KiB) 385216

[startup+1002.3 s]
/proc/loadavg: 2.06 2.00 1.74 3/177 14544
/proc/meminfo: memFree=31323692/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=385216 CPUtime=1002.1 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93412 0 0 0 100197 13 0 0 20 0 1 0 105966490 394461184 94553 33554432000 4194304 5796924 140734392754704 140734392749272 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 96304 94553 191 392 0 95903 0
Current children cumulated CPU time (s) 1002.1
Current children cumulated vsize (KiB) 385216

[startup+1062.3 s]
/proc/loadavg: 2.09 2.01 1.75 3/177 14545
/proc/meminfo: memFree=31323440/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=385216 CPUtime=1062.09 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93412 0 0 0 106196 13 0 0 20 0 1 0 105966490 394461184 94553 33554432000 4194304 5796924 140734392754704 140734392749272 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 96304 94553 191 392 0 95903 0
Current children cumulated CPU time (s) 1062.09
Current children cumulated vsize (KiB) 385216

[startup+1122.3 s]
/proc/loadavg: 2.03 2.01 1.77 3/178 14550
/proc/meminfo: memFree=31323000/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=385216 CPUtime=1122.08 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93412 0 0 0 112195 13 0 0 20 0 1 0 105966490 394461184 94553 33554432000 4194304 5796924 140734392754704 140734392749272 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 96304 94553 191 392 0 95903 0
Current children cumulated CPU time (s) 1122.08
Current children cumulated vsize (KiB) 385216

[startup+1182.3 s]
/proc/loadavg: 2.01 2.00 1.78 3/177 14551
/proc/meminfo: memFree=31344540/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=361516 CPUtime=1182.07 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93412 0 0 0 118194 13 0 0 20 0 1 0 105966490 370192384 88998 33554432000 4194304 5796924 140734392754704 140734392750920 5087499 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 90379 88998 191 392 0 89978 0
Current children cumulated CPU time (s) 1182.07
Current children cumulated vsize (KiB) 361516

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 1.79 3/177 14552
/proc/meminfo: memFree=31344660/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=361516 CPUtime=1242.06 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93412 0 0 0 124193 13 0 0 20 0 1 0 105966490 370192384 88998 33554432000 4194304 5796924 140734392754704 140734392750920 5092651 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 90379 88998 191 392 0 89978 0
Current children cumulated CPU time (s) 1242.06
Current children cumulated vsize (KiB) 361516

[startup+1302.3 s]
/proc/loadavg: 2.06 2.01 1.81 3/177 14553
/proc/meminfo: memFree=31344052/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=361772 CPUtime=1302.05 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93413 0 0 0 130192 13 0 0 20 0 1 0 105966490 370454528 88999 33554432000 4194304 5796924 140734392754704 140734392748504 5087650 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 90443 88999 191 392 0 90042 0
Current children cumulated CPU time (s) 1302.05
Current children cumulated vsize (KiB) 361772

[startup+1362.3 s]
/proc/loadavg: 2.02 2.01 1.82 3/177 14554
/proc/meminfo: memFree=31344056/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=361772 CPUtime=1362.04 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93415 0 0 0 136191 13 0 0 20 0 1 0 105966490 370454528 89001 33554432000 4194304 5796924 140734392754704 140734392748504 4806736 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 90443 89001 191 392 0 90042 0
Current children cumulated CPU time (s) 1362.04
Current children cumulated vsize (KiB) 361772

[startup+1422.3 s]
/proc/loadavg: 2.08 2.02 1.83 3/177 14556
/proc/meminfo: memFree=31344564/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=362100 CPUtime=1422.04 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93497 0 0 0 142191 13 0 0 20 0 1 0 105966490 370790400 89083 33554432000 4194304 5796924 140734392754704 140734392748424 4296060 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 90525 89083 191 392 0 90124 0
Current children cumulated CPU time (s) 1422.04
Current children cumulated vsize (KiB) 362100

[startup+1482.3 s]
/proc/loadavg: 2.03 2.01 1.84 3/177 14557
/proc/meminfo: memFree=31344688/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=362100 CPUtime=1482.02 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 93497 0 0 0 148189 13 0 0 20 0 1 0 105966490 370790400 89083 33554432000 4194304 5796924 140734392754704 140734392748424 4809336 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 90525 89083 191 392 0 90124 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 362100

[startup+1542.31 s]
/proc/loadavg: 2.08 2.02 1.85 3/176 14558
/proc/meminfo: memFree=31344084/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=363644 CPUtime=1542.01 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 105595 0 0 0 154186 15 0 0 20 0 1 0 105966490 372371456 89451 33554432000 4194304 5796924 140734392754704 140734392749272 5096591 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 90911 89451 191 392 0 90510 0
Current children cumulated CPU time (s) 1542.01
Current children cumulated vsize (KiB) 363644

[startup+1602.3 s]
/proc/loadavg: 2.03 2.02 1.85 3/177 14560
/proc/meminfo: memFree=31342464/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=364304 CPUtime=1602 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 105772 0 0 0 160185 15 0 0 20 0 1 0 105966490 373047296 89628 33554432000 4194304 5796924 140734392754704 140734392749192 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 91076 89628 191 392 0 90675 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 364304

[startup+1662.3 s]
/proc/loadavg: 2.07 2.03 1.86 3/177 14561
/proc/meminfo: memFree=31342720/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=364304 CPUtime=1661.99 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 105775 0 0 0 166184 15 0 0 20 0 1 0 105966490 373047296 89631 33554432000 4194304 5796924 140734392754704 140734392749192 4806956 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 91076 89631 191 392 0 90675 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 364304

[startup+1722.3 s]
/proc/loadavg: 2.02 2.02 1.87 3/178 14566
/proc/meminfo: memFree=31342396/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=364304 CPUtime=1721.99 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 105775 0 0 0 172183 16 0 0 20 0 1 0 105966490 373047296 89631 33554432000 4194304 5796924 140734392754704 140734392749192 4313497 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 91076 89631 191 392 0 90675 0
Current children cumulated CPU time (s) 1721.99
Current children cumulated vsize (KiB) 364304

[startup+1782.3 s]
/proc/loadavg: 2.01 2.02 1.88 3/177 14567
/proc/meminfo: memFree=31342020/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=364304 CPUtime=1781.98 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 105775 0 0 0 178182 16 0 0 20 0 1 0 105966490 373047296 89631 33554432000 4194304 5796924 140734392754704 140734392750920 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 91076 89631 191 392 0 90675 0
Current children cumulated CPU time (s) 1781.98
Current children cumulated vsize (KiB) 364304



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 2.01 1.88 3/177 14567
/proc/meminfo: memFree=31342516/32872528 swapFree=10608/190480
[pid=14521] ppid=14518 vsize=364304 CPUtime=1800.07 cores=1,3,5,7
/proc/14521/stat : 14521 (naps-1.02) R 14518 14521 14475 0 -1 4202496 105775 0 0 0 179991 16 0 0 20 0 1 0 105966490 373047296 89631 33554432000 4194304 5796924 140734392754704 140734392750920 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/14521/statm: 91076 89631 191 392 0 90675 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 364304

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 14521 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.4
CPU time (s): 1800.08
CPU user time (s): 1799.92
CPU system time (s): 0.161975
CPU usage (%): 99.9822
Max. virtual memory (cumulated for all children) (KiB): 409596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.92
system time used= 0.161975
maximum resident set size= 403944
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 105787
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 46
involuntary context switches= 2113

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.55516 second user time and 9.90849 second system time

The end

Launcher Data 

Begin job on node102 at 2016-06-06 21:11:52
IDJOB=4082241
IDBENCH=2462
IDSOLVER=2544
FILE ID=node102/4082241-1465240312
RUNJOBID= node102-1465240311-14492
PBS_JOBID= 19843244
Free space on /tmp= 71736 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-blend.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4082241-1465240312/watcher-4082241-1465240312 -o /tmp/evaluation-result-4082241-1465240312/solver-4082241-1465240312 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1465240311-14492 --watchdog 1960  naps-1.02 HOME/instance-4082241-1465240312.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eff6ad715055e79721cc364806b971f0
RANDOM SEED=8685970

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.470
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        31868888 kB
Buffers:           32264 kB
Cached:            77676 kB
SwapCached:         2308 kB
Active:            47484 kB
Inactive:          65872 kB
Active(anon):       4412 kB
Inactive(anon):     1568 kB
Active(file):      43072 kB
Inactive(file):    64304 kB
Unevictable:      190480 kB
Mlocked:           10608 kB
SwapTotal:      67108856 kB
SwapFree:       67098432 kB
Dirty:              8656 kB
Writeback:             0 kB
AnonPages:        193920 kB
Mapped:             7252 kB
Shmem:                 0 kB
Slab:             567104 kB
SReclaimable:      11100 kB
SUnreclaim:       556004 kB
KernelStack:        1400 kB
PageTables:         3960 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:     304792 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    180224 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71732 MiB
End job on node102 at 2016-06-06 21:41:52