Trace number 4110591

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NaPS 1.02? (TO) 1800.02 1802.3

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/warehouse/
normalized-capmq4_wcsp.wbo
MD5SUM5f4ca6e09dba08c0ec6d7d843609ae14
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmark
Best cost obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables90600
Total number of constraints180900
Number of soft constraints180300
Number of constraints which are clauses180300
Number of constraints which are cardinality constraints (but not clauses)600
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint300
Top cost 157287652
Min constraint cost 1
Max constraint cost 157287652
Sum of constraints costs 14157263284542
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 301
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4110591-1466346185/watcher-4110591-1466346185 -o /tmp/evaluation-result-4110591-1466346185/solver-4110591-1466346185 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node127-1466341816-3872 --watchdog 1960 naps-1.02 HOME/instance-4110591-1466346185.wbo 

pid=6136
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.15 2.21 2.18 2/176 6139
/proc/meminfo: memFree=30677472/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=6548 CPUtime=0 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 331 0 0 0 0 0 0 0 20 0 1 0 36665134 6705152 205 33554432000 4194304 5796924 140733769156112 140736181066920 5183584 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 1637 205 127 392 0 1236 0

[startup+0.100158 s]
/proc/loadavg: 2.15 2.21 2.18 2/176 6139
/proc/meminfo: memFree=30677472/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=10640 CPUtime=0.09 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 1327 0 0 0 9 0 0 0 20 0 1 0 36665134 10895360 1201 33554432000 4194304 5796924 140733769156112 140736181066920 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 2660 1202 127 392 0 2259 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 10640

[startup+0.2003 s]
/proc/loadavg: 2.15 2.21 2.18 2/176 6139
/proc/meminfo: memFree=30677472/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=15132 CPUtime=0.19 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 2419 0 0 0 19 0 0 0 20 0 1 0 36665134 15495168 2251 33554432000 4194304 5796924 140733769156112 140736181066920 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 3783 2251 127 392 0 3382 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 15132

[startup+0.300283 s]
/proc/loadavg: 2.15 2.21 2.18 2/176 6139
/proc/meminfo: memFree=30677472/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=19728 CPUtime=0.29 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 3531 0 0 0 29 0 0 0 20 0 1 0 36665134 20201472 3280 33554432000 4194304 5796924 140733769156112 140736181066920 4261421 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 4932 3280 127 392 0 4531 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 19728

[startup+0.700218 s]
/proc/loadavg: 2.15 2.21 2.18 2/176 6139
/proc/meminfo: memFree=30677472/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=37100 CPUtime=0.69 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 7806 0 0 0 68 1 0 0 20 0 1 0 36665134 37990400 7363 33554432000 4194304 5796924 140733769156112 140733769153576 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 9275 7363 127 392 0 8874 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 37100

[startup+1.50027 s]
/proc/loadavg: 2.15 2.21 2.18 3/177 6140
/proc/meminfo: memFree=30630448/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=72036 CPUtime=1.49 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 15449 0 0 0 146 3 0 0 20 0 1 0 36665134 73764864 16035 33554432000 4194304 5796924 140733769156112 140733769155336 5183584 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 18009 16035 130 392 0 17608 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 72036

[startup+3.10027 s]
/proc/loadavg: 2.14 2.20 2.18 3/177 6140
/proc/meminfo: memFree=30586984/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=149804 CPUtime=3.09 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 35732 0 0 0 302 7 0 0 20 0 1 0 36665134 153399296 35759 33554432000 4194304 5796924 140733769156112 140733769155480 4316861 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 37451 35759 142 392 0 37050 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 149804

[startup+6.30029 s]
/proc/loadavg: 2.14 2.20 2.18 3/177 6140
/proc/meminfo: memFree=30379668/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262216 CPUtime=6.29 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72560 0 0 0 616 13 0 0 20 0 1 0 36665134 268509184 59086 33554432000 4194304 5796924 140733769156112 140733769152664 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65554 59086 150 392 0 65153 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 262216

[startup+12.7003 s]
/proc/loadavg: 2.12 2.20 2.18 3/177 6140
/proc/meminfo: memFree=30440196/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262216 CPUtime=12.69 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72586 0 0 0 1256 13 0 0 20 0 1 0 36665134 268509184 59112 33554432000 4194304 5796924 140733769156112 140733769150808 5092416 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65554 59112 150 392 0 65153 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 262216

[startup+25.5004 s]
/proc/loadavg: 2.17 2.21 2.18 3/177 6140
/proc/meminfo: memFree=30440640/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262216 CPUtime=25.49 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72586 0 0 0 2536 13 0 0 20 0 1 0 36665134 268509184 59112 33554432000 4194304 5796924 140733769156112 140733769150808 4839552 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65554 59112 150 392 0 65153 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 262216

[startup+51.1004 s]
/proc/loadavg: 2.11 2.19 2.17 4/177 6140
/proc/meminfo: memFree=30440616/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262216 CPUtime=51.08 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72586 0 0 0 5095 13 0 0 20 0 1 0 36665134 268509184 59112 33554432000 4194304 5796924 140733769156112 140733769150808 5100089 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65554 59112 150 392 0 65153 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 262216

[startup+102.3 s]
/proc/loadavg: 2.27 2.22 2.18 3/177 6141
/proc/meminfo: memFree=30436284/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262216 CPUtime=102.28 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72591 0 0 0 10215 13 0 0 20 0 1 0 36665134 268509184 60154 33554432000 4194304 5796924 140733769156112 140733769150808 5096620 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65554 60154 151 392 0 65153 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 262216

[startup+162.3 s]
/proc/loadavg: 2.21 2.21 2.18 3/177 6143
/proc/meminfo: memFree=30432552/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262216 CPUtime=162.26 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72595 0 0 0 16213 13 0 0 20 0 1 0 36665134 268509184 60813 33554432000 4194304 5796924 140733769156112 140733769150808 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65554 60813 151 392 0 65153 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 262216

[startup+222.307 s]
/proc/loadavg: 2.15 2.19 2.18 3/177 6144
/proc/meminfo: memFree=30432556/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262216 CPUtime=222.26 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72599 0 0 0 22213 13 0 0 20 0 1 0 36665134 268509184 60817 33554432000 4194304 5796924 140733769156112 140733769150808 5077853 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65554 60817 151 392 0 65153 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 262216

[startup+282.3 s]
/proc/loadavg: 2.16 2.19 2.18 3/177 6145
/proc/meminfo: memFree=30432328/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=262676 CPUtime=282.24 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72661 0 0 0 28211 13 0 0 20 0 1 0 36665134 268980224 60879 33554432000 4194304 5796924 140733769156112 140733769150696 5087664 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65669 60879 151 392 0 65268 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 262676

[startup+342.3 s]
/proc/loadavg: 2.24 2.21 2.18 3/177 6146
/proc/meminfo: memFree=30431268/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=342.23 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72866 0 0 0 34210 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4865554 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 263404

[startup+402.3 s]
/proc/loadavg: 2.22 2.20 2.18 3/177 6147
/proc/meminfo: memFree=30431016/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=402.22 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72866 0 0 0 40209 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 263404

[startup+462.3 s]
/proc/loadavg: 2.17 2.19 2.18 3/178 6152
/proc/meminfo: memFree=30431368/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=462.21 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72866 0 0 0 46208 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4296045 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 263404

[startup+522.3 s]
/proc/loadavg: 2.21 2.20 2.18 3/177 6153
/proc/meminfo: memFree=30431364/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=522.2 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72866 0 0 0 52207 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 5100093 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 263404

[startup+582.3 s]
/proc/loadavg: 2.13 2.18 2.17 3/177 6154
/proc/meminfo: memFree=30431120/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=582.2 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72866 0 0 0 58207 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4809393 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 263404


################
# More data... #
################

[pid=6139] ppid=6136 vsize=263404 CPUtime=1122.11 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 112198 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4809377 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 263404

[startup+1182.3 s]
/proc/loadavg: 2.13 2.17 2.17 4/177 6169
/proc/meminfo: memFree=30430548/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1182.1 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 118197 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1182.1
Current children cumulated vsize (KiB) 263404

[startup+1242.3 s]
/proc/loadavg: 2.22 2.18 2.18 3/177 6170
/proc/meminfo: memFree=30430052/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1242.09 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 124196 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4806764 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 263404

[startup+1302.3 s]
/proc/loadavg: 2.14 2.16 2.17 4/177 6171
/proc/meminfo: memFree=30430040/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1302.09 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 130196 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 5087743 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 263404

[startup+1362.3 s]
/proc/loadavg: 2.09 2.14 2.16 3/177 6172
/proc/meminfo: memFree=30429912/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1362.08 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 136195 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 5092450 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 263404

[startup+1422.3 s]
/proc/loadavg: 2.21 2.16 2.17 4/177 6174
/proc/meminfo: memFree=30429908/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1422.07 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 142194 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4839574 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 263404

[startup+1482.3 s]
/proc/loadavg: 2.18 2.16 2.17 3/177 6175
/proc/meminfo: memFree=30430020/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1482.06 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 148193 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 263404

[startup+1542.31 s]
/proc/loadavg: 2.26 2.18 2.17 3/177 6176
/proc/meminfo: memFree=27714216/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1542.06 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 154193 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4295944 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1542.06
Current children cumulated vsize (KiB) 263404

[startup+1602.3 s]
/proc/loadavg: 2.16 2.17 2.17 3/177 6177
/proc/meminfo: memFree=27517528/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1602.04 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 160191 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 5087606 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 263404

[startup+1662.3 s]
/proc/loadavg: 2.06 2.14 2.16 3/178 6181
/proc/meminfo: memFree=27497476/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1662.03 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 166190 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 5087606 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 263404

[startup+1722.3 s]
/proc/loadavg: 2.08 2.12 2.15 3/177 6183
/proc/meminfo: memFree=27476820/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1722.02 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 172189 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 5100064 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 263404

[startup+1782.3 s]
/proc/loadavg: 1.95 2.08 2.14 3/170 6215
/proc/meminfo: memFree=30443844/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1782.01 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 178188 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4809164 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 263404



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 1.68 2.01 2.11 2/170 6215
/proc/meminfo: memFree=30444888/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1800.01 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) R 6136 6139 3856 0 -1 4202496 72867 0 0 0 179988 13 0 0 20 0 1 0 36665134 269725696 61084 33554432000 4194304 5796924 140733769156112 140733769150696 4865554 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61084 151 392 0 65450 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 263404

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -6139
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6139 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 1.68 2.01 2.11 1/170 6215
/proc/meminfo: memFree=30444892/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1800.01 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) S 6136 6139 3856 0 -1 4194304 72868 0 0 0 179988 13 0 0 20 0 1 0 36665134 269725696 61085 33554432000 4194304 5796924 140733769156112 140733769149640 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61085 152 392 0 65450 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 263404

[startup+1802 s]
/proc/loadavg: 1.68 2.01 2.11 1/170 6215
/proc/meminfo: memFree=30444892/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1800.01 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) S 6136 6139 3856 0 -1 4194304 72868 0 0 0 179988 13 0 0 20 0 1 0 36665134 269725696 61085 33554432000 4194304 5796924 140733769156112 140733769149640 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61085 152 392 0 65450 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 263404

[startup+1802.2 s]
/proc/loadavg: 1.68 2.01 2.11 1/170 6215
/proc/meminfo: memFree=30444892/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1800.01 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) S 6136 6139 3856 0 -1 4194304 72868 0 0 0 179988 13 0 0 20 0 1 0 36665134 269725696 61085 33554432000 4194304 5796924 140733769156112 140733769149640 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61085 152 392 0 65450 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 263404

[startup+1802.3 s]
/proc/loadavg: 1.68 2.01 2.11 1/170 6215
/proc/meminfo: memFree=30444892/32872528 swapFree=1191052/1305516
[pid=6139] ppid=6136 vsize=263404 CPUtime=1800.01 cores=0,2,4,6
/proc/6139/stat : 6139 (naps-1.02) S 6136 6139 3856 0 -1 4194304 72868 0 0 0 179988 13 0 0 20 0 1 0 36665134 269725696 61085 33554432000 4194304 5796924 140733769156112 140733769149640 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/6139/statm: 65851 61085 152 392 0 65450 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 263404

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.3
CPU time (s): 1800.02
CPU user time (s): 1799.88
CPU system time (s): 0.139978
CPU usage (%): 99.8736
Max. virtual memory (cumulated for all children) (KiB): 316720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.88
system time used= 0.139978
maximum resident set size= 297164
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 72868
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 1852

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.51316 second user time and 7.8548 second system time

The end

Launcher Data 

Begin job on node127 at 2016-06-19 16:23:05
IDJOB=4110591
IDBENCH=79540
IDSOLVER=2554
FILE ID=node127/4110591-1466346185
RUNJOBID= node127-1466341816-3872
PBS_JOBID= 19922026
Free space on /tmp= 71728 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/warehouse/normalized-capmq4_wcsp.wbo
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4110591-1466346185/watcher-4110591-1466346185 -o /tmp/evaluation-result-4110591-1466346185/solver-4110591-1466346185 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node127-1466341816-3872 --watchdog 1960  naps-1.02 HOME/instance-4110591-1466346185.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5f4ca6e09dba08c0ec6d7d843609ae14
RANDOM SEED=637333876

node127.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.769
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30677628 kB
Buffers:           42904 kB
Cached:            97780 kB
SwapCached:          572 kB
Active:            78272 kB
Inactive:          75032 kB
Active(anon):      11524 kB
Inactive(anon):     3028 kB
Active(file):      66748 kB
Inactive(file):    72004 kB
Unevictable:     1305516 kB
Mlocked:         1191052 kB
SwapTotal:      67108856 kB
SwapFree:       67100332 kB
Dirty:             14404 kB
Writeback:             0 kB
AnonPages:       1317208 kB
Mapped:             7848 kB
Shmem:                 0 kB
Slab:             602604 kB
SReclaimable:      46752 kB
SUnreclaim:       555852 kB
KernelStack:        1456 kB
PageTables:         6768 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1436708 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    114688 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71728 MiB
End job on node127 at 2016-06-19 16:53:07