Trace number 3349645

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: LR_GL_SHR 2011-03-02? (TO) 1300.19 1300.15

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUM6c2d25eda70423643946d76935ceb950
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1512832
Number of clauses8233086
Sum of the clauses size19530286
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 28165680
Number of clauses of size 31280
Number of clauses of size 41600
Number of clauses of size 51600
Number of clauses of size over 562080

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3349645-1304971023/watcher-3349645-1304971023 -o /tmp/evaluation-result-3349645-1304971023/solver-3349645-1304971023 -C 2400 -W 1300 -M 7680 HOME/lr_gl_shr HOME/instance-3349645-1304971023.cnf -verb=0 -model 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.53 2.26 2.91 3/333 11861
/proc/meminfo: memFree=26947648/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=24248 CPUtime=0 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 1396 0 0 0 0 0 0 0 22 0 1 0 608703237 24829952 1325 33554432000 4194304 4300056 140734533465040 18446744073709551615 244446945024 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 6062 1325 222 26 0 2694 0

[startup+0.098678 s]
/proc/loadavg: 1.53 2.26 2.91 3/333 11861
/proc/meminfo: memFree=26947648/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=30044 CPUtime=0.09 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 2868 0 0 0 9 0 0 0 22 0 1 0 608703237 30765056 2797 33554432000 4194304 4300056 140734533465040 18446744073709551615 244446606021 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 7511 2798 222 26 0 4143 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 30044

[startup+0.100674 s]
/proc/loadavg: 1.53 2.26 2.91 3/333 11861
/proc/meminfo: memFree=26947648/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=30308 CPUtime=0.09 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 2927 0 0 0 9 0 0 0 22 0 1 0 608703237 31035392 2856 33554432000 4194304 4300056 140734533465040 18446744073709551615 244446606021 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 7577 2857 222 26 0 4209 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 30308

[startup+0.300636 s]
/proc/loadavg: 1.53 2.26 2.91 3/333 11861
/proc/meminfo: memFree=26947648/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=54540 CPUtime=0.29 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 8495 0 0 0 27 2 0 0 23 0 1 0 608703237 55848960 8067 33554432000 4194304 4300056 140734533465040 18446744073709551615 244446606021 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 13635 8069 222 26 0 10267 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 54540

[startup+0.700565 s]
/proc/loadavg: 1.53 2.26 2.91 3/333 11861
/proc/meminfo: memFree=26947648/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=121256 CPUtime=0.69 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 25998 0 0 0 64 5 0 0 25 0 1 0 608703237 124166144 23107 33554432000 4194304 4300056 140734533465040 18446744073709551615 4241281 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 30314 23111 222 26 0 26946 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 121256

[startup+1.50044 s]
/proc/loadavg: 1.53 2.26 2.91 5/337 11868
/proc/meminfo: memFree=26782340/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=265068 CPUtime=1.48 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 59472 0 0 0 138 10 0 0 25 0 1 0 608703237 271429632 54017 33554432000 4194304 4300056 140734533465040 18446744073709551615 244446610968 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 66267 54018 222 26 0 62899 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 265068

[startup+3.10113 s]
/proc/loadavg: 1.53 2.26 2.91 5/337 11868
/proc/meminfo: memFree=26479408/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=553328 CPUtime=3.09 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 125560 0 0 0 286 23 0 0 25 0 1 0 608703237 566607872 114336 33554432000 4194304 4300056 140734533465040 18446744073709551615 244446606021 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 138332 114337 222 26 0 134964 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 553328

[startup+6.30053 s]
/proc/loadavg: 1.89 2.33 2.93 5/337 11868
/proc/meminfo: memFree=25789816/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=697664 CPUtime=6.29 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 171164 0 0 0 599 30 0 0 25 0 1 0 608703237 714407936 154743 33554432000 4194304 4300056 140734533465040 18446744073709551615 4230547 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 174416 154743 226 26 0 171048 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 697664

[startup+12.7003 s]
/proc/loadavg: 2.06 2.35 2.94 5/337 11868
/proc/meminfo: memFree=25698844/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=845316 CPUtime=12.69 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 192372 0 0 0 1235 34 0 0 25 0 1 0 608703237 865603584 175911 33554432000 4194304 4300056 140734533465040 18446744073709551615 4230678 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 211329 175911 228 26 0 207961 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 845316

[startup+25.501 s]
/proc/loadavg: 2.49 2.43 2.95 5/337 11868
/proc/meminfo: memFree=25902400/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=684224 CPUtime=25.49 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 227413 0 0 0 2508 41 0 0 25 0 1 0 608703237 700645376 150960 33554432000 4194304 4300056 140734533465040 18446744073709551615 4254711 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 171056 150960 246 26 0 167688 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 684224

[startup+51.1002 s]
/proc/loadavg: 3.00 2.56 2.98 5/337 11869
/proc/meminfo: memFree=25748680/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=765612 CPUtime=51.09 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 242712 0 0 0 5064 45 0 0 25 0 1 0 608703237 783986688 166246 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252384 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 191403 166246 247 26 0 188035 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 765612

[startup+102.313 s]
/proc/loadavg: 3.57 2.78 3.03 5/337 11870
/proc/meminfo: memFree=25456644/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=897872 CPUtime=102.3 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 270658 0 0 0 10181 49 0 0 25 0 1 0 608703237 919420928 194187 33554432000 4194304 4300056 140734533465040 18446744073709551615 4256227 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 224468 194187 247 26 0 221100 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 897872

[startup+162.301 s]
/proc/loadavg: 3.84 3.00 3.09 5/337 11872
/proc/meminfo: memFree=25068104/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=1112796 CPUtime=162.29 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 317044 0 0 0 16174 55 0 0 25 0 1 0 608703237 1139503104 240555 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252435 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 278199 240555 247 26 0 274831 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 1112796

[startup+222.3 s]
/proc/loadavg: 3.94 3.18 3.14 5/337 11873
/proc/meminfo: memFree=24727684/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=1462044 CPUtime=222.29 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 347305 0 0 0 22169 60 0 0 25 0 1 0 608703237 1497133056 270804 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252622 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 365511 270804 247 26 0 362143 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 1462044

[startup+282.3 s]
/proc/loadavg: 3.98 3.32 3.19 5/337 11884
/proc/meminfo: memFree=24397296/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=1462044 CPUtime=282.3 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 382323 0 0 0 28164 66 0 0 25 0 1 0 608703237 1497133056 305806 33554432000 4194304 4300056 140734533465040 18446744073709551615 4254713 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 365511 305806 247 26 0 362143 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 1462044

[startup+342.3 s]
/proc/loadavg: 4.08 3.47 3.25 5/337 11886
/proc/meminfo: memFree=24033564/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=1462044 CPUtime=342.3 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 423196 0 0 0 34158 72 0 0 25 0 1 0 608703237 1497133056 346670 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252414 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 365511 346670 247 26 0 362143 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 1462044

[startup+402.301 s]
/proc/loadavg: 4.03 3.57 3.29 5/337 11969
/proc/meminfo: memFree=24388052/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2029572 CPUtime=402.3 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 460307 0 0 0 40153 77 0 0 25 0 1 0 608703237 2078281728 383772 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252528 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 507393 383772 247 26 0 504025 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 2029572

[startup+462.301 s]
/proc/loadavg: 4.01 3.64 3.34 5/337 11973
/proc/meminfo: memFree=24145692/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2029572 CPUtime=462.31 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 494697 0 0 0 46147 84 0 0 25 0 1 0 608703237 2078281728 418156 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252414 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 507393 418156 247 26 0 504025 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 2029572

[startup+522.301 s]
/proc/loadavg: 4.08 3.73 3.38 5/337 12001
/proc/meminfo: memFree=23876328/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2029572 CPUtime=522.3 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 531205 0 0 0 52138 92 0 0 25 0 1 0 608703237 2078281728 454650 33554432000 4194304 4300056 140734533465040 18446744073709551615 4263584 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 507393 454662 247 26 0 504025 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 2029572

[startup+582.301 s]
/proc/loadavg: 4.07 3.79 3.42 5/337 12003
/proc/meminfo: memFree=23627764/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2029572 CPUtime=582.3 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 564354 0 0 0 58133 97 0 0 25 0 1 0 608703237 2078281728 487787 33554432000 4194304 4300056 140734533465040 18446744073709551615 4256040 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 507393 487787 247 26 0 504025 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 2029572

[startup+642.3 s]
/proc/loadavg: 4.02 3.83 3.46 5/337 12005
/proc/meminfo: memFree=23383808/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2951808 CPUtime=642.32 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 594743 0 0 0 64130 102 0 0 25 0 1 0 608703237 3022651392 518171 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252402 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 737952 518171 247 26 0 734584 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 2951808

[startup+702.3 s]
/proc/loadavg: 4.04 3.87 3.49 5/337 12006
/proc/meminfo: memFree=23120736/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2951808 CPUtime=702.31 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 630749 0 0 0 70124 107 0 0 25 0 1 0 608703237 3022651392 554162 33554432000 4194304 4300056 140734533465040 18446744073709551615 4256030 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 737952 554162 247 26 0 734584 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 2951808

[startup+762.312 s]
/proc/loadavg: 4.05 3.91 3.53 5/337 12008
/proc/meminfo: memFree=22871696/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2951808 CPUtime=762.33 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 663706 0 0 0 76120 113 0 0 25 0 1 0 608703237 3022651392 587110 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252676 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 737952 587110 247 26 0 734584 0
Current children cumulated CPU time (s) 762.33
Current children cumulated vsize (KiB) 2951808

[startup+822.301 s]
/proc/loadavg: 4.16 3.95 3.57 5/337 12009
/proc/meminfo: memFree=22636032/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2951808 CPUtime=822.32 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 694365 0 0 0 82114 118 0 0 25 0 1 0 608703237 3022651392 617758 33554432000 4194304 4300056 140734533465040 18446744073709551615 4256706 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 737952 617758 247 26 0 734584 0
Current children cumulated CPU time (s) 822.32
Current children cumulated vsize (KiB) 2951808

[startup+882.301 s]
/proc/loadavg: 4.12 3.97 3.60 5/337 12011
/proc/meminfo: memFree=22370988/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2951808 CPUtime=882.32 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 731474 0 0 0 88110 122 0 0 25 0 1 0 608703237 3022651392 654859 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252414 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 737952 654859 247 26 0 734584 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 2951808

[startup+942.301 s]
/proc/loadavg: 4.04 3.97 3.62 5/337 12013
/proc/meminfo: memFree=22122188/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=2951808 CPUtime=942.32 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 767743 0 0 0 94104 128 0 0 25 0 1 0 608703237 3022651392 691126 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252528 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 737952 691126 247 26 0 734584 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 2951808

[startup+1002.3 s]
/proc/loadavg: 4.01 3.97 3.64 5/337 12014
/proc/meminfo: memFree=21873008/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=4450440 CPUtime=1002.32 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 801648 0 0 0 100098 134 0 0 25 0 1 0 608703237 4557250560 725021 33554432000 4194304 4300056 140734533465040 18446744073709551615 4256511 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 1112610 725021 247 26 0 1109242 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 4450440

[startup+1062.3 s]
/proc/loadavg: 4.06 3.99 3.66 5/337 12016
/proc/meminfo: memFree=21640964/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=4450440 CPUtime=1062.32 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 834854 0 0 0 106093 139 0 0 25 0 1 0 608703237 4557250560 758211 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252370 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 1112610 758211 247 26 0 1109242 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 4450440

[startup+1122.3 s]
/proc/loadavg: 4.02 3.99 3.68 5/337 12017
/proc/meminfo: memFree=21390680/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=4450440 CPUtime=1122.32 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 868110 0 0 0 112086 146 0 0 25 0 1 0 608703237 4557250560 791453 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252659 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 1112610 791453 247 26 0 1109242 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 4450440

[startup+1182.3 s]
/proc/loadavg: 4.01 3.99 3.70 5/337 12019
/proc/meminfo: memFree=21159748/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=4450440 CPUtime=1182.33 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 896909 0 0 0 118082 151 0 0 25 0 1 0 608703237 4557250560 820243 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252402 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 1112610 820243 247 26 0 1109242 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 4450440

[startup+1242.3 s]
/proc/loadavg: 4.00 3.99 3.72 5/337 12048
/proc/meminfo: memFree=21104168/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=4450440 CPUtime=1242.33 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 925409 0 0 0 124075 158 0 0 25 0 1 0 608703237 4557250560 848730 33554432000 4194304 4300056 140734533465040 18446744073709551615 4264273 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 1112610 848730 247 26 0 1109242 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 4450440



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.92 3.97 3.73 4/332 12067
/proc/meminfo: memFree=22638532/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=4450440 CPUtime=1300.04 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4202496 957881 0 0 0 129839 165 0 0 25 0 1 0 608703237 4557250560 881193 33554432000 4194304 4300056 140734533465040 18446744073709551615 4252516 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/11861/statm: 1112610 881193 247 26 0 1109242 0
Current children cumulated CPU time (s) 1300.04
Current children cumulated vsize (KiB) 4450440

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.11 s]
/proc/loadavg: 3.92 3.97 3.73 4/333 12068
/proc/meminfo: memFree=25184492/32951124 swapFree=44485652/67111528
[pid=11861] ppid=11859 vsize=0 CPUtime=1300.16 cores=5,7
/proc/11861/stat : 11861 (lr_gl_shr) R 11859 11861 11366 0 -1 4203524 957881 0 0 0 129839 177 0 0 25 0 1 0 608703237 0 0 33554432000 0 0 0 0 0 0 0 4096 8388610 18446744073709551615 0 0 17 5 0 0 0
/proc/11861/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1300.16
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.15
CPU time (s): 1300.19
CPU user time (s): 1298.39
CPU system time (s): 1.79273
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 4450440

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1298.39
system time used= 1.79273
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 957881
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 783

runsolver used 4.11437 second user time and 10.0735 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-09 21:57:08
IDJOB=3349645
IDBENCH=82404
IDSOLVER=1813
FILE ID=node105/3349645-1304971023
RUNJOBID= node105-1304971023-11827
PBS_JOBID= 13285645
Free space on /tmp= 48356 MiB

SOLVER NAME= minisat hack: LR_GL_SHR 2011-03-02
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= HOME/lr_gl_shr BENCHNAME -verb=0 -model
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3349645-1304971023/watcher-3349645-1304971023 -o /tmp/evaluation-result-3349645-1304971023/solver-3349645-1304971023 -C 2400 -W 1300 -M 7680  HOME/lr_gl_shr HOME/instance-3349645-1304971023.cnf -verb=0 -model

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 6c2d25eda70423643946d76935ceb950
RANDOM SEED=640605786

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26945200 kB
Buffers:        142020 kB
Cached:        4113040 kB
SwapCached:      39280 kB
Active:         814212 kB
Inactive:      4949476 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26945200 kB
SwapTotal:    67111528 kB
SwapFree:     44485652 kB
Dirty:          443200 kB
Writeback:           0 kB
AnonPages:     1476744 kB
Mapped:          10736 kB
Slab:           111272 kB
PageTables:      67472 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 65695532 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 48444 MiB
End job on node105 at 2011-05-09 22:18:50