Trace number 3349582

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: LR_GL_SHR 2011-03-02? (TO) 1300.09 1300.05

General information on the benchmark

Nameindustrial/anbulagan/
hard-sat/partial-10-17-s.cnf
MD5SUMf72920912a1bb14f90e9fea5dee0ec1c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark77.9931
Satisfiable
(Un)Satisfiability was proved
Number of variables298900
Number of clauses1409628
Sum of the clauses size3261218
Maximum clause length10
Minimum clause length1
Number of clauses of size 122283
Number of clauses of size 21089480
Number of clauses of size 3242405
Number of clauses of size 46160
Number of clauses of size 524640
Number of clauses of size over 524660

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3349582-1304968093/watcher-3349582-1304968093 -o /tmp/evaluation-result-3349582-1304968093/solver-3349582-1304968093 -C 2400 -W 1300 -M 7680 HOME/lr_gl_shr HOME/instance-3349582-1304968093.cnf -verb=0 -model 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.32 0.07 0.02 4/370 23028
/proc/meminfo: memFree=12563508/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=25908 CPUtime=0.01 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 1765 0 0 0 1 0 0 0 21 0 1 0 589225680 26529792 1709 33554432000 4194304 4300056 140733303069072 18446744073709551615 4286249 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 6477 1710 220 26 0 3109 0

[startup+0.110246 s]
/proc/loadavg: 0.32 0.07 0.02 4/370 23028
/proc/meminfo: memFree=12563508/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=51272 CPUtime=0.1 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 8738 0 0 0 9 1 0 0 22 0 1 0 589225680 52502528 8353 33554432000 4194304 4300056 140733303069072 18446744073709551615 212039655168 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 12818 8353 220 26 0 9450 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 51272

[startup+0.20023 s]
/proc/loadavg: 0.32 0.07 0.02 4/370 23028
/proc/meminfo: memFree=12563508/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=74360 CPUtime=0.19 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 14677 0 0 0 17 2 0 0 22 0 1 0 589225680 76144640 13785 33554432000 4194304 4300056 140733303069072 18446744073709551615 212039655168 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 18590 13786 220 26 0 15222 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 74360

[startup+0.300211 s]
/proc/loadavg: 0.32 0.07 0.02 4/370 23028
/proc/meminfo: memFree=12563508/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=88816 CPUtime=0.29 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 18426 0 0 0 26 3 0 0 22 0 1 0 589225680 90947584 17078 33554432000 4194304 4300056 140733303069072 18446744073709551615 212039655168 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 22204 17079 220 26 0 18836 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 88816

[startup+0.701151 s]
/proc/loadavg: 0.32 0.07 0.02 4/370 23028
/proc/meminfo: memFree=12563508/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=142584 CPUtime=0.69 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 30256 0 0 0 65 4 0 0 24 0 1 0 589225680 146006016 27082 33554432000 4194304 4300056 140733303069072 18446744073709551615 212039316165 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 35646 27082 222 26 0 32278 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 142584

[startup+1.501 s]
/proc/loadavg: 0.32 0.07 0.02 5/377 23041
/proc/meminfo: memFree=12237464/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=165356 CPUtime=1.49 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 38326 0 0 0 143 6 0 0 25 0 1 0 589225680 169324544 34723 33554432000 4194304 4300056 140733303069072 18446744073709551615 4232386 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 41339 34723 228 26 0 37971 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 165356

[startup+3.10071 s]
/proc/loadavg: 0.32 0.07 0.02 5/377 23041
/proc/meminfo: memFree=12224552/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=143568 CPUtime=3.09 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 45018 0 0 0 302 7 0 0 25 0 1 0 589225680 147013632 29370 33554432000 4194304 4300056 140733303069072 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 35892 29370 246 26 0 32524 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 143568

[startup+6.30114 s]
/proc/loadavg: 0.61 0.13 0.04 5/377 23041
/proc/meminfo: memFree=12248232/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=143568 CPUtime=6.3 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 45451 0 0 0 623 7 0 0 25 0 1 0 589225680 147013632 29802 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 35892 29802 247 26 0 32524 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 143568

[startup+12.701 s]
/proc/loadavg: 0.89 0.20 0.06 5/377 23041
/proc/meminfo: memFree=12232264/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=143568 CPUtime=12.69 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 45920 0 0 0 1262 7 0 0 25 0 1 0 589225680 147013632 30264 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 35892 30264 247 26 0 32524 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 143568

[startup+25.5007 s]
/proc/loadavg: 1.57 0.38 0.13 5/377 23042
/proc/meminfo: memFree=12201340/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=155244 CPUtime=25.5 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 47253 0 0 0 2542 8 0 0 25 0 1 0 589225680 158969856 31588 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 38811 31588 247 26 0 35443 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 155244

[startup+51.1011 s]
/proc/loadavg: 2.40 0.67 0.23 5/377 23042
/proc/meminfo: memFree=12055576/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=174212 CPUtime=51.09 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 50688 0 0 0 5100 9 0 0 25 0 1 0 589225680 178393088 35017 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 43553 35017 247 26 0 40185 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 174212

[startup+102.301 s]
/proc/loadavg: 3.44 1.21 0.43 5/377 23071
/proc/meminfo: memFree=10765320/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=205032 CPUtime=102.3 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 60147 0 0 0 10217 13 0 0 25 0 1 0 589225680 209952768 44454 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256319 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 51258 44454 247 26 0 47890 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 205032

[startup+162.3 s]
/proc/loadavg: 3.79 1.72 0.65 5/377 23072
/proc/meminfo: memFree=10744088/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=255120 CPUtime=162.29 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 70915 0 0 0 16213 16 0 0 25 0 1 0 589225680 261242880 55195 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 63780 55195 247 26 0 60412 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 255120

[startup+222.314 s]
/proc/loadavg: 3.92 2.13 0.86 5/377 23074
/proc/meminfo: memFree=10605388/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=340216 CPUtime=222.31 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 81488 0 0 0 22210 21 0 0 25 0 1 0 589225680 348381184 65740 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 85054 65740 247 26 0 81686 0
Current children cumulated CPU time (s) 222.31
Current children cumulated vsize (KiB) 340216

[startup+282.301 s]
/proc/loadavg: 3.97 2.47 1.05 5/377 23075
/proc/meminfo: memFree=10489536/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=344588 CPUtime=282.29 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 91816 0 0 0 28205 24 0 0 25 0 1 0 589225680 352858112 76048 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 86147 76048 247 26 0 82779 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 344588

[startup+342.301 s]
/proc/loadavg: 4.02 2.76 1.24 5/377 23077
/proc/meminfo: memFree=10356056/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=481040 CPUtime=342.3 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 102449 0 0 0 34202 28 0 0 25 0 1 0 589225680 492584960 86658 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 120260 86658 247 26 0 116892 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 481040

[startup+402.3 s]
/proc/loadavg: 4.08 3.01 1.42 5/377 23106
/proc/meminfo: memFree=11338392/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=485008 CPUtime=402.3 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 111956 0 0 0 40198 32 0 0 25 0 1 0 589225680 496648192 96148 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 121252 96148 247 26 0 117884 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 485008

[startup+462.301 s]
/proc/loadavg: 4.03 3.19 1.58 5/377 23107
/proc/meminfo: memFree=11210752/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=488596 CPUtime=462.3 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 122183 0 0 0 46195 35 0 0 25 0 1 0 589225680 500322304 106360 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 122149 106360 247 26 0 118781 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 488596

[startup+522.301 s]
/proc/loadavg: 4.22 3.39 1.75 5/377 23109
/proc/meminfo: memFree=11083380/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=492080 CPUtime=522.3 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 131589 0 0 0 52192 38 0 0 25 0 1 0 589225680 503889920 115748 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 123020 115748 247 26 0 119652 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 492080

[startup+582.301 s]
/proc/loadavg: 4.11 3.52 1.89 5/377 23110
/proc/meminfo: memFree=10952132/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=710424 CPUtime=582.3 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 141189 0 0 0 58188 42 0 0 25 0 1 0 589225680 727474176 125329 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 177606 125329 247 26 0 174238 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 710424

[startup+642.3 s]
/proc/loadavg: 4.04 3.60 2.02 5/377 23112
/proc/meminfo: memFree=10835660/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=714124 CPUtime=642.31 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 149512 0 0 0 64185 46 0 0 25 0 1 0 589225680 731262976 133644 33554432000 4194304 4300056 140733303069072 18446744073709551615 4252392 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 178531 133644 247 26 0 175163 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 714124

[startup+702.301 s]
/proc/loadavg: 4.01 3.67 2.14 5/377 23114
/proc/meminfo: memFree=10719168/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=717236 CPUtime=702.31 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 158571 0 0 0 70182 49 0 0 25 0 1 0 589225680 734449664 142689 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256241 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 179309 142689 247 26 0 175941 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 717236

[startup+762.301 s]
/proc/loadavg: 4.00 3.73 2.26 5/377 23115
/proc/meminfo: memFree=10594128/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=720116 CPUtime=762.33 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 168649 0 0 0 76180 53 0 0 25 0 1 0 589225680 737398784 152755 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 180029 152755 247 26 0 176661 0
Current children cumulated CPU time (s) 762.33
Current children cumulated vsize (KiB) 720116

[startup+822.301 s]
/proc/loadavg: 4.00 3.77 2.36 5/377 23117
/proc/meminfo: memFree=10492028/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=723484 CPUtime=822.31 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 176591 0 0 0 82176 55 0 0 25 0 1 0 589225680 740847616 160679 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 180871 160679 247 26 0 177503 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 723484

[startup+882.314 s]
/proc/loadavg: 4.05 3.83 2.47 5/377 23118
/proc/meminfo: memFree=10377780/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=726960 CPUtime=882.33 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 186726 0 0 0 88174 59 0 0 25 0 1 0 589225680 744407040 170797 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256008 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 181740 170797 247 26 0 178372 0
Current children cumulated CPU time (s) 882.33
Current children cumulated vsize (KiB) 726960

[startup+942.301 s]
/proc/loadavg: 4.05 3.87 2.56 5/377 23120
/proc/meminfo: memFree=10270832/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1078652 CPUtime=942.32 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 195371 0 0 0 94169 63 0 0 25 0 1 0 589225680 1104539648 179425 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 269663 179425 247 26 0 266295 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 1078652

[startup+1002.3 s]
/proc/loadavg: 4.08 3.91 2.66 5/377 23124
/proc/meminfo: memFree=10169604/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1081800 CPUtime=1002.31 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 202452 0 0 0 100167 64 0 0 25 0 1 0 589225680 1107763200 186497 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256553 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 270450 186497 247 26 0 267082 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 1081800

[startup+1062.3 s]
/proc/loadavg: 4.08 3.94 2.74 5/377 23126
/proc/meminfo: memFree=10062236/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1084720 CPUtime=1062.32 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 211379 0 0 0 106165 67 0 0 25 0 1 0 589225680 1110753280 195414 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256008 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 271180 195414 247 26 0 267812 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 1084720

[startup+1122.3 s]
/proc/loadavg: 4.11 3.97 2.83 5/377 23128
/proc/meminfo: memFree=9957152/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1087436 CPUtime=1122.32 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 218789 0 0 0 112161 71 0 0 25 0 1 0 589225680 1113534464 202809 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256291 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 271859 202809 247 26 0 268491 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 1087436

[startup+1182.3 s]
/proc/loadavg: 4.04 3.97 2.90 5/377 23129
/proc/meminfo: memFree=9860276/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1090180 CPUtime=1182.32 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 225796 0 0 0 118159 73 0 0 25 0 1 0 589225680 1116344320 209799 33554432000 4194304 4300056 140733303069072 18446744073709551615 4255983 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 272545 209799 247 26 0 269177 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 1090180

[startup+1242.3 s]
/proc/loadavg: 4.01 3.97 2.97 5/377 23131
/proc/meminfo: memFree=9753452/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1092568 CPUtime=1242.32 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 232092 0 0 0 124157 75 0 0 25 0 1 0 589225680 1118789632 216080 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256291 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 273142 216080 247 26 0 269774 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 1092568



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 3.97 3.03 5/377 23133
/proc/meminfo: memFree=9660636/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1095072 CPUtime=1300.04 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 238212 0 0 0 129926 78 0 0 25 0 1 0 589225680 1121353728 222184 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 273768 222184 247 26 0 270400 0
Current children cumulated CPU time (s) 1300.04
Current children cumulated vsize (KiB) 1095072

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.00 3.97 3.03 5/377 23133
/proc/meminfo: memFree=9660636/32951124 swapFree=65155552/67111528
[pid=23028] ppid=23026 vsize=1095072 CPUtime=1300.04 cores=5,7
/proc/23028/stat : 23028 (lr_gl_shr) R 23026 23028 22980 0 -1 4202496 238212 0 0 0 129926 78 0 0 25 0 1 0 589225680 1121353728 222184 33554432000 4194304 4300056 140733303069072 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/23028/statm: 273768 222184 247 26 0 270400 0
Current children cumulated CPU time (s) 1300.04
Current children cumulated vsize (KiB) 1095072

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.05
CPU time (s): 1300.09
CPU user time (s): 1299.26
CPU system time (s): 0.821875
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 1095072

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.26
system time used= 0.821875
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 238212
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 717

runsolver used 4.36334 second user time and 11.0213 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-09 21:08:14
IDJOB=3349582
IDBENCH=20349
IDSOLVER=1813
FILE ID=node146/3349582-1304968093
RUNJOBID= node146-1304968092-23001
PBS_JOBID= 13285604
Free space on /tmp= 41792 MiB

SOLVER NAME= minisat hack: LR_GL_SHR 2011-03-02
BENCH NAME= SAT07/industrial/anbulagan/hard-sat/partial-10-17-s.cnf
COMMAND LINE= HOME/lr_gl_shr BENCHNAME -verb=0 -model
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3349582-1304968093/watcher-3349582-1304968093 -o /tmp/evaluation-result-3349582-1304968093/solver-3349582-1304968093 -C 2400 -W 1300 -M 7680  HOME/lr_gl_shr HOME/instance-3349582-1304968093.cnf -verb=0 -model

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= f72920912a1bb14f90e9fea5dee0ec1c
RANDOM SEED=1918434855

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12564036 kB
Buffers:        154728 kB
Cached:        4388616 kB
SwapCached:       9316 kB
Active:       10744656 kB
Inactive:      9330676 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12564036 kB
SwapTotal:    67111528 kB
SwapFree:     65155552 kB
Dirty:           67588 kB
Writeback:           0 kB
AnonPages:    15529308 kB
Mapped:          22168 kB
Slab:           186148 kB
PageTables:      59388 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 81837812 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 41788 MiB
End job on node146 at 2011-05-09 21:29:56