Trace number 3349999

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: LR_GL_NOSHR 2011-03-02? (TO) 1300.05 1300.03

General information on the benchmark

Nameindustrial/palacios/hard/
sortnet-8-ipc5-h19-sat.cnf
MD5SUM409f4401e9e8b60ee665ac5567a13e41
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1110.09
Satisfiable
(Un)Satisfiability was proved
Number of variables359341
Number of clauses1254773
Sum of the clauses size3046189
Maximum clause length57
Minimum clause length1
Number of clauses of size 1256
Number of clauses of size 2896240
Number of clauses of size 3346435
Number of clauses of size 4830
Number of clauses of size 5571
Number of clauses of size over 510441

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3349999-1304968100/watcher-3349999-1304968100 -o /tmp/evaluation-result-3349999-1304968100/solver-3349999-1304968100 -C 2400 -W 1300 -M 7680 HOME/lr_gl_shr HOME/instance-3349999-1304968100.cnf -verb=0 -model -no-shrinking 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/231 22664
/proc/meminfo: memFree=4357732/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=20376 CPUtime=0 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 672 0 0 0 0 0 0 0 21 0 1 0 608409926 20865024 595 33554432000 4194304 4300056 140735754583696 18446744073709551615 248089698048 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 5094 596 221 26 0 1726 0

[startup+0.028376 s]
/proc/loadavg: 0.00 0.00 0.00 2/231 22664
/proc/meminfo: memFree=4357732/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=23636 CPUtime=0.02 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 1695 0 0 0 2 0 0 0 21 0 1 0 608409926 24203264 1533 33554432000 4194304 4300056 140735754583696 18446744073709551615 4286350 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 5909 1534 222 26 0 2541 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 23636

[startup+0.100397 s]
/proc/loadavg: 0.00 0.00 0.00 2/231 22664
/proc/meminfo: memFree=4357732/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=34992 CPUtime=0.09 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 5433 0 0 0 9 0 0 0 21 0 1 0 608409926 35831808 4834 33554432000 4194304 4300056 140735754583696 18446744073709551615 4284721 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 8748 4835 222 26 0 5380 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34992

[startup+0.300359 s]
/proc/loadavg: 0.00 0.00 0.00 2/231 22664
/proc/meminfo: memFree=4357732/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=76168 CPUtime=0.29 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 15778 0 0 0 27 2 0 0 22 0 1 0 608409926 77996032 13824 33554432000 4194304 4300056 140735754583696 18446744073709551615 248089698048 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 19042 13824 244 26 0 15674 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 76168

[startup+0.700291 s]
/proc/loadavg: 0.00 0.00 0.00 2/231 22664
/proc/meminfo: memFree=4357732/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=158364 CPUtime=0.69 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 35877 0 0 0 64 5 0 0 24 0 1 0 608409926 162164736 31429 33554432000 4194304 4300056 140735754583696 18446744073709551615 248089394955 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 39591 31429 254 26 0 36223 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 158364

[startup+1.50115 s]
/proc/loadavg: 0.16 0.03 0.01 3/232 22665
/proc/meminfo: memFree=4219348/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=213812 CPUtime=1.49 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 48895 0 0 0 142 7 0 0 25 0 1 0 608409926 218943488 43976 33554432000 4194304 4300056 140735754583696 18446744073709551615 4286249 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 53453 43976 246 26 0 50085 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 213812

[startup+3.10075 s]
/proc/loadavg: 0.16 0.03 0.01 3/232 22665
/proc/meminfo: memFree=4183016/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=215608 CPUtime=3.09 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 62874 0 0 0 300 9 0 0 25 0 1 0 608409926 220782592 47082 33554432000 4194304 4300056 140735754583696 18446744073709551615 4230419 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 53902 47082 246 26 0 50534 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 215608

[startup+6.30026 s]
/proc/loadavg: 0.47 0.10 0.03 5/242 22685
/proc/meminfo: memFree=4124360/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=192096 CPUtime=6.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 68743 0 0 0 619 11 0 0 25 0 1 0 608409926 196706304 40672 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256008 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 48024 40672 263 26 0 44656 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 192096

[startup+12.7011 s]
/proc/loadavg: 0.75 0.16 0.05 5/242 22686
/proc/meminfo: memFree=4139264/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=192096 CPUtime=12.7 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 69214 0 0 0 1259 11 0 0 25 0 1 0 608409926 196706304 41135 33554432000 4194304 4300056 140735754583696 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 48024 41135 264 26 0 44656 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 192096

[startup+25.5009 s]
/proc/loadavg: 1.25 0.29 0.09 5/242 22686
/proc/meminfo: memFree=4097480/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=203772 CPUtime=25.49 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 70277 0 0 0 2538 11 0 0 25 0 1 0 608409926 208662528 42184 33554432000 4194304 4300056 140735754583696 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 50943 42184 264 26 0 47575 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 203772

[startup+51.1003 s]
/proc/loadavg: 2.33 0.64 0.22 5/242 22687
/proc/meminfo: memFree=4058156/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=203772 CPUtime=51.09 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 71984 0 0 0 5097 12 0 0 25 0 1 0 608409926 208662528 43852 33554432000 4194304 4300056 140735754583696 18446744073709551615 4251385 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 50943 43852 264 26 0 47575 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 203772

[startup+102.309 s]
/proc/loadavg: 3.27 1.16 0.41 5/242 22688
/proc/meminfo: memFree=4042368/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=222740 CPUtime=102.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 74929 0 0 0 10217 13 0 0 25 0 1 0 608409926 228085760 46728 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256548 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 55685 46728 264 26 0 52317 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 222740

[startup+162.301 s]
/proc/loadavg: 3.73 1.67 0.64 5/242 22690
/proc/meminfo: memFree=4021508/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=253560 CPUtime=162.29 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 78388 0 0 0 16214 15 0 0 25 0 1 0 608409926 259645440 50144 33554432000 4194304 4300056 140735754583696 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 63390 50144 264 26 0 60022 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 253560

[startup+222.301 s]
/proc/loadavg: 3.95 2.11 0.85 5/242 22691
/proc/meminfo: memFree=4063980/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=253560 CPUtime=222.29 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 81166 0 0 0 22213 16 0 0 25 0 1 0 608409926 259645440 52872 33554432000 4194304 4300056 140735754583696 18446744073709551615 4251385 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 63390 52872 264 26 0 60022 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 253560

[startup+282.3 s]
/proc/loadavg: 3.98 2.45 1.04 5/242 22693
/proc/meminfo: memFree=3978988/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=253560 CPUtime=282.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 83871 0 0 0 28212 18 0 0 25 0 1 0 608409926 259645440 55520 33554432000 4194304 4300056 140735754583696 18446744073709551615 4251385 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 63390 55520 264 26 0 60022 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 253560

[startup+342.301 s]
/proc/loadavg: 3.99 2.73 1.23 5/242 22694
/proc/meminfo: memFree=3936156/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=303648 CPUtime=342.29 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 86630 0 0 0 34209 20 0 0 25 0 1 0 608409926 310935552 58227 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 75912 58227 264 26 0 72544 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 303648

[startup+402.3 s]
/proc/loadavg: 4.04 2.97 1.40 5/242 22696
/proc/meminfo: memFree=3961536/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=306092 CPUtime=402.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 89559 0 0 0 40209 21 0 0 25 0 1 0 608409926 313438208 61105 33554432000 4194304 4300056 140735754583696 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 76523 61105 264 26 0 73155 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 306092

[startup+462.301 s]
/proc/loadavg: 4.01 3.16 1.56 5/242 22698
/proc/meminfo: memFree=3957772/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=306092 CPUtime=462.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 92200 0 0 0 46208 22 0 0 25 0 1 0 608409926 313438208 63691 33554432000 4194304 4300056 140735754583696 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 76523 63691 264 26 0 73155 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 306092

[startup+522.301 s]
/proc/loadavg: 4.00 3.31 1.71 5/242 22699
/proc/meminfo: memFree=3978064/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=308812 CPUtime=522.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 95456 0 0 0 52207 23 0 0 25 0 1 0 608409926 316223488 66900 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 77203 66900 264 26 0 73835 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 308812

[startup+582.3 s]
/proc/loadavg: 4.00 3.43 1.85 5/242 22701
/proc/meminfo: memFree=3948244/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=310732 CPUtime=582.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 98386 0 0 0 58206 24 0 0 25 0 1 0 608409926 318189568 69795 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256548 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 77683 69795 264 26 0 74315 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 310732

[startup+642.301 s]
/proc/loadavg: 4.11 3.56 1.99 5/242 22702
/proc/meminfo: memFree=3883220/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=397364 CPUtime=642.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 101891 0 0 0 64205 26 0 0 25 0 1 0 608409926 406900736 73250 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 99341 73250 264 26 0 95973 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 397364

[startup+702.301 s]
/proc/loadavg: 4.04 3.64 2.12 5/242 22704
/proc/meminfo: memFree=3955336/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=398004 CPUtime=702.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 104933 0 0 0 70203 27 0 0 25 0 1 0 608409926 407556096 76255 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 99501 76255 264 26 0 96133 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 398004

[startup+762.309 s]
/proc/loadavg: 4.08 3.72 2.24 5/242 22706
/proc/meminfo: memFree=3924656/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=398588 CPUtime=762.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 107408 0 0 0 76203 28 0 0 25 0 1 0 608409926 408154112 78668 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256237 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 99647 78668 264 26 0 96279 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 398588

[startup+822.301 s]
/proc/loadavg: 4.03 3.77 2.34 5/242 22707
/proc/meminfo: memFree=3761056/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=400256 CPUtime=822.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 111587 0 0 0 82201 30 0 0 25 0 1 0 608409926 409862144 82804 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256011 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 100064 82804 264 26 0 96696 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 400256

[startup+882.3 s]
/proc/loadavg: 4.01 3.81 2.44 5/242 22709
/proc/meminfo: memFree=3801308/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=403136 CPUtime=882.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 115109 0 0 0 88200 31 0 0 25 0 1 0 608409926 412811264 86271 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 100784 86271 264 26 0 97416 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 403136

[startup+942.301 s]
/proc/loadavg: 4.07 3.85 2.54 5/242 22710
/proc/meminfo: memFree=3759580/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=408848 CPUtime=942.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 118583 0 0 0 94199 32 0 0 25 0 1 0 608409926 418660352 89694 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256040 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 102212 89694 264 26 0 98844 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 408848

[startup+1002.3 s]
/proc/loadavg: 4.02 3.88 2.63 5/242 22739
/proc/meminfo: memFree=3805440/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=411132 CPUtime=1002.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 121369 0 0 0 100197 34 0 0 25 0 1 0 608409926 420999168 92429 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256264 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 102783 92429 264 26 0 99415 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 411132

[startup+1062.3 s]
/proc/loadavg: 4.01 3.90 2.72 5/242 22741
/proc/meminfo: memFree=3713928/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=417592 CPUtime=1062.3 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 124457 0 0 0 106196 34 0 0 25 0 1 0 608409926 427614208 95481 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256548 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 104398 95481 264 26 0 101030 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 417592

[startup+1122.3 s]
/proc/loadavg: 4.05 3.93 2.80 5/242 22742
/proc/meminfo: memFree=3635136/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=417592 CPUtime=1122.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 126716 0 0 0 112196 35 0 0 25 0 1 0 608409926 427614208 97690 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256570 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 104398 97690 264 26 0 101030 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 417592

[startup+1182.3 s]
/proc/loadavg: 4.06 3.95 2.88 5/242 22744
/proc/meminfo: memFree=3568628/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=552140 CPUtime=1182.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 129129 0 0 0 118195 36 0 0 25 0 1 0 608409926 565391360 100058 33554432000 4194304 4300056 140735754583696 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 138035 100058 264 26 0 134667 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 552140

[startup+1242.3 s]
/proc/loadavg: 4.06 3.97 2.95 5/242 22745
/proc/meminfo: memFree=3479548/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=554328 CPUtime=1242.31 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 131912 0 0 0 124194 37 0 0 25 0 1 0 608409926 567631872 102811 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 138582 102811 264 26 0 135214 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 554328



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.02 3.97 3.01 4/237 22765
/proc/meminfo: memFree=3427828/32950928 swapFree=64721848/67111528
[pid=22664] ppid=22662 vsize=555872 CPUtime=1300.02 cores=4,6
/proc/22664/stat : 22664 (lr_gl_shr) R 22662 22664 22624 0 -1 4202496 133937 0 0 0 129964 38 0 0 25 0 1 0 608409926 569212928 104796 33554432000 4194304 4300056 140735754583696 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/22664/statm: 138968 104796 264 26 0 135600 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 555872

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.03
CPU time (s): 1300.05
CPU user time (s): 1299.65
CPU system time (s): 0.400939
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 555872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.65
system time used= 0.400939
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 133937
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1018

runsolver used 2.79857 second user time and 6.66999 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-09 21:08:21
IDJOB=3349999
IDBENCH=20410
IDSOLVER=1815
FILE ID=node123/3349999-1304968100
RUNJOBID= node123-1304968097-22643
PBS_JOBID= 13285627
Free space on /tmp= 39128 MiB

SOLVER NAME= minisat hack: LR_GL_NOSHR 2011-03-02
BENCH NAME= SAT07/industrial/palacios/hard/sortnet-8-ipc5-h19-sat.cnf
COMMAND LINE= HOME/lr_gl_shr BENCHNAME -verb=0 -model -no-shrinking 
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3349999-1304968100/watcher-3349999-1304968100 -o /tmp/evaluation-result-3349999-1304968100/solver-3349999-1304968100 -C 2400 -W 1300 -M 7680  HOME/lr_gl_shr HOME/instance-3349999-1304968100.cnf -verb=0 -model -no-shrinking 

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 409f4401e9e8b60ee665ac5567a13e41
RANDOM SEED=390627782

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       4358012 kB
Buffers:        224944 kB
Cached:       18665180 kB
SwapCached:      10384 kB
Active:       15828212 kB
Inactive:     12131784 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       4358012 kB
SwapTotal:    67111528 kB
SwapFree:     64721848 kB
Dirty:           24328 kB
Writeback:           0 kB
AnonPages:     9067500 kB
Mapped:          16100 kB
Slab:           539484 kB
PageTables:      31680 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 13047876 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 39116 MiB
End job on node123 at 2011-05-09 21:30:03