Trace number 3251221

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-03-04? (TO) 1300.08 1300.04

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m47-q841.5-n45-p30-s84954709.cnf
MD5SUM556c58061360a1b195d9b2f28888af77
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.03469
Satisfiable
(Un)Satisfiability was proved
Number of variables2115
Number of clauses356340
Sum of the clauses size714705
Maximum clause length47
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2356295
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251221-1303583027/watcher-3251221-1303583027 -o /tmp/evaluation-result-3251221-1303583027/solver-3251221-1303583027 -C 2400 -W 1300 -M 7680 SApperloT2010 HOME/instance-3251221-1303583027.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.73 3.95 3.98 5/189 19391
/proc/meminfo: memFree=12973364/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=11696 CPUtime=0 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4194304 218 0 0 0 0 0 0 0 25 0 1 0 548533381 11976704 170 33554432000 4194304 4395502 140736456126464 18446744073709551615 231890527720 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19391/statm: 2924 171 145 50 0 51 0

[startup+0.051976 s]
/proc/loadavg: 3.73 3.95 3.98 5/189 19391
/proc/meminfo: memFree=12973364/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=23612 CPUtime=0.04 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 2563 0 0 0 4 0 0 0 25 0 1 0 548533381 24178688 2503 33554432000 4194304 4395502 140736456126464 18446744073709551615 231895490304 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 5903 2503 250 50 0 3043 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 23612

[startup+0.100962 s]
/proc/loadavg: 3.73 3.95 3.98 5/189 19391
/proc/meminfo: memFree=12973364/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=30344 CPUtime=0.09 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 4240 0 0 0 8 1 0 0 25 0 1 0 548533381 31072256 4180 33554432000 4194304 4395502 140736456126464 18446744073709551615 231895490304 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 7586 4182 250 50 0 4726 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 30344

[startup+0.300929 s]
/proc/loadavg: 3.73 3.95 3.98 5/189 19391
/proc/meminfo: memFree=12973364/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=45596 CPUtime=0.28 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 8077 0 0 0 25 3 0 0 25 0 1 0 548533381 46690304 8016 33554432000 4194304 4395502 140736456126464 18446744073709551615 231895515031 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 11399 8016 256 50 0 8539 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 45596

[startup+0.700852 s]
/proc/loadavg: 3.73 3.95 3.98 5/189 19391
/proc/meminfo: memFree=12973364/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=45596 CPUtime=0.69 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 8077 0 0 0 64 5 0 0 25 0 1 0 548533381 46690304 8016 33554432000 4194304 4395502 140736456126464 18446744073709551615 231895515031 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 11399 8016 256 50 0 8539 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 45596

[startup+1.5007 s]
/proc/loadavg: 3.73 3.95 3.98 5/190 19392
/proc/meminfo: memFree=12919920/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=66008 CPUtime=1.48 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 14532 0 0 0 142 6 0 0 25 0 1 0 548533381 67592192 13078 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299648 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 16502 13078 267 50 0 13642 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 66008

[startup+3.1004 s]
/proc/loadavg: 3.73 3.95 3.98 5/190 19392
/proc/meminfo: memFree=12895740/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=83068 CPUtime=3.08 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 18695 0 0 0 301 7 0 0 25 0 1 0 548533381 85061632 17241 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 20767 17241 267 50 0 17907 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 83068

[startup+6.3008 s]
/proc/loadavg: 3.75 3.95 3.98 5/190 19393
/proc/meminfo: memFree=12847236/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=108484 CPUtime=6.29 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 24882 0 0 0 621 8 0 0 25 0 1 0 548533381 111087616 23428 33554432000 4194304 4395502 140736456126464 18446744073709551615 4288516 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 27121 23428 267 50 0 24261 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 108484

[startup+12.7006 s]
/proc/loadavg: 3.77 3.95 3.98 5/190 19393
/proc/meminfo: memFree=12787900/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=147012 CPUtime=12.69 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 33948 0 0 0 1259 10 0 0 25 0 1 0 548533381 150540288 32494 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299142 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 36753 32494 267 50 0 33893 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 147012

[startup+25.5002 s]
/proc/loadavg: 3.82 3.95 3.98 5/190 19393
/proc/meminfo: memFree=12697192/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=200080 CPUtime=25.49 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 46551 0 0 0 2537 12 0 0 25 0 1 0 548533381 204881920 45097 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299492 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 50020 45097 267 50 0 47160 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 200080

[startup+51.1004 s]
/proc/loadavg: 3.88 3.95 3.98 5/190 19394
/proc/meminfo: memFree=12592620/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=267484 CPUtime=51.09 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 62292 0 0 0 5093 16 0 0 25 0 1 0 548533381 273903616 60838 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299648 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 66871 60838 267 50 0 64011 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 267484

[startup+102.307 s]
/proc/loadavg: 3.95 3.96 3.98 5/190 19395
/proc/meminfo: memFree=12495756/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=295636 CPUtime=102.3 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 69017 0 0 0 10212 18 0 0 25 0 1 0 548533381 302731264 67563 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 73909 67563 267 50 0 71049 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 295636

[startup+162.301 s]
/proc/loadavg: 3.98 3.96 3.98 5/190 19397
/proc/meminfo: memFree=12441164/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=322012 CPUtime=162.29 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 74638 0 0 0 16210 19 0 0 25 0 1 0 548533381 329740288 73184 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 80503 73184 267 50 0 77643 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 322012

[startup+222.3 s]
/proc/loadavg: 4.06 3.99 3.98 5/190 19398
/proc/meminfo: memFree=12390056/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=337372 CPUtime=222.29 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 77853 0 0 0 22209 20 0 0 25 0 1 0 548533381 345468928 76399 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 84343 76399 267 50 0 81483 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 337372

[startup+282.301 s]
/proc/loadavg: 4.02 3.99 3.98 5/190 19400
/proc/meminfo: memFree=12335956/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=373692 CPUtime=282.3 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 85542 0 0 0 28208 22 0 0 25 0 1 0 548533381 382660608 84088 33554432000 4194304 4395502 140736456126464 18446744073709551615 4328448 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 93423 84088 267 50 0 90563 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 373692

[startup+342.301 s]
/proc/loadavg: 4.04 4.00 3.99 5/190 19402
/proc/meminfo: memFree=12292408/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=398088 CPUtime=342.29 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 90696 0 0 0 34205 24 0 0 25 0 1 0 548533381 407642112 89242 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299662 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 99522 89242 267 50 0 96662 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 398088

[startup+402.3 s]
/proc/loadavg: 4.01 4.00 3.99 5/190 19403
/proc/meminfo: memFree=12244516/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=426128 CPUtime=402.3 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 96714 0 0 0 40203 27 0 0 25 0 1 0 548533381 436355072 95260 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299154 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 106532 95260 267 50 0 103672 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 426128

[startup+462.301 s]
/proc/loadavg: 4.07 4.02 3.99 5/190 19405
/proc/meminfo: memFree=12197240/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=445140 CPUtime=462.3 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 100819 0 0 0 46202 28 0 0 25 0 1 0 548533381 455823360 99365 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299608 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 111285 99365 267 50 0 108425 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 445140

[startup+522.301 s]
/proc/loadavg: 4.02 4.01 3.99 5/190 19406
/proc/meminfo: memFree=12159640/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=457108 CPUtime=522.31 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 103385 0 0 0 52202 29 0 0 25 0 1 0 548533381 468078592 101931 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299653 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 114277 101931 267 50 0 111417 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 457108

[startup+582.301 s]
/proc/loadavg: 4.01 4.00 3.99 5/190 19408
/proc/meminfo: memFree=12135924/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=470732 CPUtime=582.3 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 106623 0 0 0 58200 30 0 0 25 0 1 0 548533381 482029568 105169 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299648 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 117683 105169 267 50 0 114823 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 470732

[startup+642.3 s]
/proc/loadavg: 4.00 4.00 3.99 5/190 19410
/proc/meminfo: memFree=12098816/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=492720 CPUtime=642.32 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 111729 0 0 0 64199 33 0 0 25 0 1 0 548533381 504545280 110275 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 123180 110275 267 50 0 120320 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 492720

[startup+702.301 s]
/proc/loadavg: 4.00 4.00 3.99 5/190 19438
/proc/meminfo: memFree=11994012/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=505752 CPUtime=702.31 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 114722 0 0 0 70198 33 0 0 25 0 1 0 548533381 517890048 113268 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299648 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 126438 113268 267 50 0 123578 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 505752

[startup+762.307 s]
/proc/loadavg: 4.00 4.00 3.99 5/190 19440
/proc/meminfo: memFree=11938416/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=513456 CPUtime=762.31 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 116504 0 0 0 76197 34 0 0 25 0 1 0 548533381 525778944 115050 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 128364 115050 267 50 0 125504 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 513456

[startup+822.301 s]
/proc/loadavg: 4.06 4.01 4.00 5/190 19441
/proc/meminfo: memFree=11858516/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=537500 CPUtime=822.31 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 122041 0 0 0 82193 38 0 0 25 0 1 0 548533381 550400000 120587 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299648 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 134375 120587 267 50 0 131515 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 537500

[startup+882.3 s]
/proc/loadavg: 4.09 4.03 4.00 5/190 19443
/proc/meminfo: memFree=11824248/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=549788 CPUtime=882.32 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 124684 0 0 0 88192 40 0 0 25 0 1 0 548533381 562982912 123230 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299642 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 137447 123230 267 50 0 134587 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 549788

[startup+942.301 s]
/proc/loadavg: 4.03 4.02 4.00 5/190 19448
/proc/meminfo: memFree=11808052/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=552860 CPUtime=942.32 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 125487 0 0 0 94192 40 0 0 25 0 1 0 548533381 566128640 124033 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 138215 124033 267 50 0 135355 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 552860

[startup+1002.3 s]
/proc/loadavg: 4.04 4.03 4.00 5/190 19449
/proc/meminfo: memFree=11781364/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=557980 CPUtime=1002.33 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 126657 0 0 0 100192 41 0 0 25 0 1 0 548533381 571371520 125203 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299743 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 139495 125203 267 50 0 136635 0
Current children cumulated CPU time (s) 1002.33
Current children cumulated vsize (KiB) 557980

[startup+1062.3 s]
/proc/loadavg: 4.01 4.02 4.00 5/190 19451
/proc/meminfo: memFree=11694396/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=643232 CPUtime=1062.33 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 144087 0 0 0 106189 44 0 0 25 0 1 0 548533381 658669568 142633 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 160808 142633 267 50 0 157948 0
Current children cumulated CPU time (s) 1062.33
Current children cumulated vsize (KiB) 643232

[startup+1122.3 s]
/proc/loadavg: 4.00 4.02 4.00 5/190 19452
/proc/meminfo: memFree=11622192/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=708708 CPUtime=1122.32 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 157444 0 0 0 112187 45 0 0 25 0 1 0 548533381 725716992 155990 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 177177 155990 267 50 0 174317 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 708708

[startup+1182.3 s]
/proc/loadavg: 4.00 4.01 4.00 5/190 19454
/proc/meminfo: memFree=11585568/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=723812 CPUtime=1182.33 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 160372 0 0 0 118187 46 0 0 25 0 1 0 548533381 741183488 158918 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299628 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 180953 158918 267 50 0 178093 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 723812

[startup+1242.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/190 19456
/proc/meminfo: memFree=11563716/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=732260 CPUtime=1242.33 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 162057 0 0 0 124187 46 0 0 25 0 1 0 548533381 749834240 160603 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 183065 160603 267 50 0 180205 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 732260



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.90 3.98 3.99 3/180 19493
/proc/meminfo: memFree=12049112/32950928 swapFree=67111528/67111528
[pid=19391] ppid=19389 vsize=744036 CPUtime=1300.04 cores=1,3
/proc/19391/stat : 19391 (SApperloT2010) R 19389 19391 18780 0 -1 4202496 164041 0 0 0 129957 47 0 0 25 0 1 0 548533381 761892864 162587 33554432000 4194304 4395502 140736456126464 18446744073709551615 4299489 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/19391/statm: 186009 162587 267 50 0 183149 0
Current children cumulated CPU time (s) 1300.04
Current children cumulated vsize (KiB) 744036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.04
CPU time (s): 1300.08
CPU user time (s): 1299.58
CPU system time (s): 0.502923
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 744036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.58
system time used= 0.502923
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 164041
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1024

runsolver used 2.01169 second user time and 5.09323 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-23 20:23:47
IDJOB=3251221
IDBENCH=88216
IDSOLVER=1655
FILE ID=node114/3251221-1303583027
RUNJOBID= node114-1303583022-19324
PBS_JOBID= 13150339
Free space on /tmp= 71252 MiB

SOLVER NAME= SApperloT2010 2011-03-04
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m47-q841.5-n45-p30-s84954709.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251221-1303583027/watcher-3251221-1303583027 -o /tmp/evaluation-result-3251221-1303583027/solver-3251221-1303583027 -C 2400 -W 1300 -M 7680  SApperloT2010 HOME/instance-3251221-1303583027.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 556c58061360a1b195d9b2f28888af77
RANDOM SEED=1531266037

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12973520 kB
Buffers:       2303400 kB
Cached:       16893408 kB
SwapCached:          0 kB
Active:        9997456 kB
Inactive:      9390800 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12973520 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            9696 kB
Writeback:           0 kB
AnonPages:      190496 kB
Mapped:          15716 kB
Slab:           524228 kB
PageTables:       5184 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   382484 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71252 MiB
End job on node114 at 2011-04-23 20:45:29