Trace number 3438843

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.19 5000.04

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x39.cnf
MD5SUMe7679ca49bb432c9b90305d907365c4e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3276
Number of clauses628173
Sum of the clauses size2502864
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24914
Number of clauses of size 30
Number of clauses of size 4623259
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438843-1306899543/watcher-3438843-1306899543 -o /tmp/evaluation-result-3438843-1306899543/solver-3438843-1306899543 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3438843-1306899543.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.97 2.03 2.00 2/424 6101
/proc/meminfo: memFree=6908676/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=22476 CPUtime=0 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 1808 0 0 0 0 0 0 0 25 0 1 0 801552538 23015424 1747 33554432000 4194304 4394578 140734723272992 18446744073709551615 246516495045 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 5619 1748 247 49 0 2760 0

[startup+0.0900939 s]
/proc/loadavg: 1.97 2.03 2.00 2/424 6101
/proc/meminfo: memFree=6908676/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=34884 CPUtime=0.08 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 4896 0 0 0 8 0 0 0 25 0 1 0 801552538 35721216 4835 33554432000 4194304 4394578 140734723272992 18446744073709551615 246516495045 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 8721 4836 247 49 0 5862 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 34884

[startup+0.101087 s]
/proc/loadavg: 1.97 2.03 2.00 2/424 6101
/proc/meminfo: memFree=6908676/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=35940 CPUtime=0.09 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 5178 0 0 0 9 0 0 0 25 0 1 0 801552538 36802560 5117 33554432000 4194304 4394578 140734723272992 18446744073709551615 246516495045 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 8985 5117 247 49 0 6126 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 35940

[startup+0.301056 s]
/proc/loadavg: 1.97 2.03 2.00 2/424 6101
/proc/meminfo: memFree=6908676/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=66672 CPUtime=0.28 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 12841 0 0 0 27 1 0 0 25 0 1 0 801552538 68272128 12780 33554432000 4194304 4394578 140734723272992 18446744073709551615 246516834048 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 16668 12781 247 49 0 13809 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 66672

[startup+0.700984 s]
/proc/loadavg: 1.97 2.03 2.00 2/424 6101
/proc/meminfo: memFree=6908676/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=92916 CPUtime=0.69 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 19429 0 0 0 65 4 0 0 25 0 1 0 801552538 95145984 19367 33554432000 4194304 4394578 140734723272992 18446744073709551615 246516858775 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 23229 19367 256 49 0 20370 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 92916

[startup+1.50084 s]
/proc/loadavg: 1.97 2.03 2.00 3/425 6102
/proc/meminfo: memFree=6822496/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=92916 CPUtime=1.48 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 19429 0 0 0 144 4 0 0 25 0 1 0 801552538 95145984 19367 33554432000 4194304 4394578 140734723272992 18446744073709551615 246516858775 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 23229 19367 256 49 0 20370 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 92916

[startup+3.10052 s]
/proc/loadavg: 1.97 2.03 2.00 3/425 6102
/proc/meminfo: memFree=6813816/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=93548 CPUtime=3.09 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 22300 0 0 0 303 6 0 0 25 0 1 0 801552538 95793152 19758 33554432000 4194304 4394578 140734723272992 18446744073709551615 246516495045 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 23387 19761 259 49 0 20528 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 93548

[startup+6.30097 s]
/proc/loadavg: 1.97 2.03 2.00 3/425 6102
/proc/meminfo: memFree=6698808/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=189348 CPUtime=6.29 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 46059 0 0 0 620 9 0 0 25 0 1 0 801552538 193892352 43517 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 47337 43517 267 49 0 44478 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 189348

[startup+12.7008 s]
/proc/loadavg: 1.98 2.03 2.00 3/425 6102
/proc/meminfo: memFree=6639320/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=215684 CPUtime=12.69 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 53039 0 0 0 1259 10 0 0 25 0 1 0 801552538 220860416 50497 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 53921 50497 267 49 0 51062 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 215684

[startup+25.5005 s]
/proc/loadavg: 1.98 2.03 2.00 3/425 6102
/proc/meminfo: memFree=6555724/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=264792 CPUtime=25.49 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 65263 0 0 0 2535 14 0 0 25 0 1 0 801552538 271147008 62721 33554432000 4194304 4394578 140734723272992 18446744073709551615 4287700 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 66198 62721 267 49 0 63339 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 264792

[startup+51.1008 s]
/proc/loadavg: 2.05 2.04 2.00 3/425 6103
/proc/meminfo: memFree=6460992/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=322132 CPUtime=51.09 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 77582 0 0 0 5093 16 0 0 25 0 1 0 801552538 329863168 75040 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 80533 75040 267 49 0 77674 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 322132

[startup+102.316 s]
/proc/loadavg: 2.02 2.03 2.00 3/425 6105
/proc/meminfo: memFree=6303764/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=407868 CPUtime=102.31 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 97683 0 0 0 10211 20 0 0 25 0 1 0 801552538 417656832 95141 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 101967 95141 267 49 0 99108 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 407868

[startup+162.301 s]
/proc/loadavg: 2.04 2.04 2.00 3/425 6106
/proc/meminfo: memFree=6137560/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=465812 CPUtime=162.3 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 111312 0 0 0 16207 23 0 0 25 0 1 0 801552538 476991488 108770 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 116453 108770 267 49 0 113594 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 465812

[startup+222.301 s]
/proc/loadavg: 2.01 2.03 2.00 3/425 6108
/proc/meminfo: memFree=6083588/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=474608 CPUtime=222.3 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 113386 0 0 0 22206 24 0 0 25 0 1 0 801552538 485998592 110844 33554432000 4194304 4394578 140734723272992 18446744073709551615 4299758 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 118652 110844 267 49 0 115793 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 474608

[startup+282.301 s]
/proc/loadavg: 2.00 2.02 2.00 3/425 6109
/proc/meminfo: memFree=5955952/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=494112 CPUtime=282.3 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 117827 0 0 0 28205 25 0 0 25 0 1 0 801552538 505970688 115285 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 123528 115285 267 49 0 120669 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 494112

[startup+342.301 s]
/proc/loadavg: 2.00 2.01 2.00 3/425 6111
/proc/meminfo: memFree=5795828/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=574512 CPUtime=342.3 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 135771 0 0 0 34202 28 0 0 25 0 1 0 801552538 588300288 133229 33554432000 4194304 4394578 140734723272992 18446744073709551615 4327600 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 143628 133229 267 49 0 140769 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 574512

[startup+402.301 s]
/proc/loadavg: 2.20 2.06 2.01 3/425 6112
/proc/meminfo: memFree=5701672/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=605872 CPUtime=402.3 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 143535 0 0 0 40200 30 0 0 25 0 1 0 801552538 620412928 140993 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298358 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 151468 140993 267 49 0 148609 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 605872

[startup+462.301 s]
/proc/loadavg: 2.14 2.06 2.01 3/425 6114
/proc/meminfo: memFree=5679188/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=613740 CPUtime=462.31 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 145253 0 0 0 46200 31 0 0 25 0 1 0 801552538 628469760 142711 33554432000 4194304 4394578 140734723272992 18446744073709551615 4295955 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 153435 142711 267 49 0 150576 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 613740

[startup+522.301 s]
/proc/loadavg: 2.12 2.08 2.02 3/425 6116
/proc/meminfo: memFree=5586148/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=700972 CPUtime=522.31 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 166063 0 0 0 52196 35 0 0 25 0 1 0 801552538 717795328 163521 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 175243 163521 267 49 0 172384 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 700972

[startup+582.301 s]
/proc/loadavg: 2.04 2.06 2.01 3/425 6117
/proc/meminfo: memFree=5462612/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=704044 CPUtime=582.31 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 166731 0 0 0 58196 35 0 0 25 0 1 0 801552538 720941056 164189 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 176011 164189 267 49 0 173152 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 704044

[startup+642.301 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 2.00 2.02 2.00 3/425 6222
/proc/meminfo: memFree=260652/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3326840 CPUtime=4062.43 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 795619 0 0 0 406079 164 0 0 25 0 1 0 801552538 3406684160 793077 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 831710 793077 267 49 0 828851 0
Current children cumulated CPU time (s) 4062.43
Current children cumulated vsize (KiB) 3326840

[startup+4122.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/425 6224
/proc/meminfo: memFree=185832/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3334780 CPUtime=4122.41 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 797382 0 0 0 412077 164 0 0 25 0 1 0 801552538 3414814720 794840 33554432000 4194304 4394578 140734723272992 18446744073709551615 4327617 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 833695 794840 267 49 0 830836 0
Current children cumulated CPU time (s) 4122.41
Current children cumulated vsize (KiB) 3334780

[startup+4182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/425 6225
/proc/meminfo: memFree=96236/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3339900 CPUtime=4182.41 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 798457 0 0 0 418077 164 0 0 25 0 1 0 801552538 3420057600 795915 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 834975 795915 267 49 0 832116 0
Current children cumulated CPU time (s) 4182.41
Current children cumulated vsize (KiB) 3339900

[startup+4242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/425 6227
/proc/meminfo: memFree=97056/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3347580 CPUtime=4242.41 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 800360 0 0 0 424077 164 0 0 25 0 1 0 801552538 3427921920 797818 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 836895 797818 267 49 0 834036 0
Current children cumulated CPU time (s) 4242.41
Current children cumulated vsize (KiB) 3347580

[startup+4302.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/425 6228
/proc/meminfo: memFree=97160/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3350140 CPUtime=4302.42 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 800781 0 0 0 430078 164 0 0 25 0 1 0 801552538 3430543360 798239 33554432000 4194304 4394578 140734723272992 18446744073709551615 4327688 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 837535 798239 267 49 0 834676 0
Current children cumulated CPU time (s) 4302.42
Current children cumulated vsize (KiB) 3350140

[startup+4362.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/425 6230
/proc/meminfo: memFree=97312/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3363964 CPUtime=4362.42 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 803541 0 0 0 436077 165 0 0 25 0 1 0 801552538 3444699136 800999 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 840991 800999 267 49 0 838132 0
Current children cumulated CPU time (s) 4362.42
Current children cumulated vsize (KiB) 3363964

[startup+4422.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/425 6232
/proc/meminfo: memFree=93956/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3372156 CPUtime=4422.42 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 805253 0 0 0 442077 165 0 0 25 0 1 0 801552538 3453087744 802711 33554432000 4194304 4394578 140734723272992 18446744073709551615 4299126 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 843039 802711 267 49 0 840180 0
Current children cumulated CPU time (s) 4422.42
Current children cumulated vsize (KiB) 3372156

[startup+4482.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/425 6233
/proc/meminfo: memFree=95600/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3378300 CPUtime=4482.42 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 806511 0 0 0 448077 165 0 0 25 0 1 0 801552538 3459379200 803969 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 844575 803969 267 49 0 841716 0
Current children cumulated CPU time (s) 4482.42
Current children cumulated vsize (KiB) 3378300

[startup+4542.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/425 6235
/proc/meminfo: memFree=98444/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3385980 CPUtime=4542.42 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 807741 0 0 0 454077 165 0 0 25 0 1 0 801552538 3467243520 805199 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298985 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 846495 805199 267 49 0 843636 0
Current children cumulated CPU time (s) 4542.42
Current children cumulated vsize (KiB) 3385980

[startup+4602.3 s]
/proc/loadavg: 2.09 2.03 2.01 3/425 6237
/proc/meminfo: memFree=94008/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3394172 CPUtime=4602.44 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 809406 0 0 0 460078 166 0 0 25 0 1 0 801552538 3475632128 806864 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 848543 806864 267 49 0 845684 0
Current children cumulated CPU time (s) 4602.44
Current children cumulated vsize (KiB) 3394172

[startup+4662.3 s]
/proc/loadavg: 2.12 2.05 2.01 3/425 6238
/proc/meminfo: memFree=94680/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3402364 CPUtime=4662.43 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 810840 0 0 0 466077 166 0 0 25 0 1 0 801552538 3484020736 808298 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298818 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 850591 808298 267 49 0 847732 0
Current children cumulated CPU time (s) 4662.43
Current children cumulated vsize (KiB) 3402364

[startup+4722.32 s]
/proc/loadavg: 2.12 2.06 2.01 3/425 6240
/proc/meminfo: memFree=98420/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3402364 CPUtime=4722.45 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 810940 0 0 0 472079 166 0 0 25 0 1 0 801552538 3484020736 808398 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 850591 808398 267 49 0 847732 0
Current children cumulated CPU time (s) 4722.45
Current children cumulated vsize (KiB) 3402364

[startup+4782.3 s]
/proc/loadavg: 2.11 2.06 2.01 3/425 6241
/proc/meminfo: memFree=94212/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3416704 CPUtime=4782.43 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 813743 0 0 0 478077 166 0 0 25 0 1 0 801552538 3498704896 811201 33554432000 4194304 4394578 140734723272992 18446744073709551615 4327678 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 854176 811201 267 49 0 851317 0
Current children cumulated CPU time (s) 4782.43
Current children cumulated vsize (KiB) 3416704

[startup+4842.3 s]
/proc/loadavg: 2.30 2.11 2.03 3/425 6243
/proc/meminfo: memFree=97204/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3416704 CPUtime=4842.43 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 813765 0 0 0 484077 166 0 0 25 0 1 0 801552538 3498704896 811223 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298966 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 854176 811223 267 49 0 851317 0
Current children cumulated CPU time (s) 4842.43
Current children cumulated vsize (KiB) 3416704

[startup+4902.3 s]
/proc/loadavg: 2.18 2.10 2.03 3/425 6244
/proc/meminfo: memFree=94844/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3416704 CPUtime=4902.43 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 813795 0 0 0 490077 166 0 0 25 0 1 0 801552538 3498704896 811253 33554432000 4194304 4394578 140734723272992 18446744073709551615 4327617 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 854176 811253 267 49 0 851317 0
Current children cumulated CPU time (s) 4902.43
Current children cumulated vsize (KiB) 3416704

[startup+4962.3 s]
/proc/loadavg: 2.06 2.08 2.02 3/425 6255
/proc/meminfo: memFree=95924/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3421312 CPUtime=4962.43 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 814426 0 0 0 496077 166 0 0 25 0 1 0 801552538 3503423488 811884 33554432000 4194304 4394578 140734723272992 18446744073709551615 4327617 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 855328 811884 267 49 0 852469 0
Current children cumulated CPU time (s) 4962.43
Current children cumulated vsize (KiB) 3421312



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 1.95 2.05 2.01 2/423 6257
/proc/meminfo: memFree=4530944/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=3437732 CPUtime=5000.05 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4202496 817960 0 0 0 499837 168 0 0 25 0 1 0 801552538 3520237568 815418 33554432000 4194304 4394578 140734723272992 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/6101/statm: 859433 815418 267 49 0 856574 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 3437732

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000.02 s]
/proc/loadavg: 1.95 2.05 2.01 2/423 6257
/proc/meminfo: memFree=4530944/32951124 swapFree=44043512/67111528
[pid=6101] ppid=6099 vsize=0 CPUtime=5000.16 cores=0,2,4,6
/proc/6101/stat : 6101 (SApperloT2010) R 6099 6101 3013 0 -1 4203524 817960 0 0 0 499838 178 0 0 25 0 1 0 801552538 0 0 33554432000 0 0 0 0 0 0 0 4096 6 18446744073709551615 0 0 17 4 0 0 0
/proc/6101/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.16
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5000.04
CPU time (s): 5000.19
CPU user time (s): 4998.38
CPU system time (s): 1.80672
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 3437732

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4998.38
system time used= 1.80672
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 817960
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 4108

runsolver used 21.9437 second user time and 46.359 second system time

The end

Launcher Data 

Begin job on node134 at 2011-06-01 05:39:03
IDJOB=3438843
IDBENCH=83184
IDSOLVER=1933
FILE ID=node134/3438843-1306899543
RUNJOBID= node134-1306899542-6027
PBS_JOBID= 13488442
Free space on /tmp= 19260 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x39.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438843-1306899543/watcher-3438843-1306899543 -o /tmp/evaluation-result-3438843-1306899543/solver-3438843-1306899543 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3438843-1306899543.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e7679ca49bb432c9b90305d907365c4e
RANDOM SEED=1190861534

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       6908840 kB
Buffers:        107884 kB
Cached:       19298244 kB
SwapCached:       9328 kB
Active:       13574952 kB
Inactive:     11706740 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       6908840 kB
SwapTotal:    67111528 kB
SwapFree:     44043512 kB
Dirty:           19892 kB
Writeback:           0 kB
AnonPages:     5873152 kB
Mapped:          20812 kB
Slab:           604404 kB
PageTables:      89620 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 110819668 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 19264 MiB
End job on node134 at 2011-06-01 07:02:25