Trace number 3438483

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.06 4999.95

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2640c305320gyes3.cnf
MD5SUMd6877629cc818d7e31dc245fb95f0588
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2640
Number of clauses305320
Sum of the clauses size613120
Maximum clause length33
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2305240
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 580

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438483-1306889539/watcher-3438483-1306889539 -o /tmp/evaluation-result-3438483-1306889539/solver-3438483-1306889539 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3438483-1306889539.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.06 2.05 2.01 1/512 20603
/proc/meminfo: memFree=4258376/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=17804 CPUtime=0 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 1279 0 0 0 0 0 0 0 25 0 1 0 879184728 18231296 1218 33554432000 4194304 4394578 140734639302880 18446744073709551615 215988253381 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 4451 1218 247 49 0 1592 0

[startup+0.0950419 s]
/proc/loadavg: 2.06 2.05 2.01 1/512 20603
/proc/meminfo: memFree=4258376/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=29420 CPUtime=0.09 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 4159 0 0 0 9 0 0 0 25 0 1 0 879184728 30126080 4098 33554432000 4194304 4394578 140734639302880 18446744073709551615 215988592384 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 7355 4099 247 49 0 4496 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29420

[startup+0.101036 s]
/proc/loadavg: 2.06 2.05 2.01 1/512 20603
/proc/meminfo: memFree=4258376/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=29948 CPUtime=0.09 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 4301 0 0 0 9 0 0 0 25 0 1 0 879184728 30666752 4240 33554432000 4194304 4394578 140734639302880 18446744073709551615 215988592384 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 7487 4243 247 49 0 4628 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29948

[startup+0.301005 s]
/proc/loadavg: 2.06 2.05 2.01 1/512 20603
/proc/meminfo: memFree=4258376/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=40568 CPUtime=0.29 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 6982 0 0 0 28 1 0 0 25 0 1 0 879184728 41541632 6920 33554432000 4194304 4394578 140734639302880 18446744073709551615 215988617111 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 10142 6920 255 49 0 7283 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 40568

[startup+0.700819 s]
/proc/loadavg: 2.06 2.05 2.01 1/512 20603
/proc/meminfo: memFree=4258376/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=52036 CPUtime=0.69 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 11042 0 0 0 67 2 0 0 25 0 1 0 879184728 53284864 9786 33554432000 4194304 4394578 140734639302880 18446744073709551615 215988253381 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 13009 9786 266 49 0 10150 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 52036

[startup+1.50068 s]
/proc/loadavg: 2.06 2.05 2.01 3/515 20631
/proc/meminfo: memFree=4188888/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=62800 CPUtime=1.49 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 13734 0 0 0 147 2 0 0 25 0 1 0 879184728 64307200 12478 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 15700 12478 266 49 0 12841 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 62800

[startup+3.10051 s]
/proc/loadavg: 2.06 2.05 2.01 3/515 20631
/proc/meminfo: memFree=4155040/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=77796 CPUtime=3.09 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 17445 0 0 0 306 3 0 0 25 0 1 0 879184728 79663104 16189 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 19449 16189 266 49 0 16590 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 77796

[startup+6.30095 s]
/proc/loadavg: 2.06 2.05 2.01 3/515 20632
/proc/meminfo: memFree=4102468/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=99072 CPUtime=6.29 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 22721 0 0 0 625 4 0 0 25 0 1 0 879184728 101449728 21465 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298652 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 24768 21465 266 49 0 21909 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 99072

[startup+12.7008 s]
/proc/loadavg: 2.05 2.05 2.00 3/515 20632
/proc/meminfo: memFree=4027948/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=132568 CPUtime=12.69 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 30872 0 0 0 1264 5 0 0 25 0 1 0 879184728 135749632 29616 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298664 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 33142 29616 266 49 0 30283 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 132568

[startup+25.5006 s]
/proc/loadavg: 2.04 2.05 2.00 3/515 20632
/proc/meminfo: memFree=3924796/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=183588 CPUtime=25.49 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 43194 0 0 0 2542 7 0 0 25 0 1 0 879184728 187994112 41938 33554432000 4194304 4394578 140734639302880 18446744073709551615 215988253381 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 45897 41938 266 49 0 43038 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 183588

[startup+51.1011 s]
/proc/loadavg: 2.02 2.04 2.00 3/515 20633
/proc/meminfo: memFree=3883468/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=205176 CPUtime=51.09 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 48445 0 0 0 5101 8 0 0 25 0 1 0 879184728 210100224 47189 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298985 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 51294 47189 266 49 0 48435 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 205176

[startup+102.319 s]
/proc/loadavg: 2.01 2.03 2.00 3/515 20634
/proc/meminfo: memFree=3810172/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=243648 CPUtime=102.31 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 57316 0 0 0 10221 10 0 0 25 0 1 0 879184728 249495552 56060 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298373 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 60912 56060 266 49 0 58053 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 243648

[startup+162.301 s]
/proc/loadavg: 2.00 2.02 2.00 3/515 20636
/proc/meminfo: memFree=3775284/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=258552 CPUtime=162.29 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 60510 0 0 0 16219 10 0 0 25 0 1 0 879184728 264757248 59254 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298795 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 64638 59254 266 49 0 61779 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 258552

[startup+222.301 s]
/proc/loadavg: 2.12 2.05 2.01 3/515 20637
/proc/meminfo: memFree=3704816/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=299144 CPUtime=222.3 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 69782 0 0 0 22218 12 0 0 25 0 1 0 879184728 306323456 68526 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 74786 68526 266 49 0 71927 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 299144

[startup+282.301 s]
/proc/loadavg: 2.04 2.04 2.00 3/515 20639
/proc/meminfo: memFree=3663356/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=326596 CPUtime=282.3 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 75706 0 0 0 28217 13 0 0 25 0 1 0 879184728 334434304 74450 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 81649 74450 266 49 0 78790 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 326596

[startup+342.301 s]
/proc/loadavg: 2.01 2.03 2.00 3/515 20641
/proc/meminfo: memFree=3621396/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=353720 CPUtime=342.3 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 81547 0 0 0 34216 14 0 0 25 0 1 0 879184728 362209280 80291 33554432000 4194304 4394578 140734639302880 18446744073709551615 4346589 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 88430 80291 266 49 0 85571 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 353720

[startup+402.301 s]
/proc/loadavg: 2.00 2.02 2.00 3/515 20642
/proc/meminfo: memFree=3586884/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=372540 CPUtime=402.3 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 85537 0 0 0 40215 15 0 0 25 0 1 0 879184728 381480960 84281 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298862 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 93135 84281 266 49 0 90276 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 372540

[startup+462.301 s]
/proc/loadavg: 2.14 2.06 2.01 3/515 20644
/proc/meminfo: memFree=3567864/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=387200 CPUtime=462.3 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 88730 0 0 0 46214 16 0 0 25 0 1 0 879184728 396492800 87474 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 96800 87474 266 49 0 93941 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 387200

[startup+522.301 s]
/proc/loadavg: 2.05 2.05 2.00 3/515 20645
/proc/meminfo: memFree=3532240/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=390876 CPUtime=522.3 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 89544 0 0 0 52214 16 0 0 25 0 1 0 879184728 400257024 88288 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298773 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 97719 88288 266 49 0 94860 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 390876

[startup+582.301 s]
/proc/loadavg: 2.02 2.04 2.00 3/515 20656
/proc/meminfo: memFree=3496148/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=405044 CPUtime=582.3 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 92842 0 0 0 58213 17 0 0 25 0 1 0 879184728 414765056 91586 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 101261 91586 266 49 0 98402 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 405044

[startup+642.301 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 2.00 2.02 2.00 3/515 20752
/proc/meminfo: memFree=2946564/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=732156 CPUtime=4062.4 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 167162 0 0 0 406204 36 0 0 25 0 1 0 879184728 749727744 165906 33554432000 4194304 4394578 140734639302880 18446744073709551615 4346561 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 183039 165906 266 49 0 180180 0
Current children cumulated CPU time (s) 4062.4
Current children cumulated vsize (KiB) 732156

[startup+4122.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/515 20753
/proc/meminfo: memFree=2944180/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=733564 CPUtime=4122.39 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 167435 0 0 0 412203 36 0 0 25 0 1 0 879184728 751169536 166179 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 183391 166179 266 49 0 180532 0
Current children cumulated CPU time (s) 4122.39
Current children cumulated vsize (KiB) 733564

[startup+4182.3 s]
/proc/loadavg: 2.15 2.04 2.01 4/522 20853
/proc/meminfo: memFree=2931368/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=735868 CPUtime=4182.39 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 167882 0 0 0 418203 36 0 0 25 0 1 0 879184728 753528832 166626 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 183967 166626 266 49 0 181108 0
Current children cumulated CPU time (s) 4182.39
Current children cumulated vsize (KiB) 735868

[startup+4242.3 s]
/proc/loadavg: 2.13 2.05 2.01 3/515 21250
/proc/meminfo: memFree=2952576/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=739068 CPUtime=4242.39 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 168525 0 0 0 424203 36 0 0 25 0 1 0 879184728 756805632 167269 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 184767 167269 266 49 0 181908 0
Current children cumulated CPU time (s) 4242.39
Current children cumulated vsize (KiB) 739068

[startup+4302.3 s]
/proc/loadavg: 2.04 2.04 2.00 3/515 21251
/proc/meminfo: memFree=2946604/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=741628 CPUtime=4302.38 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 169005 0 0 0 430202 36 0 0 25 0 1 0 879184728 759427072 167749 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298951 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 185407 167749 266 49 0 182548 0
Current children cumulated CPU time (s) 4302.38
Current children cumulated vsize (KiB) 741628

[startup+4362.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/515 21253
/proc/meminfo: memFree=2943720/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=743164 CPUtime=4362.39 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 169300 0 0 0 436202 37 0 0 25 0 1 0 879184728 760999936 168044 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 185791 168044 266 49 0 182932 0
Current children cumulated CPU time (s) 4362.39
Current children cumulated vsize (KiB) 743164

[startup+4422.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/515 21254
/proc/meminfo: memFree=2936872/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=746620 CPUtime=4422.39 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 169940 0 0 0 442202 37 0 0 25 0 1 0 879184728 764538880 168684 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 186655 168684 266 49 0 183796 0
Current children cumulated CPU time (s) 4422.39
Current children cumulated vsize (KiB) 746620

[startup+4482.3 s]
/proc/loadavg: 2.08 2.04 2.01 3/515 21256
/proc/meminfo: memFree=2931504/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=748416 CPUtime=4482.4 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 170288 0 0 0 448203 37 0 0 25 0 1 0 879184728 766377984 169032 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 187104 169032 266 49 0 184245 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 748416

[startup+4542.3 s]
/proc/loadavg: 2.06 2.05 2.01 3/515 21258
/proc/meminfo: memFree=2925260/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=752640 CPUtime=4542.4 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 171119 0 0 0 454203 37 0 0 25 0 1 0 879184728 770703360 169863 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 188160 169863 266 49 0 185301 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 752640

[startup+4602.3 s]
/proc/loadavg: 2.02 2.04 2.00 3/515 21259
/proc/meminfo: memFree=2915180/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=758656 CPUtime=4602.41 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 172276 0 0 0 460204 37 0 0 25 0 1 0 879184728 776863744 171020 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298989 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 189664 171020 266 49 0 186805 0
Current children cumulated CPU time (s) 4602.41
Current children cumulated vsize (KiB) 758656

[startup+4662.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/515 21261
/proc/meminfo: memFree=2912164/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=761344 CPUtime=4662.4 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 172858 0 0 0 466203 37 0 0 25 0 1 0 879184728 779616256 171602 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298818 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 190336 171602 266 49 0 187477 0
Current children cumulated CPU time (s) 4662.4
Current children cumulated vsize (KiB) 761344

[startup+4722.32 s]
/proc/loadavg: 2.00 2.02 2.00 3/515 21262
/proc/meminfo: memFree=2909036/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=765952 CPUtime=4722.42 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 173737 0 0 0 472205 37 0 0 25 0 1 0 879184728 784334848 172481 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 191488 172481 266 49 0 188629 0
Current children cumulated CPU time (s) 4722.42
Current children cumulated vsize (KiB) 765952

[startup+4782.3 s]
/proc/loadavg: 2.07 2.04 2.01 3/515 21264
/proc/meminfo: memFree=2904664/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=770688 CPUtime=4782.4 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 174619 0 0 0 478203 37 0 0 25 0 1 0 879184728 789184512 173363 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 192672 173363 266 49 0 189813 0
Current children cumulated CPU time (s) 4782.4
Current children cumulated vsize (KiB) 770688

[startup+4842.3 s]
/proc/loadavg: 2.06 2.05 2.01 3/515 21266
/proc/meminfo: memFree=2898044/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=773120 CPUtime=4842.4 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 175157 0 0 0 484202 38 0 0 25 0 1 0 879184728 791674880 173901 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 193280 173901 266 49 0 190421 0
Current children cumulated CPU time (s) 4842.4
Current children cumulated vsize (KiB) 773120

[startup+4902.3 s]
/proc/loadavg: 2.02 2.04 2.00 3/515 21267
/proc/meminfo: memFree=2863788/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=773888 CPUtime=4902.41 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 175268 0 0 0 490203 38 0 0 25 0 1 0 879184728 792461312 174012 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 193472 174012 266 49 0 190613 0
Current children cumulated CPU time (s) 4902.41
Current children cumulated vsize (KiB) 773888

[startup+4962.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/515 21269
/proc/meminfo: memFree=2853584/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=774272 CPUtime=4962.41 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 175340 0 0 0 496203 38 0 0 25 0 1 0 879184728 792854528 174084 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 193568 174084 266 49 0 190709 0
Current children cumulated CPU time (s) 4962.41
Current children cumulated vsize (KiB) 774272



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.15 2.06 2.01 3/515 21270
/proc/meminfo: memFree=2852684/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=774272 CPUtime=5000.01 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 175355 0 0 0 499963 38 0 0 25 0 1 0 879184728 792854528 174099 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 193568 174099 266 49 0 190709 0
Current children cumulated CPU time (s) 5000.01
Current children cumulated vsize (KiB) 774272

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.15 2.06 2.01 3/515 21270
/proc/meminfo: memFree=2852684/32950940 swapFree=67111364/67111528
[pid=20603] ppid=20601 vsize=774272 CPUtime=5000.01 cores=0,2,4,6
/proc/20603/stat : 20603 (SApperloT2010) R 20601 20603 20386 0 -1 4202496 175355 0 0 0 499963 38 0 0 25 0 1 0 879184728 792854528 174099 33554432000 4194304 4394578 140734639302880 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/20603/statm: 193568 174099 266 49 0 190709 0
Current children cumulated CPU time (s) 5000.01
Current children cumulated vsize (KiB) 774272

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.95
CPU time (s): 5000.06
CPU user time (s): 4999.65
CPU system time (s): 0.413937
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 774272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.65
system time used= 0.413937
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 175355
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 4996

runsolver used 25.9131 second user time and 56.4804 second system time

The end

Launcher Data 

Begin job on node117 at 2011-06-01 02:52:20
IDJOB=3438483
IDBENCH=71423
IDSOLVER=1933
FILE ID=node117/3438483-1306889539
RUNJOBID= node117-1306884537-20404
PBS_JOBID= 13488459
Free space on /tmp= 58348 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2640c305320gyes3.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438483-1306889539/watcher-3438483-1306889539 -o /tmp/evaluation-result-3438483-1306889539/solver-3438483-1306889539 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3438483-1306889539.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d6877629cc818d7e31dc245fb95f0588
RANDOM SEED=1058150467

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:       4258532 kB
Buffers:        308812 kB
Cached:       17897796 kB
SwapCached:          0 kB
Active:       20935244 kB
Inactive:      7059260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:       4258532 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            4292 kB
Writeback:           0 kB
AnonPages:     9787736 kB
Mapped:          41980 kB
Slab:           569824 kB
PageTables:      57956 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 149505756 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 58384 MiB
End job on node117 at 2011-06-01 04:15:41