Trace number 3264192

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
QuteRSat 2011-03-01? (TO) 1300.07 1300.02

General information on the benchmark

NameSAT04/handmade/kexu/frb-0.8/
frb59-26-2.used-as.sat04-892.cnf
MD5SUMfd8d5783ed404e5c6590d627ffdcca50
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1534
Number of clauses132295
Sum of the clauses size266006
Maximum clause length26
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2132236
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 559

Solver Data 

0.00/0.00	c Set FPU double precision.
0.00/0.03	c Parse Cnf success: #var: 1534 #clause: 132295
0.00/0.03	c Find Units :          0
0.00/0.03	c Find Invs  :          0
0.00/0.04	c Find Ands  :       1534 AvgFaninNum: 25
0.00/0.04	c Find Xors  :          0 AvgFaninNum: nan
0.00/0.04	c Find Ite   :          0
0.00/0.04	c UnDirect variable: 0
0.00/0.04	c UnDirect to Direct Gate: 0
0.00/0.04	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
0.00/0.04	c Break Cycle : 1475
0.00/0.04	c Total Root : 0 Undef Var: 1475
0.00/0.04	c After covering, Total Root: 59 Leaf: 1475
0.00/0.04	c Variable( cover/uncovered/unused ): 1534 0 0
0.00/0.04	c Unit Clauses: 0
0.00/0.04	c Binary Clauses( cover/uncovered ): 1475 124947
0.00/0.04	c Clauses( cover/uncovered ): 59 0
0.00/0.04	c Total Clauses( cover/uncovered ): 1534 124947 1.21283%
0.00/0.04	c Covered Ands: 59 Invs: 0 Xors: 0 Ites: 0
0.05/0.09	c Uncover Clauses avg size: 2 max size: 2
0.05/0.09	c Final circuit: i/l/o/s    1475       0  124947    126363
0.05/0.09	c CnfToAig: Time: 0.09 s
0.09/0.16	c TmMap: Set choices finish.
0.19/0.21	c TmMap: Set big and: 125006
0.19/0.21	c TmMap: Origin: 127839 ClauseNum: 379089 --> New: 126482 ClauseNum: 376375
0.19/0.21	c TmMap: Time: 0.06
0.19/0.23	c Try to Add: #clause: 250012 #xorclause: 0
0.19/0.25	c #var: 1534 #clauses: 60 Solving... 
1300.04/1300.00	c Time Out !!
1300.04/1300.00	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3264192-1303569448/watcher-3264192-1303569448 -o /tmp/evaluation-result-3264192-1303569448/solver-3264192-1303569448 -C 2400 -W 1300 -M 7680 qutersat_release HOME/instance-3264192-1303569448.cnf 548857423 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.40 3.88 3.87 4/184 32204
/proc/meminfo: memFree=14724888/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=33388 CPUtime=0 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 2169 0 0 0 0 0 0 0 21 0 1 0 449360463 34189312 2103 33554432000 4194304 6016207 140736993679584 18446744073709551615 4279516 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 8347 2104 379 445 0 1891 0

[startup+0.055183 s]
/proc/loadavg: 3.40 3.88 3.87 4/184 32204
/proc/meminfo: memFree=14724888/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=39020 CPUtime=0.05 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 3635 0 0 0 5 0 0 0 21 0 1 0 449360463 39956480 3569 33554432000 4194304 6016207 140736993679584 18446744073709551615 4335448 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 9755 3569 400 445 0 3299 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 39020

[startup+0.101167 s]
/proc/loadavg: 3.40 3.88 3.87 4/184 32204
/proc/meminfo: memFree=14724888/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=43116 CPUtime=0.09 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 4689 0 0 0 9 0 0 0 21 0 1 0 449360463 44150784 4623 33554432000 4194304 6016207 140736993679584 18446744073709551615 4342367 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 10779 4624 437 445 0 4323 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 43116

[startup+0.301152 s]
/proc/loadavg: 3.40 3.88 3.87 4/184 32204
/proc/meminfo: memFree=14724888/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=79700 CPUtime=0.29 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 14089 0 0 0 28 1 0 0 22 0 1 0 449360463 81612800 14023 33554432000 4194304 6016207 140736993679584 18446744073709551615 4530896 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 19925 14023 705 445 0 13469 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 79700

[startup+0.701075 s]
/proc/loadavg: 3.40 3.88 3.87 4/184 32204
/proc/meminfo: memFree=14724888/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=89684 CPUtime=0.69 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 14536 0 0 0 68 1 0 0 24 0 1 0 449360463 91836416 14470 33554432000 4194304 6016207 140736993679584 18446744073709551615 4424334 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 22421 14470 718 445 0 15965 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 89684

[startup+1.50092 s]
/proc/loadavg: 3.45 3.88 3.87 5/190 32215
/proc/meminfo: memFree=14560168/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=99360 CPUtime=1.49 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 15077 0 0 0 148 1 0 0 25 0 1 0 449360463 101744640 15011 33554432000 4194304 6016207 140736993679584 18446744073709551615 4426099 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 24840 15011 718 445 0 18384 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 99360

[startup+3.10062 s]
/proc/loadavg: 3.45 3.88 3.87 5/190 32215
/proc/meminfo: memFree=14552860/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=99360 CPUtime=3.09 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 15381 0 0 0 308 1 0 0 25 0 1 0 449360463 101744640 15315 33554432000 4194304 6016207 140736993679584 18446744073709551615 4538661 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 24840 15315 727 445 0 18384 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 99360

[startup+6.30101 s]
/proc/loadavg: 3.49 3.88 3.87 5/190 32215
/proc/meminfo: memFree=14536372/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=109296 CPUtime=6.29 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 15490 0 0 0 628 1 0 0 25 0 1 0 449360463 111919104 15424 33554432000 4194304 6016207 140736993679584 18446744073709551615 4538609 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 27324 15424 727 445 0 20868 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 109296

[startup+12.7008 s]
/proc/loadavg: 3.53 3.88 3.87 5/190 32216
/proc/meminfo: memFree=14510680/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=109296 CPUtime=12.69 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 17386 0 0 0 1268 1 0 0 25 0 1 0 449360463 111919104 17320 33554432000 4194304 6016207 140736993679584 18446744073709551615 4424344 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 27324 17320 727 445 0 20868 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 109296

[startup+25.5004 s]
/proc/loadavg: 3.60 3.89 3.87 5/190 32216
/proc/meminfo: memFree=14468240/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=129040 CPUtime=25.49 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 20221 0 0 0 2547 2 0 0 25 0 1 0 449360463 132136960 20155 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425440 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 32260 20155 727 445 0 25804 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 129040

[startup+51.1005 s]
/proc/loadavg: 3.76 3.89 3.88 6/190 32217
/proc/meminfo: memFree=14431892/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=129040 CPUtime=51.09 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 22279 0 0 0 5107 2 0 0 25 0 1 0 449360463 132136960 22213 33554432000 4194304 6016207 140736993679584 18446744073709551615 4371014 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 32260 22213 727 445 0 25804 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 129040

[startup+102.307 s]
/proc/loadavg: 3.89 3.91 3.88 5/190 32218
/proc/meminfo: memFree=14336884/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=152044 CPUtime=102.3 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 27914 0 0 0 10226 4 0 0 25 0 1 0 449360463 155693056 27848 33554432000 4194304 6016207 140736993679584 18446744073709551615 4373467 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 38011 27848 727 445 0 31555 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 152044

[startup+162.301 s]
/proc/loadavg: 4.01 3.94 3.89 5/190 32220
/proc/meminfo: memFree=14261960/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=175444 CPUtime=162.29 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 35856 0 0 0 16225 4 0 0 25 0 1 0 449360463 179654656 35790 33554432000 4194304 6016207 140736993679584 18446744073709551615 4378259 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 43861 35790 727 445 0 37405 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 175444

[startup+222.3 s]
/proc/loadavg: 4.05 3.96 3.90 5/190 32221
/proc/meminfo: memFree=14201288/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=225816 CPUtime=222.3 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 38127 0 0 0 22225 5 0 0 25 0 1 0 449360463 231235584 38036 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425626 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 56454 38036 729 445 0 49998 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 225816

[startup+282.301 s]
/proc/loadavg: 4.02 3.97 3.91 5/190 32223
/proc/meminfo: memFree=14151152/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=327756 CPUtime=282.3 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 42119 0 0 0 28225 5 0 0 25 0 1 0 449360463 335622144 41947 33554432000 4194304 6016207 140736993679584 18446744073709551615 4381064 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 81939 41947 731 445 0 75483 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 327756

[startup+342.301 s]
/proc/loadavg: 4.00 3.97 3.91 5/190 32224
/proc/meminfo: memFree=14119504/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=327756 CPUtime=342.3 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 43121 0 0 0 34224 6 0 0 25 0 1 0 449360463 335622144 42802 33554432000 4194304 6016207 140736993679584 18446744073709551615 4513178 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 81939 42802 731 445 0 75483 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 327756

[startup+402.3 s]
/proc/loadavg: 4.04 3.99 3.91 5/190 32226
/proc/meminfo: memFree=14048408/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=327756 CPUtime=402.3 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 47127 0 0 0 40224 6 0 0 25 0 1 0 449360463 335622144 46438 33554432000 4194304 6016207 140736993679584 18446744073709551615 4381064 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 81939 46438 731 445 0 75483 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 327756

[startup+462.301 s]
/proc/loadavg: 4.01 3.99 3.91 5/190 32228
/proc/meminfo: memFree=14032256/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=327756 CPUtime=462.31 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 48958 0 0 0 46224 7 0 0 25 0 1 0 449360463 335622144 48269 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425530 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 81939 48269 731 445 0 75483 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 327756

[startup+522.301 s]
/proc/loadavg: 4.00 3.99 3.91 5/190 32229
/proc/meminfo: memFree=14038668/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=327756 CPUtime=522.3 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 49889 0 0 0 52223 7 0 0 25 0 1 0 449360463 335622144 49200 33554432000 4194304 6016207 140736993679584 18446744073709551615 4380045 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 81939 49200 731 445 0 75483 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 327756

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/190 32231
/proc/meminfo: memFree=13975272/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=582.32 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 60055 0 0 0 58221 11 0 0 25 0 1 0 449360463 395829248 59364 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425519 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 59364 729 445 0 90182 0
Current children cumulated CPU time (s) 582.32
Current children cumulated vsize (KiB) 386552

[startup+642.301 s]
/proc/loadavg: 4.00 3.99 3.91 5/190 32232
/proc/meminfo: memFree=13897240/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=642.32 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 63955 0 0 0 64221 11 0 0 25 0 1 0 449360463 395829248 63264 33554432000 4194304 6016207 140736993679584 18446744073709551615 4372831 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 63264 729 445 0 90182 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 386552

[startup+702.301 s]
/proc/loadavg: 4.03 4.00 3.92 5/190 32234
/proc/meminfo: memFree=13894852/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=702.31 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 64160 0 0 0 70220 11 0 0 25 0 1 0 449360463 395829248 63469 33554432000 4194304 6016207 140736993679584 18446744073709551615 4373669 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 63469 729 445 0 90182 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 386552

[startup+762.306 s]
/proc/loadavg: 4.01 4.00 3.92 5/190 32236
/proc/meminfo: memFree=13871020/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=762.33 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 64475 0 0 0 76221 12 0 0 25 0 1 0 449360463 395829248 63784 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425526 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 63784 729 445 0 90182 0
Current children cumulated CPU time (s) 762.33
Current children cumulated vsize (KiB) 386552

[startup+822.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 32237
/proc/meminfo: memFree=13843724/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=822.32 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 65265 0 0 0 82220 12 0 0 25 0 1 0 449360463 395829248 64574 33554432000 4194304 6016207 140736993679584 18446744073709551615 4378013 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 64574 729 445 0 90182 0
Current children cumulated CPU time (s) 822.32
Current children cumulated vsize (KiB) 386552

[startup+882.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 32239
/proc/meminfo: memFree=13822240/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=882.32 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 65422 0 0 0 88220 12 0 0 25 0 1 0 449360463 395829248 64731 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425995 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 64731 729 445 0 90182 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 386552

[startup+942.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 32240
/proc/meminfo: memFree=13813540/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=942.33 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 66748 0 0 0 94220 13 0 0 25 0 1 0 449360463 395829248 66057 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425705 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 66057 729 445 0 90182 0
Current children cumulated CPU time (s) 942.33
Current children cumulated vsize (KiB) 386552

[startup+1002.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 32242
/proc/meminfo: memFree=13789332/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=1002.33 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 67155 0 0 0 100220 13 0 0 25 0 1 0 449360463 395829248 66464 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425467 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 66464 729 445 0 90182 0
Current children cumulated CPU time (s) 1002.33
Current children cumulated vsize (KiB) 386552

[startup+1062.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 32244
/proc/meminfo: memFree=13779012/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=386552 CPUtime=1062.33 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 67456 0 0 0 106220 13 0 0 25 0 1 0 449360463 395829248 66765 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425626 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 96638 66765 729 445 0 90182 0
Current children cumulated CPU time (s) 1062.33
Current children cumulated vsize (KiB) 386552

[startup+1122.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 32245
/proc/meminfo: memFree=13754920/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=453552 CPUtime=1122.33 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 72544 0 0 0 112219 14 0 0 25 0 1 0 449360463 464437248 71848 33554432000 4194304 6016207 140736993679584 18446744073709551615 4424309 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 113388 71848 729 445 0 106932 0
Current children cumulated CPU time (s) 1122.33
Current children cumulated vsize (KiB) 453552

[startup+1182.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 32247
/proc/meminfo: memFree=13752036/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=521112 CPUtime=1182.33 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 72884 0 0 0 118219 14 0 0 25 0 1 0 449360463 533618688 72188 33554432000 4194304 6016207 140736993679584 18446744073709551615 4567728 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 130278 72188 729 445 0 123822 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 521112

[startup+1242.3 s]
/proc/loadavg: 4.04 4.01 3.93 5/190 32248
/proc/meminfo: memFree=13726576/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=521112 CPUtime=1242.33 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 73441 0 0 0 124219 14 0 0 25 0 1 0 449360463 533618688 72735 33554432000 4194304 6016207 140736993679584 18446744073709551615 4379459 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 130278 72735 729 445 0 123822 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 521112



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.01 4.02 3.93 4/190 32252
/proc/meminfo: memFree=13948620/32951124 swapFree=67111528/67111528
[pid=32204] ppid=32202 vsize=521112 CPUtime=1300.04 cores=4,6
/proc/32204/stat : 32204 (qutersat_releas) R 32202 32204 32154 0 -1 4202496 73774 0 0 0 129990 14 0 0 25 0 1 0 449360463 533618688 73035 33554432000 4194304 6016207 140736993679584 18446744073709551615 4425530 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32204/statm: 130278 73035 728 445 0 123822 0
Current children cumulated CPU time (s) 1300.04
Current children cumulated vsize (KiB) 521112

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 1
Real time (s): 1300.02
CPU time (s): 1300.07
CPU user time (s): 1299.9
CPU system time (s): 0.162975
CPU usage (%): 100.004
Max. virtual memory (cumulated for all children) (KiB): 521112

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.9
system time used= 0.162975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 73779
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 14749

runsolver used 2.29065 second user time and 4.67729 second system time

The end

Launcher Data 

Begin job on node141 at 2011-04-23 16:37:29
IDJOB=3264192
IDBENCH=84560
IDSOLVER=1607
FILE ID=node141/3264192-1303569448
RUNJOBID= node141-1303569448-32173
PBS_JOBID= 13150314
Free space on /tmp= 70956 MiB

SOLVER NAME= QuteRSat 2011-03-01
BENCH NAME= SAT04/handmade/kexu/frb-0.8/frb59-26-2.used-as.sat04-892.cnf
COMMAND LINE= qutersat_release BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3264192-1303569448/watcher-3264192-1303569448 -o /tmp/evaluation-result-3264192-1303569448/solver-3264192-1303569448 -C 2400 -W 1300 -M 7680  qutersat_release HOME/instance-3264192-1303569448.cnf 548857423

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= fd8d5783ed404e5c6590d627ffdcca50
RANDOM SEED=548857423

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14725416 kB
Buffers:       1625924 kB
Cached:       15945652 kB
SwapCached:          0 kB
Active:        9759316 kB
Inactive:      7893080 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14725416 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            8004 kB
Writeback:           0 kB
AnonPages:       80196 kB
Mapped:          15956 kB
Slab:           509016 kB
PageTables:       5352 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   247092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 70956 MiB
End job on node141 at 2011-04-23 16:59:11