Trace number 3188555

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
QuteRSat 2011-03-01? (TO) 1300.07 1300.04

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S625465881-078-UNKNOWN.cnf
MD5SUM3ba69e7f651721ce4358ca0320f27486
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark497.12
Satisfiable
(Un)Satisfiability was proved
Number of variables35000
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Set FPU double precision.
0.09/0.18	c Parse Cnf success: #var: 35000 #clause: 147000
0.09/0.18	c Find Units :          0
0.09/0.18	c Find Invs  :          0
0.09/0.19	c Find Ands  :          0 AvgFaninNum: nan
0.19/0.20	c Find Xors  :          0 AvgFaninNum: nan
0.19/0.21	c Find Ite   :          0
0.19/0.29	c UnDirect variable: 0
0.19/0.29	c UnDirect to Direct Gate: 0
0.19/0.29	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
0.19/0.29	c Break Cycle : 0
0.19/0.29	c Total Root : 0 Undef Var: 35000
0.19/0.29	c After covering, Total Root: 0 Leaf: 0
0.19/0.29	c Variable( cover/uncovered/unused ): 0 35000 0
0.19/0.29	c Unit Clauses: 0
0.19/0.29	c Binary Clauses( cover/uncovered ): 0 0
0.19/0.29	c Clauses( cover/uncovered ): 0 147000
0.19/0.29	c Total Clauses( cover/uncovered ): 0 147000 0%
0.19/0.29	c Covered Ands: 0 Invs: 0 Xors: 0 Ites: 0
0.39/0.45	c Uncover Clauses avg size: 3 max size: 3
0.39/0.46	c Final circuit: i/l/o/s   35000       0  147000    293991
0.39/0.46	c CnfToAig: Time: 0.45 s
0.59/0.69	c TmMap: Set choices finish.
0.79/0.80	c TmMap: Set big and: 147000
0.79/0.80	c TmMap: Origin: 328992 ClauseNum: 881973 --> New: 182001 ClauseNum: 588000
0.79/0.80	c TmMap: Time: 0.16
0.79/0.84	c Try to Add: #clause: 294000 #xorclause: 0
0.89/0.92	c #var: 35000 #clauses: 147001 Solving... 
1300.02/1300.00	c Time Out !!
1300.02/1300.00	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3188555-1302282036/watcher-3188555-1302282036 -o /tmp/evaluation-result-3188555-1302282036/solver-3188555-1302282036 -C 2400 -W 1300 -M 7680 qutersat_release HOME/instance-3188555-1302282036.cnf 519184208 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.05 4.85 4/189 12248
/proc/meminfo: memFree=16839908/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=33388 CPUtime=0 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 2150 0 0 0 0 0 0 0 25 0 1 0 339801620 34189312 2082 33554432000 4194304 6016207 140734632077088 18446744073709551615 4305236 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 8347 2082 379 445 0 1891 0

[startup+0.080353 s]
/proc/loadavg: 4.00 4.05 4.85 4/189 12248
/proc/meminfo: memFree=16839908/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=49772 CPUtime=0.07 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 6164 0 0 0 7 0 0 0 25 0 1 0 339801620 50966528 6096 33554432000 4194304 6016207 140734632077088 18446744073709551615 4779602 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 12443 6097 379 445 0 5987 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 49772

[startup+0.100319 s]
/proc/loadavg: 4.00 4.05 4.85 4/189 12248
/proc/meminfo: memFree=16839908/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=60140 CPUtime=0.09 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 8722 0 0 0 9 0 0 0 25 0 1 0 339801620 61583360 8654 33554432000 4194304 6016207 140734632077088 18446744073709551615 4305236 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 15035 8654 379 445 0 8579 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 60140

[startup+0.300245 s]
/proc/loadavg: 4.00 4.05 4.85 4/189 12248
/proc/meminfo: memFree=16839908/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=67308 CPUtime=0.29 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 10726 0 0 0 28 1 0 0 25 0 1 0 339801620 68923392 10658 33554432000 4194304 6016207 140734632077088 18446744073709551615 4335949 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 16827 10658 400 445 0 10371 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 67308

[startup+0.700214 s]
/proc/loadavg: 4.00 4.05 4.85 4/189 12248
/proc/meminfo: memFree=16839908/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=125696 CPUtime=0.69 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 25041 0 0 0 67 2 0 0 18 0 1 0 339801620 128712704 24973 33554432000 4194304 6016207 140734632077088 18446744073709551615 4223990 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 31424 24973 672 445 0 24968 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 125696

[startup+1.5011 s]
/proc/loadavg: 4.00 4.05 4.85 5/190 12249
/proc/meminfo: memFree=16675388/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=144256 CPUtime=1.49 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 29241 0 0 0 146 3 0 0 19 0 1 0 339801620 147718144 29173 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425146 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 36064 29173 719 445 0 29608 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 144256

[startup+3.10082 s]
/proc/loadavg: 4.00 4.05 4.85 5/190 12249
/proc/meminfo: memFree=16665716/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=177584 CPUtime=3.09 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 29665 0 0 0 306 3 0 0 22 0 1 0 339801620 181846016 29597 33554432000 4194304 6016207 140734632077088 18446744073709551615 4426994 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 44396 29598 719 445 0 37940 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 177584

[startup+6.30025 s]
/proc/loadavg: 4.00 4.05 4.85 5/190 12249
/proc/meminfo: memFree=16628516/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=177584 CPUtime=6.29 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 32001 0 0 0 626 3 0 0 25 0 1 0 339801620 181846016 31933 33554432000 4194304 6016207 140734632077088 18446744073709551615 4387602 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 44396 31933 719 445 0 37940 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 177584

[startup+12.7011 s]
/proc/loadavg: 4.00 4.05 4.84 5/190 12249
/proc/meminfo: memFree=16502332/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=275160 CPUtime=12.69 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 46750 0 0 0 1264 5 0 0 25 0 1 0 339801620 281763840 46682 33554432000 4194304 6016207 140734632077088 18446744073709551615 4536800 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 68790 46682 727 445 0 62334 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 275160

[startup+25.5009 s]
/proc/loadavg: 4.00 4.05 4.83 5/190 12258
/proc/meminfo: memFree=16304904/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=357228 CPUtime=25.5 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 56292 0 0 0 2543 7 0 0 25 0 1 0 339801620 365801472 56224 33554432000 4194304 6016207 140734632077088 18446744073709551615 4373679 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 89307 56224 727 445 0 82851 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 357228

[startup+51.1005 s]
/proc/loadavg: 4.00 4.04 4.81 5/190 12259
/proc/meminfo: memFree=16085220/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=390780 CPUtime=51.09 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 77969 0 0 0 5099 10 0 0 25 0 1 0 339801620 400158720 77718 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425254 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 97695 77718 727 445 0 91239 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 390780

[startup+102.307 s]
/proc/loadavg: 4.00 4.03 4.76 5/190 12260
/proc/meminfo: memFree=15967284/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=435780 CPUtime=102.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 90849 0 0 0 10218 12 0 0 25 0 1 0 339801620 446238720 90598 33554432000 4194304 6016207 140734632077088 18446744073709551615 4606531 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 108945 90598 727 445 0 102489 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 435780

[startup+162.301 s]
/proc/loadavg: 4.00 4.03 4.71 5/190 12262
/proc/meminfo: memFree=15795024/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=456204 CPUtime=162.29 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 98394 0 0 0 16216 13 0 0 25 0 1 0 339801620 467152896 97916 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425705 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 114051 97916 727 445 0 107595 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 456204

[startup+222.301 s]
/proc/loadavg: 4.00 4.02 4.66 6/191 12266
/proc/meminfo: memFree=15666900/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=531608 CPUtime=222.29 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 106614 0 0 0 22215 14 0 0 25 0 1 0 339801620 544366592 106136 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 132902 106136 727 445 0 126446 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 531608

[startup+282.3 s]
/proc/loadavg: 4.00 4.01 4.62 5/190 12268
/proc/meminfo: memFree=15643356/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=652792 CPUtime=282.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 122396 0 0 0 28212 18 0 0 25 0 1 0 339801620 668459008 118147 33554432000 4194304 6016207 140734632077088 18446744073709551615 4426099 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 163198 118147 727 445 0 156742 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 652792

[startup+342.301 s]
/proc/loadavg: 4.00 4.01 4.58 5/190 12270
/proc/meminfo: memFree=15555800/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=652792 CPUtime=342.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 123189 0 0 0 34212 18 0 0 25 0 1 0 339801620 668459008 118940 33554432000 4194304 6016207 140734632077088 18446744073709551615 4377997 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 163198 118940 727 445 0 156742 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 652792

[startup+402.3 s]
/proc/loadavg: 4.00 4.00 4.54 5/190 12271
/proc/meminfo: memFree=15500844/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=652792 CPUtime=402.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 124292 0 0 0 40212 18 0 0 25 0 1 0 339801620 668459008 120043 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 163198 120043 727 445 0 156742 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 652792

[startup+462.301 s]
/proc/loadavg: 4.09 4.03 4.51 5/190 12273
/proc/meminfo: memFree=15488184/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=652792 CPUtime=462.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 125288 0 0 0 46212 18 0 0 25 0 1 0 339801620 668459008 121039 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425639 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 163198 121039 727 445 0 156742 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 652792

[startup+522.3 s]
/proc/loadavg: 4.03 4.02 4.48 5/190 12274
/proc/meminfo: memFree=15478252/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=652792 CPUtime=522.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 126344 0 0 0 52211 19 0 0 25 0 1 0 339801620 668459008 122095 33554432000 4194304 6016207 140734632077088 18446744073709551615 4387629 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 163198 122095 727 445 0 156742 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 652792

[startup+582.301 s]
/proc/loadavg: 4.01 4.02 4.44 5/190 12276
/proc/meminfo: memFree=15455544/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=652920 CPUtime=582.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 129222 0 0 0 58211 19 0 0 25 0 1 0 339801620 668590080 124973 33554432000 4194304 6016207 140734632077088 18446744073709551615 4378013 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 163230 124973 727 445 0 156774 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 652920

[startup+642.3 s]
/proc/loadavg: 4.00 4.01 4.41 5/190 12278
/proc/meminfo: memFree=15344796/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=716028 CPUtime=642.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 149564 0 0 0 64207 24 0 0 25 0 1 0 339801620 733212672 145315 33554432000 4194304 6016207 140734632077088 18446744073709551615 4424219 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 179007 145315 727 445 0 172551 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 716028

[startup+702.301 s]
/proc/loadavg: 4.00 4.00 4.38 5/190 12279
/proc/meminfo: memFree=15256600/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=779036 CPUtime=702.3 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 163664 0 0 0 70203 27 0 0 25 0 1 0 339801620 797732864 159415 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425176 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 194759 159415 727 445 0 188303 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 779036

[startup+762.306 s]
/proc/loadavg: 4.07 4.02 4.36 5/190 12281
/proc/meminfo: memFree=15215900/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=779036 CPUtime=762.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 168052 0 0 0 76203 28 0 0 25 0 1 0 339801620 797732864 163803 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425530 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 194759 163803 727 445 0 188303 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 779036

[startup+822.301 s]
/proc/loadavg: 4.02 4.01 4.34 5/190 12282
/proc/meminfo: memFree=15142468/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=842484 CPUtime=822.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 169554 0 0 0 82202 29 0 0 25 0 1 0 339801620 862703616 165305 33554432000 4194304 6016207 140734632077088 18446744073709551615 4377787 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 210621 165305 727 445 0 204165 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 842484

[startup+882.3 s]
/proc/loadavg: 4.01 4.00 4.31 5/190 12284
/proc/meminfo: memFree=15135260/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=842484 CPUtime=882.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 170710 0 0 0 88202 29 0 0 25 0 1 0 339801620 862703616 166461 33554432000 4194304 6016207 140734632077088 18446744073709551615 4385057 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 210621 166461 727 445 0 204165 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 842484

[startup+942.301 s]
/proc/loadavg: 4.00 4.00 4.29 5/190 12286
/proc/meminfo: memFree=15123716/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=842484 CPUtime=942.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 172193 0 0 0 94201 30 0 0 25 0 1 0 339801620 862703616 167944 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425185 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 210621 167944 727 445 0 204165 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 842484

[startup+1002.3 s]
/proc/loadavg: 4.15 4.04 4.28 5/190 12287
/proc/meminfo: memFree=15047932/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=842484 CPUtime=1002.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 173558 0 0 0 100201 30 0 0 25 0 1 0 339801620 862703616 169309 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425254 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 210621 169309 727 445 0 204165 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 842484

[startup+1062.3 s]
/proc/loadavg: 4.06 4.03 4.26 5/190 12289
/proc/meminfo: memFree=14927500/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=842868 CPUtime=1062.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 182006 0 0 0 106199 32 0 0 25 0 1 0 339801620 863096832 177757 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425132 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 210717 177757 727 445 0 204261 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 842868

[startup+1122.3 s]
/proc/loadavg: 4.02 4.02 4.25 5/190 12290
/proc/meminfo: memFree=14856064/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=842868 CPUtime=1122.31 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 186804 0 0 0 112198 33 0 0 25 0 1 0 339801620 863096832 182555 33554432000 4194304 6016207 140734632077088 18446744073709551615 4380234 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 210717 182555 727 445 0 204261 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 842868

[startup+1182.3 s]
/proc/loadavg: 4.00 4.02 4.23 5/190 12292
/proc/meminfo: memFree=14824920/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=1364692 CPUtime=1182.32 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 188241 0 0 0 118198 34 0 0 25 0 1 0 339801620 1397444608 183916 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425705 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 341173 183916 727 445 0 334717 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 1364692

[startup+1242.3 s]
/proc/loadavg: 4.00 4.01 4.21 5/190 12294
/proc/meminfo: memFree=14730916/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=1626416 CPUtime=1242.32 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 188974 0 0 0 124198 34 0 0 25 0 1 0 339801620 1665449984 184477 33554432000 4194304 6016207 140734632077088 18446744073709551615 4425639 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 406604 184477 727 445 0 400148 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 1626416



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 4.01 4.19 2/184 12298
/proc/meminfo: memFree=16169216/32951124 swapFree=67111524/67111528
[pid=12248] ppid=12246 vsize=1888872 CPUtime=1300.02 cores=4,6
/proc/12248/stat : 12248 (qutersat_releas) R 12246 12248 12041 0 -1 4202496 209440 0 0 0 129964 38 0 0 25 0 1 0 339801620 1934204928 192926 33554432000 4194304 6016207 140734632077088 18446744073709551615 4377997 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12248/statm: 472218 192926 727 445 0 465762 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 1888872

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 1
Real time (s): 1300.04
CPU time (s): 1300.07
CPU user time (s): 1299.65
CPU system time (s): 0.419936
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 1888872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.65
system time used= 0.419936
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 209445
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 1963

runsolver used 2.17467 second user time and 4.92925 second system time

The end

Launcher Data 

Begin job on node136 at 2011-04-08 19:00:37
IDJOB=3188555
IDBENCH=82686
IDSOLVER=1607
FILE ID=node136/3188555-1302282036
RUNJOBID= node136-1302280734-12060
PBS_JOBID= 12919095
Free space on /tmp= 71412 MiB

SOLVER NAME= QuteRSat 2011-03-01
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S625465881-078-UNKNOWN.cnf
COMMAND LINE= qutersat_release BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3188555-1302282036/watcher-3188555-1302282036 -o /tmp/evaluation-result-3188555-1302282036/solver-3188555-1302282036 -C 2400 -W 1300 -M 7680  qutersat_release HOME/instance-3188555-1302282036.cnf 519184208

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 3ba69e7f651721ce4358ca0320f27486
RANDOM SEED=519184208

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16840188 kB
Buffers:        446916 kB
Cached:       15120068 kB
SwapCached:          4 kB
Active:        7819548 kB
Inactive:      7918036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16840188 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           12060 kB
Writeback:           0 kB
AnonPages:      169520 kB
Mapped:          18944 kB
Slab:           309652 kB
PageTables:       5136 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   369328 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71412 MiB
End job on node136 at 2011-04-08 19:22:19