Trace number 3290051

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
kw 2011-02-28? (TO) 1300.05 1300.01

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_4_keyfind_1.cnf
MD5SUM07ea67092ce3fd4529e72f69434e3f99
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1808
Number of clauses9968
Sum of the clauses size39152
Maximum clause length5
Minimum clause length1
Number of clauses of size 1144
Number of clauses of size 2320
Number of clauses of size 33904
Number of clauses of size 41344
Number of clauses of size 54256
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3290051-1303785935/watcher-3290051-1303785935 -o /tmp/evaluation-result-3290051-1303785935/solver-3290051-1303785935 -C 2400 -W 1300 -M 7680 kw --tmp-path=HOME HOME/instance-3290051-1303785935.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.01 3.94 4/181 15207
/proc/meminfo: memFree=13032420/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=11800 CPUtime=0 cores=1,3
/proc/15207/stat : 15207 (runsolver) R 15205 15207 15038 0 -1 4202560 41 0 0 0 0 0 0 0 20 0 1 0 490193964 12083200 51 33554432000 4194304 5434984 140735641170448 18446744073709551615 4881607 0 2147483391 4096 24578 0 0 0 17 3 0 0 0
/proc/15207/statm: 2950 51 31 303 0 2644 0

[startup+0.103094 s]
/proc/loadavg: 4.00 4.01 3.94 4/181 15207
/proc/meminfo: memFree=13032420/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=6220 CPUtime=0.09 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 1107 0 0 0 9 0 0 0 20 0 1 0 490193964 6369280 958 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430885 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 1555 958 282 670 0 876 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 6220

[startup+0.201056 s]
/proc/loadavg: 4.00 4.01 3.94 4/181 15207
/proc/meminfo: memFree=13032420/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=6880 CPUtime=0.19 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 1292 0 0 0 19 0 0 0 20 0 1 0 490193964 7045120 1143 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430625 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 1720 1143 282 670 0 1041 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 6880

[startup+0.301036 s]
/proc/loadavg: 4.00 4.01 3.94 4/181 15207
/proc/meminfo: memFree=13032420/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=7660 CPUtime=0.29 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 1476 0 0 0 29 0 0 0 21 0 1 0 490193964 7843840 1327 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 1915 1327 282 670 0 1236 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7660

[startup+0.700964 s]
/proc/loadavg: 4.00 4.01 3.94 4/181 15207
/proc/meminfo: memFree=13032420/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=9660 CPUtime=0.69 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 1972 0 0 0 69 0 0 0 22 0 1 0 490193964 9891840 1823 33554432000 4194304 6935321 140735919590112 18446744073709551615 4433393 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 2415 1823 282 670 0 1736 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 9660

[startup+1.50082 s]
/proc/loadavg: 4.00 4.01 3.94 6/190 15246
/proc/meminfo: memFree=13011636/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=12688 CPUtime=1.48 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 2760 0 0 0 148 0 0 0 25 0 1 0 490193964 12992512 2611 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 3172 2611 282 670 0 2493 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 12688

[startup+3.10053 s]
/proc/loadavg: 4.00 4.01 3.94 6/190 15246
/proc/meminfo: memFree=12999360/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=17092 CPUtime=3.08 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 3865 0 0 0 308 0 0 0 25 0 1 0 490193964 17502208 3661 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430592 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 4273 3661 294 670 0 3594 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 17092

[startup+6.30094 s]
/proc/loadavg: 4.00 4.01 3.94 6/190 15246
/proc/meminfo: memFree=12981056/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=22660 CPUtime=6.29 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 5287 0 0 0 628 1 0 0 25 0 1 0 490193964 23203840 5083 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430662 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 5665 5083 294 670 0 4986 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 22660

[startup+12.7008 s]
/proc/loadavg: 4.08 4.02 3.95 6/190 15246
/proc/meminfo: memFree=12966576/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=26860 CPUtime=12.69 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 6337 0 0 0 1268 1 0 0 25 0 1 0 490193964 27504640 6048 33554432000 4194304 6935321 140735919590112 18446744073709551615 4429583 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 6715 6048 294 670 0 6036 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 26860

[startup+25.5004 s]
/proc/loadavg: 4.07 4.02 3.95 6/190 15246
/proc/meminfo: memFree=12954392/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=30144 CPUtime=25.49 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 7467 0 0 0 2547 2 0 0 25 0 1 0 490193964 30867456 6849 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430943 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 7536 6849 294 670 0 6857 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 30144

[startup+51.1008 s]
/proc/loadavg: 4.05 4.02 3.95 6/190 15247
/proc/meminfo: memFree=12944064/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=33296 CPUtime=51.08 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 8606 0 0 0 5106 2 0 0 25 0 1 0 490193964 34095104 7611 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 8324 7611 294 670 0 7645 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 33296

[startup+102.3 s]
/proc/loadavg: 4.02 4.02 3.95 6/190 15248
/proc/meminfo: memFree=12926196/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=39016 CPUtime=102.29 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 10855 0 0 0 10226 3 0 0 25 0 1 0 490193964 39952384 9017 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430636 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 9754 9017 294 670 0 9075 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 39016

[startup+162.3 s]
/proc/loadavg: 4.00 4.01 3.95 6/190 15250
/proc/meminfo: memFree=12911180/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=43880 CPUtime=162.29 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 12923 0 0 0 16225 4 0 0 25 0 1 0 490193964 44933120 10140 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 10970 10140 294 670 0 10291 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 43880

[startup+222.307 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15252
/proc/meminfo: memFree=12899764/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=48680 CPUtime=222.3 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 15194 0 0 0 22225 5 0 0 25 0 1 0 490193964 49848320 11359 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430709 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 12170 11359 294 670 0 11491 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 48680

[startup+282.301 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15253
/proc/meminfo: memFree=12892664/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=50132 CPUtime=282.29 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 16315 0 0 0 28223 6 0 0 25 0 1 0 490193964 51335168 11722 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 12533 11722 294 670 0 11854 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 50132

[startup+342.301 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15255
/proc/meminfo: memFree=12882976/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=53340 CPUtime=342.3 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 17926 0 0 0 34223 7 0 0 25 0 1 0 490193964 54620160 12530 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430964 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 13335 12530 294 670 0 12656 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 53340

[startup+402.301 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15256
/proc/meminfo: memFree=12876380/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=55504 CPUtime=402.29 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 19317 0 0 0 40221 8 0 0 25 0 1 0 490193964 56836096 13072 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430609 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 13876 13072 294 670 0 13197 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 55504

[startup+462.301 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15258
/proc/meminfo: memFree=12869536/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=58208 CPUtime=462.3 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 20892 0 0 0 46221 9 0 0 25 0 1 0 490193964 59604992 13752 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430621 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 14552 13752 294 670 0 13873 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 58208

[startup+522.301 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15260
/proc/meminfo: memFree=12861576/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=61692 CPUtime=522.31 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 22482 0 0 0 52221 10 0 0 25 0 1 0 490193964 63172608 14638 33554432000 4194304 6935321 140735919590112 18446744073709551615 4431230 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 15423 14638 294 670 0 14744 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 61692

[startup+582.301 s]
/proc/loadavg: 4.07 4.02 3.95 6/190 15261
/proc/meminfo: memFree=12856484/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=62768 CPUtime=582.3 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 23470 0 0 0 58220 10 0 0 25 0 1 0 490193964 64274432 14897 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430662 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 15692 14897 294 670 0 15013 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 62768

[startup+642.301 s]
/proc/loadavg: 4.02 4.01 3.95 6/190 15263
/proc/meminfo: memFree=12850640/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=65156 CPUtime=642.31 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 24821 0 0 0 64220 11 0 0 25 0 1 0 490193964 66719744 15494 33554432000 4194304 6935321 140735919590112 18446744073709551615 4347640 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 16289 15494 294 670 0 15610 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 65156

[startup+702.301 s]
/proc/loadavg: 4.01 4.00 3.95 6/190 15264
/proc/meminfo: memFree=12844432/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=67432 CPUtime=702.3 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 26187 0 0 0 70219 11 0 0 25 0 1 0 490193964 69050368 16080 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 16858 16080 294 670 0 16179 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 67432

[startup+762.301 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15266
/proc/meminfo: memFree=12839336/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=68092 CPUtime=762.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 26910 0 0 0 76220 12 0 0 25 0 1 0 490193964 69726208 16270 33554432000 4194304 6935321 140735919590112 18446744073709551615 4336101 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 17023 16270 294 670 0 16344 0
Current children cumulated CPU time (s) 762.32
Current children cumulated vsize (KiB) 68092

[startup+822.301 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15268
/proc/meminfo: memFree=12832012/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=71620 CPUtime=822.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 28600 0 0 0 82219 13 0 0 25 0 1 0 490193964 73338880 17138 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430943 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 17905 17138 294 670 0 17226 0
Current children cumulated CPU time (s) 822.32
Current children cumulated vsize (KiB) 71620

[startup+882.307 s]
/proc/loadavg: 4.00 4.00 3.95 6/190 15269
/proc/meminfo: memFree=12829136/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=71620 CPUtime=882.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 29173 0 0 0 88219 13 0 0 25 0 1 0 490193964 73338880 17148 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 17905 17148 294 670 0 17226 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 71620

[startup+942.301 s]
/proc/loadavg: 4.08 4.03 3.96 6/190 15280
/proc/meminfo: memFree=12825004/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=73620 CPUtime=942.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 30224 0 0 0 94218 14 0 0 25 0 1 0 490193964 75386880 17624 33554432000 4194304 6935321 140735919590112 18446744073709551615 4346555 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 18405 17624 294 670 0 17726 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 73620

[startup+1002.3 s]
/proc/loadavg: 4.03 4.02 3.96 6/190 15281
/proc/meminfo: memFree=12819900/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=75740 CPUtime=1002.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 31343 0 0 0 100218 14 0 0 25 0 1 0 490193964 77557760 18157 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430675 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 18935 18157 294 670 0 18256 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 75740

[startup+1062.3 s]
/proc/loadavg: 4.01 4.02 3.96 6/190 15283
/proc/meminfo: memFree=12816904/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=75872 CPUtime=1062.31 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 31991 0 0 0 106217 14 0 0 25 0 1 0 490193964 77692928 18208 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 18968 18208 294 670 0 18289 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 75872

[startup+1122.3 s]
/proc/loadavg: 4.00 4.01 3.96 6/190 15288
/proc/meminfo: memFree=12813352/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=77588 CPUtime=1122.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 33039 0 0 0 112217 15 0 0 25 0 1 0 490193964 79450112 18647 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 19397 18647 294 670 0 18718 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 77588

[startup+1182.3 s]
/proc/loadavg: 4.00 4.00 3.96 6/190 15289
/proc/meminfo: memFree=12808100/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=80584 CPUtime=1182.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 34092 0 0 0 118216 16 0 0 25 0 1 0 490193964 82518016 19079 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 20146 19079 294 670 0 19467 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 80584

[startup+1242.3 s]
/proc/loadavg: 4.00 4.00 3.96 6/190 15291
/proc/meminfo: memFree=12804112/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=81244 CPUtime=1242.32 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 34905 0 0 0 124216 16 0 0 25 0 1 0 490193964 83193856 19260 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430607 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 20311 19260 294 670 0 19632 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 81244



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 4.00 3.96 6/190 15292
/proc/meminfo: memFree=12801860/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=81508 CPUtime=1300.03 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 35608 0 0 0 129987 16 0 0 25 0 1 0 490193964 83464192 19320 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430621 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 20377 19320 294 670 0 19698 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 81508

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.00 4.00 3.96 6/190 15292
/proc/meminfo: memFree=12801860/32951124 swapFree=67111528/67111528
[pid=15207] ppid=15205 vsize=81508 CPUtime=1300.03 cores=1,3
/proc/15207/stat : 15207 (kw) R 15205 15207 15038 0 -1 4202496 35608 0 0 0 129987 16 0 0 25 0 1 0 490193964 83464192 19320 33554432000 4194304 6935321 140735919590112 18446744073709551615 4430621 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/15207/statm: 20377 19320 294 670 0 19698 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 81508

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.01
CPU time (s): 1300.05
CPU user time (s): 1299.87
CPU system time (s): 0.171973
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 82800

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.87
system time used= 0.171973
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35608
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 1744

runsolver used 1.9617 second user time and 5.09123 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-26 04:45:35
IDJOB=3290051
IDBENCH=83416
IDSOLVER=1658
FILE ID=node104/3290051-1303785935
RUNJOBID= node104-1303784633-15058
PBS_JOBID= 13157242
Free space on /tmp= 71828 MiB

SOLVER NAME= kw 2011-02-28
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_4_keyfind_1.cnf
COMMAND LINE= kw --tmp-path=TMPDIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3290051-1303785935/watcher-3290051-1303785935 -o /tmp/evaluation-result-3290051-1303785935/solver-3290051-1303785935 -C 2400 -W 1300 -M 7680  kw --tmp-path=HOME HOME/instance-3290051-1303785935.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 07ea67092ce3fd4529e72f69434e3f99
RANDOM SEED=1944698998

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13032972 kB
Buffers:       2288592 kB
Cached:       16980456 kB
SwapCached:          0 kB
Active:       10619028 kB
Inactive:      8716436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13032972 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            5460 kB
Writeback:           0 kB
AnonPages:       66432 kB
Mapped:          15072 kB
Slab:           517556 kB
PageTables:       4736 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   225580 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71828 MiB
End job on node104 at 2011-04-26 05:07:17