Trace number 1797209

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
kw_pre 2009-03-21? (TO) 1200.07 1200.71

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_11_UNKNOWN.cnf
MD5SUMb02fa517730e45c506203f9bd7ebb62c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1740
Number of clauses104640
Sum of the clauses size311346
Maximum clause length12
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22781
Number of clauses of size 3101836
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1797209-1242086114/watcher-1797209-1242086114 -o /tmp/evaluation-result-1797209-1242086114/solver-1797209-1242086114 -C 1200 -W 1800 -M 1800 HOME/kw_pre HOME/instance-1797209-1242086114.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 10166
/proc/meminfo: memFree=1374016/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) R 10164 10166 9663 0 -1 4194304 262 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 230 1992294400 4194304 4889804 548682068832 18446744073709551615 259913214623 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/10166/statm: 1339 230 191 169 0 50 0
[pid=10167] ppid=10166 vsize=3764 CPUtime=0
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 581 0 0 0 0 0 0 0 18 0 1 0 236645361 3854336 557 1992294400 4194304 6416590 548682068912 18446744073709551615 5489867 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 941 566 205 542 0 390 0

[startup+0.0462129 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 10166
/proc/meminfo: memFree=1374016/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=5588 CPUtime=0.04
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 827 0 0 0 4 0 0 0 18 0 1 0 236645361 5722112 803 1992294400 4194304 6416590 548682068912 18446744073709551615 5489867 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 1397 803 215 542 0 846 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 10944

[startup+0.101221 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 10166
/proc/meminfo: memFree=1374016/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=6908 CPUtime=0.08
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 1175 0 0 0 8 0 0 0 19 0 1 0 236645361 7073792 1151 1992294400 4194304 6416590 548682068912 18446744073709551615 5489867 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 1727 1151 215 542 0 1176 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 12264

[startup+0.301255 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 10166
/proc/meminfo: memFree=1374016/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=11164 CPUtime=0.29
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 2346 0 0 0 28 1 0 0 21 0 1 0 236645361 11431936 2322 1992294400 4194304 6416590 548682068912 18446744073709551615 5489867 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 2791 2322 215 542 0 2240 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 16520

[startup+0.701326 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 10166
/proc/meminfo: memFree=1374016/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=18504 CPUtime=0.69
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 4209 0 0 0 67 2 0 0 25 0 1 0 236645361 18948096 4185 1992294400 4194304 6416590 548682068912 18446744073709551615 4268784 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 4626 4185 233 542 0 4075 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 23860

[startup+1.50147 s]
/proc/loadavg: 1.00 1.00 1.00 3/66 10168
/proc/meminfo: memFree=1357936/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=23500 CPUtime=1.49
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 5255 0 0 0 146 3 0 0 25 0 1 0 236645361 24064000 5231 1992294400 4194304 6416590 548682068912 18446744073709551615 4511333 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 5875 5231 242 542 0 5324 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 28856

[startup+3.10175 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10168
/proc/meminfo: memFree=1352432/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=24160 CPUtime=3.08
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 5437 0 0 0 305 3 0 0 25 0 1 0 236645361 24739840 5413 1992294400 4194304 6416590 548682068912 18446744073709551615 4567576 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 6040 5413 242 542 0 5489 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 29516

[startup+6.30131 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10168
/proc/meminfo: memFree=1352688/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=23500 CPUtime=6.28
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 5478 0 0 0 625 3 0 0 25 0 1 0 236645361 24064000 5304 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 5875 5304 250 542 0 5324 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 28856

[startup+12.7014 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10168
/proc/meminfo: memFree=1345456/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=32104 CPUtime=12.68
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 7410 0 0 0 1263 5 0 0 25 0 1 0 236645361 32874496 7196 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 8026 7196 254 542 0 7475 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 37460

[startup+25.5017 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10168
/proc/meminfo: memFree=1336816/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=42100 CPUtime=25.47
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 9708 0 0 0 2537 10 0 0 25 0 1 0 236645361 43110400 9337 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 10525 9337 254 542 0 9974 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 47456

[startup+51.1012 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10168
/proc/meminfo: memFree=1327344/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=53604 CPUtime=51.06
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 12270 0 0 0 5093 13 0 0 25 0 1 0 236645361 54890496 11751 1992294400 4194304 6416590 548682068912 18446744073709551615 4294648 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 13401 11751 254 542 0 12850 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 58960

[startup+102.305 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10168
/proc/meminfo: memFree=1312048/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=72092 CPUtime=102.24
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 16332 0 0 0 10202 22 0 0 25 0 1 0 236645361 73822208 15498 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 18023 15498 254 542 0 17472 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 77448

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10168
/proc/meminfo: memFree=1296112/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=89604 CPUtime=162.22
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 20639 0 0 0 16192 30 0 0 25 0 1 0 236645361 91754496 19509 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 22401 19509 254 542 0 21850 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 94960

[startup+222.301 s]
/proc/loadavg: 1.07 1.02 1.00 2/66 10168
/proc/meminfo: memFree=1281328/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=108932 CPUtime=222.19
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 24447 0 0 0 22185 34 0 0 25 0 1 0 236645361 111546368 23135 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 27233 23135 254 542 0 26682 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 114288

[startup+282.302 s]
/proc/loadavg: 1.08 1.03 1.00 2/66 10168
/proc/meminfo: memFree=1278064/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=111756 CPUtime=282.15
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 25265 0 0 0 28179 36 0 0 25 0 1 0 236645361 114438144 23953 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 27939 23953 254 542 0 27388 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 117112

[startup+342.301 s]
/proc/loadavg: 1.09 1.04 1.00 2/66 10168
/proc/meminfo: memFree=1256880/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=140216 CPUtime=342.13
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 30739 0 0 0 34170 43 0 0 25 0 1 0 236645361 143581184 29186 1992294400 4194304 6416590 548682068912 18446744073709551615 4294632 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 35054 29186 254 542 0 34503 0
Current children cumulated CPU time (s) 342.13

################
# More data... #
################

/proc/10167/statm: 43985 36713 254 542 0 43434 0
Current children cumulated CPU time (s) 582.01
Current children cumulated vsize (KiB) 181296

[startup+642.302 s]
/proc/loadavg: 1.00 1.04 1.01 2/66 10174
/proc/meminfo: memFree=1218736/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=188220 CPUtime=641.97
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 41239 0 0 0 64125 72 0 0 25 0 1 0 236645361 192737280 38725 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 47055 38725 254 542 0 46504 0
Current children cumulated CPU time (s) 641.97
Current children cumulated vsize (KiB) 193576

[startup+702.301 s]
/proc/loadavg: 1.00 1.03 1.00 2/66 10174
/proc/meminfo: memFree=1208944/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=199812 CPUtime=701.92
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 44597 0 0 0 70109 83 0 0 25 0 1 0 236645361 204607488 41178 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 49953 41178 254 542 0 49402 0
Current children cumulated CPU time (s) 701.92
Current children cumulated vsize (KiB) 205168

[startup+762.306 s]
/proc/loadavg: 1.00 1.02 1.00 2/66 10174
/proc/meminfo: memFree=1198064/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=212460 CPUtime=761.9
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 47826 0 0 0 76096 94 0 0 25 0 1 0 236645361 217559040 43851 1992294400 4194304 6416590 548682068912 18446744073709551615 4294711 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 53115 43851 254 542 0 52564 0
Current children cumulated CPU time (s) 761.9
Current children cumulated vsize (KiB) 217816

[startup+822.302 s]
/proc/loadavg: 1.00 1.02 1.00 2/66 10174
/proc/meminfo: memFree=1193904/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=218204 CPUtime=821.84
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 48937 0 0 0 82085 99 0 0 25 0 1 0 236645361 223440896 44962 1992294400 4194304 6416590 548682068912 18446744073709551615 4294538 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 54551 44962 254 542 0 54000 0
Current children cumulated CPU time (s) 821.84
Current children cumulated vsize (KiB) 223560

[startup+882.302 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 10174
/proc/meminfo: memFree=1181936/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=231744 CPUtime=881.82
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 52487 0 0 0 88072 110 0 0 25 0 1 0 236645361 237305856 47872 1992294400 4194304 6416590 548682068912 18446744073709551615 4294639 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 57936 47872 254 542 0 57385 0
Current children cumulated CPU time (s) 881.82
Current children cumulated vsize (KiB) 237100

[startup+942.301 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 10174
/proc/meminfo: memFree=1153264/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=261568 CPUtime=941.79
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 59810 0 0 0 94056 123 0 0 25 0 1 0 236645361 267845632 55195 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 65392 55195 254 542 0 64841 0
Current children cumulated CPU time (s) 941.79
Current children cumulated vsize (KiB) 266924

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10174
/proc/meminfo: memFree=1143984/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=271696 CPUtime=1001.76
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 62721 0 0 0 100047 129 0 0 25 0 1 0 236645361 278216704 57370 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 67924 57370 254 542 0 67373 0
Current children cumulated CPU time (s) 1001.76
Current children cumulated vsize (KiB) 277052

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10174
/proc/meminfo: memFree=1137968/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=278896 CPUtime=1061.74
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 64322 0 0 0 106041 133 0 0 25 0 1 0 236645361 285589504 58971 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 69724 58971 254 542 0 69173 0
Current children cumulated CPU time (s) 1061.74
Current children cumulated vsize (KiB) 284252

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10174
/proc/meminfo: memFree=1129712/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=289140 CPUtime=1121.7
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 66283 0 0 0 112033 137 0 0 25 0 1 0 236645361 296079360 60932 1992294400 4194304 6416590 548682068912 18446744073709551615 4294660 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 72285 60932 254 542 0 71734 0
Current children cumulated CPU time (s) 1121.7
Current children cumulated vsize (KiB) 294496

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10174
/proc/meminfo: memFree=1121456/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=299008 CPUtime=1181.67
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 68389 0 0 0 118027 140 0 0 25 0 1 0 236645361 306184192 63038 1992294400 4194304 6416590 548682068912 18446744073709551615 4294639 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 74752 63038 254 542 0 74201 0
Current children cumulated CPU time (s) 1181.67
Current children cumulated vsize (KiB) 304364



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10174
/proc/meminfo: memFree=1117872/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=303356 CPUtime=1200.07
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 69238 0 0 0 119866 141 0 0 25 0 1 0 236645361 310636544 63887 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 75839 63887 254 542 0 75288 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 308712

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 10174
/proc/meminfo: memFree=1117872/2055920 swapFree=4180812/4192956
[pid=10166] ppid=10164 vsize=5356 CPUtime=0
/proc/10166/stat : 10166 (kw_pre) S 10164 10166 9663 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236645361 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10166/statm: 1339 231 192 169 0 50 0
[pid=10167] ppid=10166 vsize=303356 CPUtime=1200.07
/proc/10167/stat : 10167 (kw_preprocessor) R 10166 10166 9663 0 -1 0 69238 0 0 0 119866 141 0 0 25 0 1 0 236645361 310636544 63887 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/10167/statm: 75839 63887 254 542 0 75288 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 308712

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10166 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.002999
# while last known CPU time is 1200.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.71
CPU time (s): 1200.07
CPU user time (s): 1198.66
CPU system time (s): 1.41
CPU usage (%): 99.9465
Max. virtual memory (cumulated for all children) (KiB): 308712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 280
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 1

runsolver used 0.995848 second user time and 3.37949 second system time

The end

Launcher Data 

Begin job on node4 at 2009-05-12 01:55:14
IDJOB=1797209
IDBENCH=71064
IDSOLVER=646
FILE ID=node4/1797209-1242086114
PBS_JOBID= 9277594
Free space on /tmp= 66260 MiB

SOLVER NAME= kw_pre 2009-03-21
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_11_UNKNOWN.cnf
COMMAND LINE= HOME/kw_pre BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1797209-1242086114/watcher-1797209-1242086114 -o /tmp/evaluation-result-1797209-1242086114/solver-1797209-1242086114 -C 1200 -W 1800 -M 1800  HOME/kw_pre HOME/instance-1797209-1242086114.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= b02fa517730e45c506203f9bd7ebb62c
RANDOM SEED=60620057

node4.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1374560 kB
Buffers:         57240 kB
Cached:         552344 kB
SwapCached:       5952 kB
Active:          56644 kB
Inactive:       560852 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1374560 kB
SwapTotal:     4192956 kB
SwapFree:      4180812 kB
Dirty:            4652 kB
Writeback:           0 kB
Mapped:          13496 kB
Slab:            49836 kB
Committed_AS:   967636 kB
PageTables:       1468 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66256 MiB
End job on node4 at 2009-05-12 02:15:17