Trace number 1559769

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.12 1200.51

General information on the benchmark

NameAPPLICATIONS/aprove09/
AProVE09-20.cnf
MD5SUMd682d44f13c64e9669f2eded046ee8c4
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark34.5318
Satisfiable
(Un)Satisfiability was proved
Number of variables33054
Number of clauses108377
Sum of the clauses size276669
Maximum clause length61
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 251324
Number of clauses of size 355013
Number of clauses of size 41546
Number of clauses of size 5256
Number of clauses of size over 5236

Solver Data

0.00/0.00	c Trying configuration 1
700.00/700.29	HOME/hydrasat-multi.sh: line 48: 24568 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.00/700.29	c Trying configuration 2
1200.10/1200.51	HOME/hydrasat-multi.sh: line 64: 24570 Terminated              $SOLVER2 $BENCHNAME $OPTIONS2

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1559769-1238753788/watcher-1559769-1238753788 -o /tmp/evaluation-result-1559769-1238753788/solver-1559769-1238753788 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1559769-1238753788.cnf 1800 1087722997 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.30 1.06 1.02 3/64 24567
/proc/meminfo: memFree=1744640/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) R 24565 24567 24499 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 238 1992294400 4194304 4889804 548682068720 18446744073709551615 235371293343 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/24567/statm: 1340 238 196 169 0 51 0
[pid=24568] ppid=24567 vsize=1876 CPUtime=0
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 171 0 0 0 0 0 0 0 18 0 1 0 1148040872 1921024 153 1992294400 134512640 135813592 4294956160 18446744073709551615 135204212 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 469 154 117 317 0 149 0

[startup+0.044422 s]
/proc/loadavg: 1.30 1.06 1.02 3/64 24567
/proc/meminfo: memFree=1744640/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=3592 CPUtime=0.03
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 638 0 0 0 3 0 0 0 19 0 1 0 1148040872 3678208 620 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 898 620 117 317 0 578 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8952

[startup+0.102426 s]
/proc/loadavg: 1.30 1.06 1.02 3/64 24567
/proc/meminfo: memFree=1744640/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=6232 CPUtime=0.09
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 1312 0 0 0 9 0 0 0 19 0 1 0 1148040872 6381568 1294 1992294400 134512640 135813592 4294956160 18446744073709551615 135207783 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 1558 1294 117 317 0 1238 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 11592

[startup+0.301443 s]
/proc/loadavg: 1.30 1.06 1.02 3/64 24567
/proc/meminfo: memFree=1744640/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=12888 CPUtime=0.29
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 3116 0 0 0 28 1 0 0 21 0 1 0 1148040872 13197312 2894 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 3222 2895 126 317 0 2902 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 18248

[startup+0.70248 s]
/proc/loadavg: 1.30 1.06 1.02 3/64 24567
/proc/meminfo: memFree=1744640/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=18080 CPUtime=0.69
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 4507 0 0 0 68 1 0 0 25 0 1 0 1148040872 18513920 4156 1992294400 134512640 135813592 4294956160 18446744073709551615 134673561 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 4520 4156 126 317 0 4200 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 23440

[startup+1.50255 s]
/proc/loadavg: 1.28 1.06 1.02 2/66 24569
/proc/meminfo: memFree=1722608/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=23968 CPUtime=1.49
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 6206 0 0 0 147 2 0 0 25 0 1 0 1148040872 24543232 5627 1992294400 134512640 135813592 4294956160 18446744073709551615 134665049 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 5992 5627 150 317 0 5672 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 29328

[startup+3.10169 s]
/proc/loadavg: 1.28 1.06 1.02 2/66 24569
/proc/meminfo: memFree=1721904/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=24496 CPUtime=3.08
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 6342 0 0 0 306 2 0 0 25 0 1 0 1148040872 25083904 5763 1992294400 134512640 135813592 4294956160 18446744073709551615 134664968 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 6124 5763 150 317 0 5804 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 29856

[startup+6.30198 s]
/proc/loadavg: 1.28 1.06 1.02 2/66 24569
/proc/meminfo: memFree=1721136/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=25288 CPUtime=6.28
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 6529 0 0 0 625 3 0 0 25 0 1 0 1148040872 25894912 5950 1992294400 134512640 135813592 4294956160 18446744073709551615 134665743 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 6322 5950 150 317 0 6002 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 30648

[startup+12.7016 s]
/proc/loadavg: 1.23 1.06 1.02 2/66 24569
/proc/meminfo: memFree=1720056/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=26216 CPUtime=12.69
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 6779 0 0 0 1265 4 0 0 25 0 1 0 1148040872 26845184 6200 1992294400 134512640 135813592 4294956160 18446744073709551615 134665173 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 6554 6200 150 317 0 6234 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 31576

[startup+25.5017 s]
/proc/loadavg: 1.20 1.06 1.02 2/66 24569
/proc/meminfo: memFree=1718776/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=27648 CPUtime=25.48
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 7128 0 0 0 2544 4 0 0 25 0 1 0 1148040872 28311552 6549 1992294400 134512640 135813592 4294956160 18446744073709551615 134664928 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 6912 6549 150 317 0 6592 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 33008

[startup+51.102 s]
/proc/loadavg: 1.13 1.05 1.02 2/66 24569
/proc/meminfo: memFree=1716472/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=30088 CPUtime=51.07
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 7708 0 0 0 5103 4 0 0 25 0 1 0 1148040872 30810112 7129 1992294400 134512640 135813592 4294956160 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 7522 7129 150 317 0 7202 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 35448

[startup+102.307 s]
/proc/loadavg: 1.05 1.04 1.01 2/66 24569
/proc/meminfo: memFree=1713592/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=32876 CPUtime=102.27
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 8407 0 0 0 10222 5 0 0 25 0 1 0 1148040872 33665024 7828 1992294400 134512640 135813592 4294956160 18446744073709551615 134665397 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 8219 7828 150 317 0 7899 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 38236

[startup+162.302 s]
/proc/loadavg: 1.02 1.03 1.00 2/66 24569
/proc/meminfo: memFree=1710840/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=35676 CPUtime=162.24
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 9099 0 0 0 16218 6 0 0 25 0 1 0 1148040872 36532224 8520 1992294400 134512640 135813592 4294956160 18446744073709551615 134662603 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 8919 8520 150 317 0 8599 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 41036

[startup+222.301 s]
/proc/loadavg: 1.00 1.02 1.00 2/66 24569
/proc/meminfo: memFree=1709176/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=37172 CPUtime=222.22
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 9490 0 0 0 22216 6 0 0 25 0 1 0 1148040872 38064128 8911 1992294400 134512640 135813592 4294956160 18446744073709551615 134667755 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 9293 8911 150 317 0 8973 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 42532

[startup+282.302 s]
/proc/loadavg: 1.00 1.02 1.00 2/66 24569
/proc/meminfo: memFree=1706488/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=40120 CPUtime=282.21
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 10156 0 0 0 28214 7 0 0 25 0 1 0 1148040872 41082880 9577 1992294400 134512640 135813592 4294956160 18446744073709551615 134665358 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 10030 9577 150 317 0 9710 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 45480

[startup+342.301 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 24569
/proc/meminfo: memFree=1704696/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=41856 CPUtime=342.19
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 10605 0 0 0 34212 7 0 0 25 0 1 0 1148040872 42860544 10026 1992294400 134512640 135813592 4294956160 18446744073709551615 134592479 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 10464 10026 150 317 0 10144 0

################
# More data... #
################

[pid=24568] ppid=24567 vsize=48816 CPUtime=522.14
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 12218 0 0 0 52206 8 0 0 25 0 1 0 1148040872 49987584 11639 1992294400 134512640 135813592 4294956160 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 12204 11639 150 317 0 11884 0
Current children cumulated CPU time (s) 522.14
Current children cumulated vsize (KiB) 54176

[startup+582.303 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24569
/proc/meminfo: memFree=1696632/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=50548 CPUtime=582.13
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 12626 0 0 0 58204 9 0 0 25 0 1 0 1148040872 51761152 12047 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 12637 12047 150 317 0 12317 0
Current children cumulated CPU time (s) 582.13
Current children cumulated vsize (KiB) 55908

[startup+642.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24569
/proc/meminfo: memFree=1695032/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5360 CPUtime=0
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1148040872 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24567/statm: 1340 239 197 169 0 51 0
[pid=24568] ppid=24567 vsize=52044 CPUtime=642.12
/proc/24568/stat : 24568 (hydrasat_cache4) R 24567 24567 24499 0 -1 4194304 13001 0 0 0 64203 9 0 0 25 0 1 0 1148040872 53293056 12422 1992294400 134512640 135813592 4294956160 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/24568/statm: 13011 12422 150 317 0 12691 0
Current children cumulated CPU time (s) 642.12
Current children cumulated vsize (KiB) 57404

[startup+702.303 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1674936/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=17428 CPUtime=1.98
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 4547 0 0 0 197 1 0 0 25 0 1 0 1148110902 17846272 3969 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 4357 3969 173 362 0 3992 0
Current children cumulated CPU time (s) 702.07
Current children cumulated vsize (KiB) 22792

[startup+762.307 s]
/proc/loadavg: 1.03 1.01 1.00 2/66 24570
/proc/meminfo: memFree=1672056/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=21336 CPUtime=61.98
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 5503 0 0 0 6195 3 0 0 25 0 1 0 1148110902 21848064 4925 1992294400 134512640 135995732 4294956016 18446744073709551615 134807691 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 5334 4925 173 362 0 4969 0
Current children cumulated CPU time (s) 762.07
Current children cumulated vsize (KiB) 26700

[startup+822.302 s]
/proc/loadavg: 1.01 1.01 1.00 2/66 24570
/proc/meminfo: memFree=1670200/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=23204 CPUtime=121.95
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 5985 0 0 0 12192 3 0 0 25 0 1 0 1148110902 23760896 5407 1992294400 134512640 135995732 4294956016 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 5801 5407 173 362 0 5436 0
Current children cumulated CPU time (s) 822.04
Current children cumulated vsize (KiB) 28568

[startup+882.303 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1668728/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=24672 CPUtime=181.94
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 6353 0 0 0 18190 4 0 0 25 0 1 0 1148110902 25264128 5775 1992294400 134512640 135995732 4294956016 18446744073709551615 135364228 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 6168 5775 173 362 0 5803 0
Current children cumulated CPU time (s) 882.03
Current children cumulated vsize (KiB) 30036

[startup+942.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1667256/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=26136 CPUtime=241.92
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 6732 0 0 0 24187 5 0 0 25 0 1 0 1148110902 26763264 6154 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 6534 6154 173 362 0 6169 0
Current children cumulated CPU time (s) 942.01
Current children cumulated vsize (KiB) 31500

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1665080/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=28528 CPUtime=301.89
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 7267 0 0 0 30184 5 0 0 25 0 1 0 1148110902 29212672 6689 1992294400 134512640 135995732 4294956016 18446744073709551615 134807804 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 7132 6689 173 362 0 6767 0
Current children cumulated CPU time (s) 1001.98
Current children cumulated vsize (KiB) 33892

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1664248/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=29324 CPUtime=361.86
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 7475 0 0 0 36181 5 0 0 25 0 1 0 1148110902 30027776 6897 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 7331 6897 173 362 0 6966 0
Current children cumulated CPU time (s) 1061.95
Current children cumulated vsize (KiB) 34688

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1662648/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=30932 CPUtime=421.83
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 7857 0 0 0 42178 5 0 0 25 0 1 0 1148110902 31674368 7279 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 7733 7279 173 362 0 7368 0
Current children cumulated CPU time (s) 1121.92
Current children cumulated vsize (KiB) 36296

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1661560/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=32016 CPUtime=481.82
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 8142 0 0 0 48176 6 0 0 25 0 1 0 1148110902 32784384 7564 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 8004 7564 173 362 0 7639 0
Current children cumulated CPU time (s) 1181.91
Current children cumulated vsize (KiB) 37380



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1660600/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=32812 CPUtime=500.01
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 8351 0 0 0 49995 6 0 0 25 0 1 0 1148110902 33599488 7773 1992294400 134512640 135995732 4294956016 18446744073709551615 134807830 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 8203 7773 173 362 0 7838 0
Current children cumulated CPU time (s) 1200.1
Current children cumulated vsize (KiB) 38176

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 24570
/proc/meminfo: memFree=1660600/2055920 swapFree=4176732/4192956
[pid=24567] ppid=24565 vsize=5364 CPUtime=700.09
/proc/24567/stat : 24567 (hydrasat-multi.) S 24565 24567 24499 0 -1 4194304 321 14396 0 0 0 0 69979 30 16 0 1 0 1148040872 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24567/statm: 1341 245 202 169 0 52 0
[pid=24570] ppid=24567 vsize=32812 CPUtime=500.01
/proc/24570/stat : 24570 (hydrasat_cachew) R 24567 24567 24499 0 -1 4194304 8351 0 0 0 49995 6 0 0 25 0 1 0 1148110902 33599488 7773 1992294400 134512640 135995732 4294956016 18446744073709551615 134807830 0 0 4096 1 0 0 0 17 0 0 0
/proc/24570/statm: 8203 7773 173 362 0 7838 0
Current children cumulated CPU time (s) 1200.1
Current children cumulated vsize (KiB) 38176

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.51
CPU time (s): 1200.12
CPU user time (s): 1199.75
CPU system time (s): 0.374943
CPU usage (%): 99.9676
Max. virtual memory (cumulated for all children) (KiB): 61300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.75
system time used= 0.374943
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23071
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 2721

runsolver used 1.18982 second user time and 3.18751 second system time

The end

Launcher Data

Begin job on node51 at 2009-04-03 12:16:28
IDJOB=1559769
IDBENCH=70883
IDSOLVER=518
FILE ID=node51/1559769-1238753788
PBS_JOBID= 9085463
Free space on /tmp= 66540 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/APPLICATIONS/aprove09/AProVE09-20.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1559769-1238753788/watcher-1559769-1238753788 -o /tmp/evaluation-result-1559769-1238753788/solver-1559769-1238753788 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1559769-1238753788.cnf 1800 1087722997

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= d682d44f13c64e9669f2eded046ee8c4
RANDOM SEED=1087722997

node51.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1745120 kB
Buffers:         36160 kB
Cached:         181540 kB
SwapCached:      10236 kB
Active:          72508 kB
Inactive:       156936 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1745120 kB
SwapTotal:     4192956 kB
SwapFree:      4176732 kB
Dirty:            5976 kB
Writeback:           0 kB
Mapped:          17384 kB
Slab:            67424 kB
Committed_AS:  3313624 kB
PageTables:       1400 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66484 MiB
End job on node51 at 2009-04-03 12:36:31