Trace number 1719651

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.05 1200.41

General information on the benchmark

Namegoldb-heqc-frg1mul.cnf
MD5SUM4984fea7abc49dd7f6973cd779e805d7
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark20.8818
Satisfiable
(Un)Satisfiability was proved
Number of variables3230
Number of clauses20575
Sum of the clauses size69606
Maximum clause length6
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24746
Number of clauses of size 39516
Number of clauses of size 40
Number of clauses of size 56312
Number of clauses of size over 51

Solver Data 

0.00/0.00	c Trying configuration 1
700.19/700.40	HOME/hydrasat-multi.sh: line 48: 14022 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.19/700.40	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1719651-1240647929/watcher-1719651-1240647929 -o /tmp/evaluation-result-1719651-1240647929/solver-1719651-1240647929 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1719651-1240647929.cnf 1800 412145492 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.06 3/64 14021
/proc/meminfo: memFree=1953256/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=1584 CPUtime=0
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 163 0 0 0 0 0 0 0 20 0 1 0 92820417 1622016 145 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 396 145 116 317 0 76 0

[startup+0.0701771 s]
/proc/loadavg: 1.00 1.00 1.06 3/64 14021
/proc/meminfo: memFree=1953256/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=3532 CPUtime=0.06
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 650 0 0 0 6 0 0 0 20 0 1 0 92820417 3616768 632 1992294400 134512640 135813592 4294956160 18446744073709551615 135224163 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 883 632 126 317 0 563 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 8892

[startup+0.102178 s]
/proc/loadavg: 1.00 1.00 1.06 3/64 14021
/proc/meminfo: memFree=1953256/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=4464 CPUtime=0.09
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 917 0 0 0 9 0 0 0 20 0 1 0 92820417 4571136 898 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 1116 898 149 317 0 796 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9824

[startup+0.302191 s]
/proc/loadavg: 1.00 1.00 1.06 3/64 14021
/proc/meminfo: memFree=1953256/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=4992 CPUtime=0.29
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 1045 0 0 0 29 0 0 0 20 0 1 0 92820417 5111808 1026 1992294400 134512640 135813592 4294956160 18446744073709551615 134665194 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 1248 1026 149 317 0 928 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 10352

[startup+0.702217 s]
/proc/loadavg: 1.00 1.00 1.06 3/64 14021
/proc/meminfo: memFree=1953256/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=5120 CPUtime=0.69
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 1081 0 0 0 69 0 0 0 24 0 1 0 92820417 5242880 1062 1992294400 134512640 135813592 4294956160 18446744073709551615 134664934 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 1280 1062 149 317 0 960 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 10480

[startup+1.50127 s]
/proc/loadavg: 1.00 1.00 1.06 2/66 14023
/proc/meminfo: memFree=1949144/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=5372 CPUtime=1.49
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 1133 0 0 0 149 0 0 0 25 0 1 0 92820417 5500928 1114 1992294400 134512640 135813592 4294956160 18446744073709551615 134665957 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 1343 1114 149 317 0 1023 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 10732

[startup+3.10138 s]
/proc/loadavg: 1.00 1.00 1.06 2/66 14023
/proc/meminfo: memFree=1948760/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=5632 CPUtime=3.09
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 1215 0 0 0 309 0 0 0 25 0 1 0 92820417 5767168 1196 1992294400 134512640 135813592 4294956160 18446744073709551615 134665391 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 1408 1196 149 317 0 1088 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 10992

[startup+6.30159 s]
/proc/loadavg: 1.00 1.00 1.06 2/66 14023
/proc/meminfo: memFree=1947928/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=6248 CPUtime=6.29
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 1356 0 0 0 629 0 0 0 25 0 1 0 92820417 6397952 1337 1992294400 134512640 135813592 4294956160 18446744073709551615 134667486 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 1562 1337 149 317 0 1242 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 11608

[startup+12.702 s]
/proc/loadavg: 1.00 1.00 1.06 2/66 14023
/proc/meminfo: memFree=1946648/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=7788 CPUtime=12.68
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 1723 0 0 0 1268 0 0 0 25 0 1 0 92820417 7974912 1704 1992294400 134512640 135813592 4294956160 18446744073709551615 134665197 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 1947 1704 149 317 0 1627 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 13148

[startup+25.5019 s]
/proc/loadavg: 1.00 1.00 1.06 2/66 14023
/proc/meminfo: memFree=1943832/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=10836 CPUtime=25.48
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 2405 0 0 0 2547 1 0 0 25 0 1 0 92820417 11096064 2386 1992294400 134512640 135813592 4294956160 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 2709 2386 149 317 0 2389 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 16196

[startup+51.1016 s]
/proc/loadavg: 1.00 1.00 1.06 2/66 14023
/proc/meminfo: memFree=1938904/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=16844 CPUtime=51.07
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 3950 0 0 0 5105 2 0 0 25 0 1 0 92820417 17248256 3614 1992294400 134512640 135813592 4294956160 18446744073709551615 135202056 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 4211 3614 149 317 0 3891 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 22204

[startup+102.306 s]
/proc/loadavg: 1.00 1.00 1.05 2/66 14023
/proc/meminfo: memFree=1929560/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=27052 CPUtime=102.27
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 6649 0 0 0 10222 5 0 0 25 0 1 0 92820417 27701248 5935 1992294400 134512640 135813592 4294956160 18446744073709551615 134665320 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 6763 5935 149 317 0 6443 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 32412

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.05 2/66 14023
/proc/meminfo: memFree=1923736/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=32808 CPUtime=162.25
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 8356 0 0 0 16218 7 0 0 25 0 1 0 92820417 33595392 7388 1992294400 134512640 135813592 4294956160 18446744073709551615 134667452 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 8202 7388 149 317 0 7882 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 38168

[startup+222.303 s]
/proc/loadavg: 1.00 1.00 1.04 2/66 14023
/proc/meminfo: memFree=1916376/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=41664 CPUtime=222.23
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 10942 0 0 0 22215 8 0 0 25 0 1 0 92820417 42663936 9206 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 10416 9206 149 317 0 10096 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 47024

[startup+282.303 s]
/proc/loadavg: 1.00 1.00 1.03 2/66 14023
/proc/meminfo: memFree=1908632/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=51280 CPUtime=282.22
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 13897 0 0 0 28212 10 0 0 25 0 1 0 92820417 52510720 11131 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 12820 11131 149 317 0 12500 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 56640

[startup+342.302 s]
/proc/loadavg: 1.00 1.00 1.03 2/66 14023
/proc/meminfo: memFree=1902872/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=57256 CPUtime=342.2
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 15782 0 0 0 34209 11 0 0 25 0 1 0 92820417 58630144 12553 1992294400 134512640 135813592 4294956160 18446744073709551615 134665303 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 14314 12553 149 317 0 13994 0

################
# More data... #
################

/proc/14022/statm: 18687 16070 149 317 0 18367 0
Current children cumulated CPU time (s) 522.16
Current children cumulated vsize (KiB) 80108

[startup+582.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14023
/proc/meminfo: memFree=1885400/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=78644 CPUtime=582.14
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 21788 0 0 0 58198 16 0 0 25 0 1 0 92820417 80531456 16864 1992294400 134512640 135813592 4294956160 18446744073709551615 134665562 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 19661 16864 149 317 0 19341 0
Current children cumulated CPU time (s) 582.14
Current children cumulated vsize (KiB) 84004

[startup+642.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14023
/proc/meminfo: memFree=1878104/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5360 CPUtime=0
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 92820417 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1340 239 197 169 0 51 0
[pid=14022] ppid=14021 vsize=87052 CPUtime=642.13
/proc/14022/stat : 14022 (hydrasat_cache4) R 14021 14021 13430 0 -1 4194304 24317 0 0 0 64194 19 0 0 25 0 1 0 92820417 89141248 18668 1992294400 134512640 135813592 4294956160 18446744073709551615 134665173 0 0 4096 1 0 0 0 17 1 0 0
/proc/14022/statm: 21763 18668 149 317 0 21443 0
Current children cumulated CPU time (s) 642.13
Current children cumulated vsize (KiB) 92412

[startup+702.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14024
/proc/meminfo: memFree=1868888/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=4188 CPUtime=1.88
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 811 0 0 0 188 0 0 0 25 0 1 0 92890458 4288512 793 1992294400 134512640 135995732 4294956016 18446744073709551615 134589984 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 1047 793 171 362 0 682 0
Current children cumulated CPU time (s) 702.08
Current children cumulated vsize (KiB) 9552

[startup+762.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1861784/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=12884 CPUtime=61.85
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 2952 0 0 0 6183 2 0 0 25 0 1 0 92890458 13193216 2901 1992294400 134512640 135995732 4294956016 18446744073709551615 134807724 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 3221 2901 171 362 0 2856 0
Current children cumulated CPU time (s) 762.05
Current children cumulated vsize (KiB) 18248

[startup+822.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1856728/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=18684 CPUtime=121.84
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 4383 0 0 0 12180 4 0 0 25 0 1 0 92890458 19132416 4177 1992294400 134512640 135995732 4294956016 18446744073709551615 134808030 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 4671 4177 171 362 0 4306 0
Current children cumulated CPU time (s) 822.04
Current children cumulated vsize (KiB) 24048

[startup+882.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1853016/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=23040 CPUtime=181.82
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 5381 0 0 0 18178 4 0 0 25 0 1 0 92890458 23592960 5104 1992294400 134512640 135995732 4294956016 18446744073709551615 134682179 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 5760 5104 171 362 0 5395 0
Current children cumulated CPU time (s) 882.02
Current children cumulated vsize (KiB) 28404

[startup+942.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1847704/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=28932 CPUtime=241.8
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 6911 0 0 0 24174 6 0 0 25 0 1 0 92890458 29626368 6443 1992294400 134512640 135995732 4294956016 18446744073709551615 134808081 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 7233 6443 171 362 0 6868 0
Current children cumulated CPU time (s) 942
Current children cumulated vsize (KiB) 34296

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1842648/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=34956 CPUtime=301.79
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 8530 0 0 0 30171 8 0 0 25 0 1 0 92890458 35794944 7690 1992294400 134512640 135995732 4294956016 18446744073709551615 134807724 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 8739 7690 171 362 0 8374 0
Current children cumulated CPU time (s) 1001.99
Current children cumulated vsize (KiB) 40320

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1838936/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=39220 CPUtime=361.78
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 9496 0 0 0 36169 9 0 0 25 0 1 0 92890458 40161280 8601 1992294400 134512640 135995732 4294956016 18446744073709551615 134808032 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 9805 8601 171 362 0 9440 0
Current children cumulated CPU time (s) 1061.98
Current children cumulated vsize (KiB) 44584

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1836376/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=42096 CPUtime=421.76
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 10275 0 0 0 42166 10 0 0 25 0 1 0 92890458 43106304 9238 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 10524 9238 171 362 0 10159 0
Current children cumulated CPU time (s) 1121.96
Current children cumulated vsize (KiB) 47460

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1832728/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=45588 CPUtime=481.74
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 11284 0 0 0 48164 10 0 0 25 0 1 0 92890458 46682112 10142 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 11397 10142 171 362 0 11032 0
Current children cumulated CPU time (s) 1181.94
Current children cumulated vsize (KiB) 50952



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.4 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 14026
/proc/meminfo: memFree=1831768/2055920 swapFree=4192812/4192956
[pid=14021] ppid=14019 vsize=5364 CPUtime=700.2
/proc/14021/stat : 14021 (hydrasat-multi.) S 14019 14021 13430 0 -1 4194304 321 28581 0 0 0 0 69968 52 16 0 1 0 92820417 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 273653752644 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14021/statm: 1341 245 202 169 0 52 0
[pid=14024] ppid=14021 vsize=46868 CPUtime=499.85
/proc/14024/stat : 14024 (hydrasat_cachew) R 14021 14021 13430 0 -1 4194304 11648 0 0 0 49974 11 0 0 25 0 1 0 92890458 47992832 10366 1992294400 134512640 135995732 4294956016 18446744073709551615 134807763 0 0 4096 1 0 0 0 17 1 0 0
/proc/14024/statm: 11717 10366 171 362 0 11352 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 52232

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14021 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=690630
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=525920
# CPU time returned by wait4() is 700.217
# while last known CPU time is 1200.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.41
CPU time (s): 1200.05
CPU user time (s): 1199.42
CPU system time (s): 0.63
CPU usage (%): 99.9699
Max. virtual memory (cumulated for all children) (KiB): 96344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.691
system time used= 0.52592
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28902
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 1617

runsolver used 1.45178 second user time and 2.90556 second system time

The end

Launcher Data 

Begin job on node52 at 2009-04-25 10:25:29
IDJOB=1719651
IDBENCH=69567
IDSOLVER=518
FILE ID=node52/1719651-1240647929
PBS_JOBID= 9186448
Free space on /tmp= 66224 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT_RACE08/cnf/goldb-heqc-frg1mul.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1719651-1240647929/watcher-1719651-1240647929 -o /tmp/evaluation-result-1719651-1240647929/solver-1719651-1240647929 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1719651-1240647929.cnf 1800 412145492

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 4984fea7abc49dd7f6973cd779e805d7
RANDOM SEED=412145492

node52.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1953672 kB
Buffers:          2816 kB
Cached:          30640 kB
SwapCached:          0 kB
Active:          33640 kB
Inactive:        13748 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1953672 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            4392 kB
Writeback:           0 kB
Mapped:          23704 kB
Slab:            40808 kB
Committed_AS:   327752 kB
PageTables:       1476 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66144 MiB
End job on node52 at 2009-04-25 10:45:32