Trace number 1582153

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.03 1200.41

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UTI-20-10p1.cnf
MD5SUM9573f6b4001373bab93d1a02f96820d1
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables260342
Number of clauses1391257
Sum of the clauses size3358569
Maximum clause length10
Minimum clause length1
Number of clauses of size 113149
Number of clauses of size 2984984
Number of clauses of size 3327764
Number of clauses of size 47260
Number of clauses of size 529040
Number of clauses of size over 529060

Solver Data 

0.00/0.00	c Trying configuration 1
700.67/700.97	HOME/hydrasat-multi.sh: line 48: 16695 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.67/700.97	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1582153-1238936851/watcher-1582153-1238936851 -o /tmp/evaluation-result-1582153-1238936851/solver-1582153-1238936851 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1582153-1238936851.cnf 1800 1184975923 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.07 1.00 1.00 3/68 16694
/proc/meminfo: memFree=1834224/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=6888 CPUtime=0
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 170 0 0 0 0 0 0 0 20 0 1 0 1166346934 7053312 152 1992294400 134512640 135813592 4294956160 18446744073709551615 135213000 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 1722 152 117 317 0 1402 0

[startup+0.037982 s]
/proc/loadavg: 1.07 1.00 1.00 3/68 16694
/proc/meminfo: memFree=1834224/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=8604 CPUtime=0.02
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 620 0 0 0 2 0 0 0 20 0 1 0 1166346934 8810496 602 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 2151 602 117 317 0 1831 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13964

[startup+0.101986 s]
/proc/loadavg: 1.07 1.00 1.00 3/68 16694
/proc/meminfo: memFree=1834224/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=11904 CPUtime=0.09
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 1491 0 0 0 9 0 0 0 20 0 1 0 1166346934 12189696 1473 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 2976 1474 117 317 0 2656 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17264

[startup+0.302006 s]
/proc/loadavg: 1.07 1.00 1.00 3/68 16694
/proc/meminfo: memFree=1834224/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=21672 CPUtime=0.29
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 4121 0 0 0 28 1 0 0 22 0 1 0 1166346934 22192128 4103 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 5418 4104 117 317 0 5098 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 27032

[startup+0.701047 s]
/proc/loadavg: 1.07 1.00 1.00 3/68 16694
/proc/meminfo: memFree=1834224/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=40944 CPUtime=0.69
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 9291 0 0 0 65 4 0 0 25 0 1 0 1166346934 41926656 9273 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 10236 9273 117 317 0 9916 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 46304

[startup+1.50113 s]
/proc/loadavg: 1.07 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1782368/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=74604 CPUtime=1.49
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 18294 0 0 0 141 8 0 0 25 0 1 0 1166346934 76394496 18276 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 18651 18276 117 317 0 18331 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 79964

[startup+3.10128 s]
/proc/loadavg: 1.07 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1733728/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=123516 CPUtime=3.08
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 31790 0 0 0 294 14 0 0 25 0 1 0 1166346934 126480384 29991 1992294400 134512640 135813592 4294956160 18446744073709551615 134692693 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 30879 29991 124 317 0 30559 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 128876

[startup+6.3016 s]
/proc/loadavg: 1.07 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1693728/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=148948 CPUtime=6.29
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 38831 0 0 0 611 18 0 0 25 0 1 0 1166346934 152522752 35142 1992294400 134512640 135813592 4294956160 18446744073709551615 134676824 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 37237 35142 126 317 0 36917 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 154308

[startup+12.7012 s]
/proc/loadavg: 1.06 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1641184/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=202608 CPUtime=12.68
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 56292 0 0 0 1243 25 0 0 25 0 1 0 1166346934 207470592 48374 1992294400 134512640 135813592 4294956160 18446744073709551615 134664877 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 50652 48374 150 317 0 50332 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 207968

[startup+25.5015 s]
/proc/loadavg: 1.05 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1640160/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=203664 CPUtime=25.48
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 56574 0 0 0 2523 25 0 0 25 0 1 0 1166346934 208551936 48656 1992294400 134512640 135813592 4294956160 18446744073709551615 134661778 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 50916 48656 150 317 0 50596 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 209024

[startup+51.101 s]
/proc/loadavg: 1.03 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1639520/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=204456 CPUtime=51.08
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 56768 0 0 0 5082 26 0 0 25 0 1 0 1166346934 209362944 48850 1992294400 134512640 135813592 4294956160 18446744073709551615 134662857 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 51114 48850 150 317 0 50794 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 209816

[startup+102.305 s]
/proc/loadavg: 1.01 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1636832/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=206996 CPUtime=102.27
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 57415 0 0 0 10200 27 0 0 25 0 1 0 1166346934 211963904 49497 1992294400 134512640 135813592 4294956160 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 51749 49497 150 317 0 51429 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 212356

[startup+162.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1634144/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=209552 CPUtime=162.24
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 58076 0 0 0 16197 27 0 0 25 0 1 0 1166346934 214581248 50158 1992294400 134512640 135813592 4294956160 18446744073709551615 134662242 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 52388 50158 150 317 0 52068 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 214912

[startup+222.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1632032/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=211828 CPUtime=222.23
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 58591 0 0 0 22195 28 0 0 25 0 1 0 1166346934 216911872 50673 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 52957 50673 150 317 0 52637 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 217188

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1630176/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=213556 CPUtime=282.21
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 59045 0 0 0 28193 28 0 0 25 0 1 0 1166346934 218681344 51127 1992294400 134512640 135813592 4294956160 18446744073709551615 134662702 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 53389 51127 150 317 0 53069 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 218916

[startup+342.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1628576/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=215100 CPUtime=342.2
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 59435 0 0 0 34191 29 0 0 25 0 1 0 1166346934 220262400 51517 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 53775 51517 150 317 0 53455 0

################
# More data... #
################

/proc/16695/statm: 54707 52411 150 317 0 54387 0
Current children cumulated CPU time (s) 522.14
Current children cumulated vsize (KiB) 224188

[startup+582.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1623648/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=220040 CPUtime=582.12
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 60640 0 0 0 58182 30 0 0 25 0 1 0 1166346934 225320960 52722 1992294400 134512640 135813592 4294956160 18446744073709551615 134662702 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 55010 52722 150 317 0 54690 0
Current children cumulated CPU time (s) 582.12
Current children cumulated vsize (KiB) 225400

[startup+642.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16696
/proc/meminfo: memFree=1623072/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5360 CPUtime=0
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1166346933 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16694/statm: 1340 239 197 169 0 51 0
[pid=16695] ppid=16694 vsize=220592 CPUtime=642.11
/proc/16695/stat : 16695 (hydrasat_cache4) R 16694 16694 16323 0 -1 4194304 60776 0 0 0 64181 30 0 0 25 0 1 0 1166346934 225886208 52858 1992294400 134512640 135813592 4294956160 18446744073709551615 134662152 0 0 4096 1 0 0 0 17 1 0 0
/proc/16695/statm: 55148 52858 150 317 0 54828 0
Current children cumulated CPU time (s) 642.11
Current children cumulated vsize (KiB) 225952

[startup+702.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16697
/proc/meminfo: memFree=1581984/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=56040 CPUtime=1.31
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 13629 0 0 0 124 7 0 0 25 0 1 0 1166417031 57384960 13612 1992294400 134512640 135995732 4294956016 18446744073709551615 135369318 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 14010 13612 143 362 0 13645 0
Current children cumulated CPU time (s) 702.05
Current children cumulated vsize (KiB) 61404

[startup+762.307 s]
/proc/loadavg: 1.07 1.03 1.01 2/70 16697
/proc/meminfo: memFree=1490656/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=136740 CPUtime=61.3
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 39794 0 0 0 6103 27 0 0 25 0 1 0 1166417031 140021760 31877 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 34185 31877 173 362 0 33820 0
Current children cumulated CPU time (s) 762.04
Current children cumulated vsize (KiB) 142104

[startup+822.302 s]
/proc/loadavg: 1.02 1.02 1.00 2/70 16697
/proc/meminfo: memFree=1488736/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=138748 CPUtime=121.28
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 40316 0 0 0 12099 29 0 0 25 0 1 0 1166417031 142077952 32399 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 34687 32399 173 362 0 34322 0
Current children cumulated CPU time (s) 822.02
Current children cumulated vsize (KiB) 144112

[startup+882.302 s]
/proc/loadavg: 1.01 1.01 1.00 2/70 16697
/proc/meminfo: memFree=1487200/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=140068 CPUtime=181.26
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 40683 0 0 0 18097 29 0 0 25 0 1 0 1166417031 143429632 32766 1992294400 134512640 135995732 4294956016 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 35017 32766 173 362 0 34652 0
Current children cumulated CPU time (s) 882
Current children cumulated vsize (KiB) 145432

[startup+942.301 s]
/proc/loadavg: 1.00 1.01 1.00 2/70 16697
/proc/meminfo: memFree=1485600/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=141928 CPUtime=241.25
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 41104 0 0 0 24095 30 0 0 25 0 1 0 1166417031 145334272 33187 1992294400 134512640 135995732 4294956016 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 35482 33187 173 362 0 35117 0
Current children cumulated CPU time (s) 941.99
Current children cumulated vsize (KiB) 147292

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16697
/proc/meminfo: memFree=1484320/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=142996 CPUtime=301.23
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 41383 0 0 0 30093 30 0 0 25 0 1 0 1166417031 146427904 33466 1992294400 134512640 135995732 4294956016 18446744073709551615 134665283 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 35749 33466 173 362 0 35384 0
Current children cumulated CPU time (s) 1001.97
Current children cumulated vsize (KiB) 148360

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16697
/proc/meminfo: memFree=1483104/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=144256 CPUtime=361.22
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 41689 0 0 0 36091 31 0 0 25 0 1 0 1166417031 147718144 33772 1992294400 134512640 135995732 4294956016 18446744073709551615 134808081 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 36064 33772 173 362 0 35699 0
Current children cumulated CPU time (s) 1061.96
Current children cumulated vsize (KiB) 149620

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16697
/proc/meminfo: memFree=1482016/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=145224 CPUtime=421.2
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 41955 0 0 0 42089 31 0 0 25 0 1 0 1166417031 148709376 34038 1992294400 134512640 135995732 4294956016 18446744073709551615 134590015 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 36306 34038 173 362 0 35941 0
Current children cumulated CPU time (s) 1121.94
Current children cumulated vsize (KiB) 150588

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16697
/proc/meminfo: memFree=1480800/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=146376 CPUtime=481.18
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 42241 0 0 0 48087 31 0 0 25 0 1 0 1166417031 149889024 34324 1992294400 134512640 135995732 4294956016 18446744073709551615 134807674 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 36594 34324 173 362 0 36229 0
Current children cumulated CPU time (s) 1181.92
Current children cumulated vsize (KiB) 151740



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.4 s]
/proc/loadavg: 1.00 1.00 1.00 2/70 16697
/proc/meminfo: memFree=1480416/2055920 swapFree=4175300/4192956
[pid=16694] ppid=16692 vsize=5364 CPUtime=700.74
/proc/16694/stat : 16694 (hydrasat-multi.) S 16692 16694 16323 0 -1 4194304 321 62854 0 0 0 0 69957 117 16 0 1 0 1166346933 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/16694/statm: 1341 245 202 169 0 52 0
[pid=16697] ppid=16694 vsize=146648 CPUtime=499.29
/proc/16697/stat : 16697 (hydrasat_cachew) R 16694 16694 16323 0 -1 4194304 42339 0 0 0 49897 32 0 0 25 0 1 0 1166417031 150167552 34422 1992294400 134512640 135995732 4294956016 18446744073709551615 134807768 0 0 4096 1 0 0 0 17 1 0 0
/proc/16697/statm: 36662 34422 173 362 0 36297 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 152012

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16694 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=581647
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=174821
# CPU time returned by wait4() is 700.756
# while last known CPU time is 1200.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.41
CPU time (s): 1200.03
CPU user time (s): 1198.54
CPU system time (s): 1.49
CPU usage (%): 99.9681
Max. virtual memory (cumulated for all children) (KiB): 227824

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.582
system time used= 1.17482
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 63175
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 1196

runsolver used 1.13283 second user time and 3.24451 second system time

The end

Launcher Data 

Begin job on node60 at 2009-04-05 15:07:33
IDJOB=1582153
IDBENCH=71050
IDSOLVER=518
FILE ID=node60/1582153-1238936851
PBS_JOBID= 9101464
Free space on /tmp= 66508 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UTI-20-10p1.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1582153-1238936851/watcher-1582153-1238936851 -o /tmp/evaluation-result-1582153-1238936851/solver-1582153-1238936851 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1582153-1238936851.cnf 1800 1184975923

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 9573f6b4001373bab93d1a02f96820d1
RANDOM SEED=1184975923

node60.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.202
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.202
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1835408 kB
Buffers:         16068 kB
Cached:         136268 kB
SwapCached:      10524 kB
Active:          40456 kB
Inactive:       124472 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1835408 kB
SwapTotal:     4192956 kB
SwapFree:      4175300 kB
Dirty:           30424 kB
Writeback:           0 kB
Mapped:          18328 kB
Slab:            41164 kB
Committed_AS:  3855348 kB
PageTables:       1724 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66296 MiB
End job on node60 at 2009-04-05 15:27:36