Trace number 1530534

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.05 1200.61

General information on the benchmark

NameRANDOM/MEDIUM/3SAT/UNKNOWN/380/
unif-k3-r4.25-v380-c1615-S1807135406-059.cnf
MD5SUMcb595cd6bad1f0c5699baaa892a03467
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark40.7418
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses1615
Sum of the clauses size4845
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31615
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Trying configuration 1
699.97/700.32	HOME/hydrasat-multi.sh: line 48:  2037 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
699.97/700.32	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1530534-1238562054/watcher-1530534-1238562054 -o /tmp/evaluation-result-1530534-1238562054/solver-1530534-1238562054 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1530534-1238562054.cnf 1800 524891825 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 1.07 3/80 2036
/proc/meminfo: memFree=1369056/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=1584 CPUtime=0
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 186 0 0 0 0 0 0 0 19 0 1 0 1128869331 1622016 168 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 396 169 121 317 0 76 0

[startup+0.0359779 s]
/proc/loadavg: 0.92 0.98 1.07 3/80 2036
/proc/meminfo: memFree=1369056/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=1716 CPUtime=0.03
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 262 0 0 0 3 0 0 0 19 0 1 0 1128869331 1757184 243 1992294400 134512640 135813592 4294956160 18446744073709551615 134662196 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 429 243 150 317 0 109 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 7076

[startup+0.102984 s]
/proc/loadavg: 0.92 0.98 1.07 3/80 2036
/proc/meminfo: memFree=1369056/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=1848 CPUtime=0.09
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 278 0 0 0 9 0 0 0 19 0 1 0 1128869331 1892352 259 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 462 259 150 317 0 142 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7208

[startup+0.303005 s]
/proc/loadavg: 0.92 0.98 1.07 3/80 2036
/proc/meminfo: memFree=1369056/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=1976 CPUtime=0.29
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 318 0 0 0 29 0 0 0 21 0 1 0 1128869331 2023424 299 1992294400 134512640 135813592 4294956160 18446744073709551615 134592190 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 494 299 150 317 0 174 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7336

[startup+0.702047 s]
/proc/loadavg: 0.92 0.98 1.07 3/80 2036
/proc/meminfo: memFree=1369056/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=2108 CPUtime=0.69
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 372 0 0 0 69 0 0 0 25 0 1 0 1128869331 2158592 353 1992294400 134512640 135813592 4294956160 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 527 353 150 317 0 207 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 7468

[startup+1.50113 s]
/proc/loadavg: 0.92 0.98 1.07 2/82 2038
/proc/meminfo: memFree=1367632/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=2624 CPUtime=1.49
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 484 0 0 0 149 0 0 0 25 0 1 0 1128869331 2686976 465 1992294400 134512640 135813592 4294956160 18446744073709551615 134668716 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 656 465 150 317 0 336 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 7984

[startup+3.1013 s]
/proc/loadavg: 0.92 0.98 1.07 2/82 2038
/proc/meminfo: memFree=1367248/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=2888 CPUtime=3.09
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 536 0 0 0 309 0 0 0 25 0 1 0 1128869331 2957312 517 1992294400 134512640 135813592 4294956160 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 722 517 150 317 0 402 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 8248

[startup+6.30163 s]
/proc/loadavg: 0.93 0.98 1.07 2/82 2038
/proc/meminfo: memFree=1366032/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=3964 CPUtime=6.28
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 804 0 0 0 628 0 0 0 25 0 1 0 1128869331 4059136 785 1992294400 134512640 135813592 4294956160 18446744073709551615 134588811 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 991 785 150 317 0 671 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 9324

[startup+12.7013 s]
/proc/loadavg: 0.93 0.98 1.07 2/82 2044
/proc/meminfo: memFree=1363520/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=6520 CPUtime=12.67
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 1384 0 0 0 1266 1 0 0 25 0 1 0 1128869331 6676480 1365 1992294400 134512640 135813592 4294956160 18446744073709551615 134665006 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 1630 1365 150 317 0 1310 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 11880

[startup+25.5016 s]
/proc/loadavg: 0.95 0.98 1.07 2/82 2044
/proc/meminfo: memFree=1359704/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=10920 CPUtime=25.46
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 2412 0 0 0 2544 2 0 0 25 0 1 0 1128869331 11182080 2360 1992294400 134512640 135813592 4294956160 18446744073709551615 134665194 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 2730 2360 150 317 0 2410 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 16280

[startup+51.1013 s]
/proc/loadavg: 0.96 0.98 1.06 2/82 2044
/proc/meminfo: memFree=1358680/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=12136 CPUtime=51.05
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 2664 0 0 0 5103 2 0 0 25 0 1 0 1128869331 12427264 2612 1992294400 134512640 135813592 4294956160 18446744073709551615 134665171 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 3034 2612 150 317 0 2714 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 17496

[startup+102.308 s]
/proc/loadavg: 0.98 0.98 1.06 2/82 2044
/proc/meminfo: memFree=1356568/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=14492 CPUtime=102.24
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 3218 0 0 0 10221 3 0 0 25 0 1 0 1128869331 14839808 3120 1992294400 134512640 135813592 4294956160 18446744073709551615 134665490 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 3623 3120 150 317 0 3303 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 19852

[startup+162.302 s]
/proc/loadavg: 0.99 0.98 1.05 2/82 2044
/proc/meminfo: memFree=1351000/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=20764 CPUtime=162.2
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 4669 0 0 0 16216 4 0 0 25 0 1 0 1128869331 21262336 4506 1992294400 134512640 135813592 4294956160 18446744073709551615 134665074 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 5191 4506 150 317 0 4871 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 26124

[startup+222.301 s]
/proc/loadavg: 0.99 0.98 1.05 2/82 2044
/proc/meminfo: memFree=1346584/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=25688 CPUtime=222.18
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 5958 0 0 0 22212 6 0 0 25 0 1 0 1128869331 26304512 5601 1992294400 134512640 135813592 4294956160 18446744073709551615 134665160 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 6422 5601 150 317 0 6102 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 31048

[startup+282.301 s]
/proc/loadavg: 0.99 0.98 1.04 2/82 2044
/proc/meminfo: memFree=1345176/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=27424 CPUtime=282.15
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 6308 0 0 0 28209 6 0 0 25 0 1 0 1128869331 28082176 5951 1992294400 134512640 135813592 4294956160 18446744073709551615 134667921 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 6856 5951 150 317 0 6536 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 32784

[startup+342.301 s]
/proc/loadavg: 0.99 0.98 1.04 2/82 2044
/proc/meminfo: memFree=1344792/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=28068 CPUtime=342.12
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 6413 0 0 0 34206 6 0 0 25 0 1 0 1128869331 28741632 6056 1992294400 134512640 135813592 4294956160 18446744073709551615 134665745 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 7017 6056 150 317 0 6697 0

################
# More data... #
################

/proc/2037/statm: 7360 6361 150 317 0 7040 0
Current children cumulated CPU time (s) 522.04
Current children cumulated vsize (KiB) 34800

[startup+582.302 s]
/proc/loadavg: 0.99 0.98 1.01 2/82 2044
/proc/meminfo: memFree=1342744/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=30552 CPUtime=582.02
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 7051 0 0 0 58195 7 0 0 25 0 1 0 1128869331 31285248 6567 1992294400 134512640 135813592 4294956160 18446744073709551615 134665049 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 7638 6567 150 317 0 7318 0
Current children cumulated CPU time (s) 582.02
Current children cumulated vsize (KiB) 35912

[startup+642.303 s]
/proc/loadavg: 0.99 0.98 1.01 2/82 2044
/proc/meminfo: memFree=1340568/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5360 CPUtime=0
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128869331 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1340 239 197 169 0 51 0
[pid=2037] ppid=2036 vsize=33176 CPUtime=642
/proc/2037/stat : 2037 (hydrasat_cache4) R 2036 2036 1803 0 -1 4194304 7587 0 0 0 64193 7 0 0 25 0 1 0 1128869331 33972224 7103 1992294400 134512640 135813592 4294956160 18446744073709551615 134667486 0 0 4096 1 0 0 0 17 0 0 0
/proc/2037/statm: 8294 7103 150 317 0 7974 0
Current children cumulated CPU time (s) 642
Current children cumulated vsize (KiB) 38536

[startup+702.303 s]
/proc/loadavg: 0.99 0.98 1.00 2/82 2045
/proc/meminfo: memFree=1338840/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=3072 CPUtime=1.97
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 567 0 0 0 197 0 0 0 25 0 1 0 1128939363 3145728 549 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 768 549 172 362 0 403 0
Current children cumulated CPU time (s) 701.96
Current children cumulated vsize (KiB) 8436

[startup+762.307 s]
/proc/loadavg: 1.04 1.00 1.00 2/82 2045
/proc/meminfo: memFree=1325656/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=17000 CPUtime=61.94
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 3924 0 0 0 6191 3 0 0 25 0 1 0 1128939363 17408000 3808 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 4250 3808 172 362 0 3885 0
Current children cumulated CPU time (s) 761.93
Current children cumulated vsize (KiB) 22364

[startup+822.302 s]
/proc/loadavg: 1.05 1.01 1.00 2/82 2045
/proc/meminfo: memFree=1320536/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=22456 CPUtime=121.91
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 5244 0 0 0 12187 4 0 0 25 0 1 0 1128939363 22994944 5128 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 5614 5128 172 362 0 5249 0
Current children cumulated CPU time (s) 821.9
Current children cumulated vsize (KiB) 27820

[startup+882.303 s]
/proc/loadavg: 1.05 1.02 1.00 2/82 2045
/proc/meminfo: memFree=1315544/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=28724 CPUtime=181.89
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 6726 0 0 0 18183 6 0 0 25 0 1 0 1128939363 29413376 6384 1992294400 134512640 135995732 4294956016 18446744073709551615 134807855 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 7181 6384 172 362 0 6816 0
Current children cumulated CPU time (s) 881.88
Current children cumulated vsize (KiB) 34088

[startup+942.303 s]
/proc/loadavg: 1.13 1.05 1.01 2/82 2045
/proc/meminfo: memFree=1312152/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=32400 CPUtime=241.86
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 7574 0 0 0 24180 6 0 0 25 0 1 0 1128939363 33177600 7232 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 8100 7232 172 362 0 7735 0
Current children cumulated CPU time (s) 941.85
Current children cumulated vsize (KiB) 37764

[startup+1002.3 s]
/proc/loadavg: 1.12 1.05 1.00 2/82 2045
/proc/meminfo: memFree=1308760/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=35712 CPUtime=301.84
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 8465 0 0 0 30177 7 0 0 25 0 1 0 1128939363 36569088 8082 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 8928 8082 172 362 0 8563 0
Current children cumulated CPU time (s) 1001.83
Current children cumulated vsize (KiB) 41076

[startup+1062.3 s]
/proc/loadavg: 1.23 1.09 1.02 2/82 2045
/proc/meminfo: memFree=1305112/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=39392 CPUtime=361.81
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 9383 0 0 0 36174 7 0 0 25 0 1 0 1128939363 40337408 9000 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 9848 9000 172 362 0 9483 0
Current children cumulated CPU time (s) 1061.8
Current children cumulated vsize (KiB) 44756

[startup+1122.3 s]
/proc/loadavg: 1.15 1.08 1.01 2/82 2045
/proc/meminfo: memFree=1302616/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=41564 CPUtime=421.78
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 9999 0 0 0 42170 8 0 0 25 0 1 0 1128939363 42561536 9616 1992294400 134512640 135995732 4294956016 18446744073709551615 134807756 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 10391 9616 172 362 0 10026 0
Current children cumulated CPU time (s) 1121.77
Current children cumulated vsize (KiB) 46928

[startup+1182.3 s]
/proc/loadavg: 1.05 1.07 1.01 2/82 2045
/proc/meminfo: memFree=1299224/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=45456 CPUtime=481.77
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 10835 0 0 0 48168 9 0 0 25 0 1 0 1128939363 46546944 10452 1992294400 134512640 135995732 4294956016 18446744073709551615 134807904 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 11364 10452 172 362 0 10999 0
Current children cumulated CPU time (s) 1181.76
Current children cumulated vsize (KiB) 50820



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.6 s]
/proc/loadavg: 1.04 1.06 1.01 2/82 2045
/proc/meminfo: memFree=1298520/2055912 swapFree=4170680/4192956
[pid=2036] ppid=2034 vsize=5364 CPUtime=699.99
/proc/2036/stat : 2036 (hydrasat-multi.) S 2034 2036 1803 0 -1 4194304 321 8610 0 0 0 0 69981 18 16 0 1 0 1128869331 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 255372878660 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2036/statm: 1341 245 202 169 0 52 0
[pid=2045] ppid=2036 vsize=47148 CPUtime=500.06
/proc/2045/stat : 2045 (hydrasat_cachew) R 2036 2036 1803 0 -1 4194304 11261 0 0 0 49997 9 0 0 25 0 1 0 1128939363 48279552 10621 1992294400 134512640 135995732 4294956016 18446744073709551615 134807904 0 0 4096 1 0 0 0 17 0 0 0
/proc/2045/statm: 11787 10621 172 362 0 11422 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 52512

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2036 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=818611
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=187971
# CPU time returned by wait4() is 700.007
# while last known CPU time is 1200.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.61
CPU time (s): 1200.05
CPU user time (s): 1199.78
CPU system time (s): 0.27
CPU usage (%): 99.953
Max. virtual memory (cumulated for all children) (KiB): 52512

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.819
system time used= 0.187971
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8931
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 2618

runsolver used 1.48777 second user time and 3.98239 second system time

The end

Launcher Data 

Begin job on node78 at 2009-04-01 07:00:54
IDJOB=1530534
IDBENCH=70629
IDSOLVER=518
FILE ID=node78/1530534-1238562054
PBS_JOBID= 9062144
Free space on /tmp= 126872 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/RANDOM/MEDIUM/3SAT/UNKNOWN/380/unif-k3-r4.25-v380-c1615-S1807135406-059.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1530534-1238562054/watcher-1530534-1238562054 -o /tmp/evaluation-result-1530534-1238562054/solver-1530534-1238562054 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1530534-1238562054.cnf 1800 524891825

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= cb595cd6bad1f0c5699baaa892a03467
RANDOM SEED=524891825

node78.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055912 kB
MemFree:       1369600 kB
Buffers:         97464 kB
Cached:         495584 kB
SwapCached:       7800 kB
Active:         331696 kB
Inactive:       271816 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055912 kB
LowFree:       1369600 kB
SwapTotal:     4192956 kB
SwapFree:      4170680 kB
Dirty:            4084 kB
Writeback:           0 kB
Mapped:          16136 kB
Slab:            67060 kB
Committed_AS:  2694248 kB
PageTables:       2556 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 126840 MiB
End job on node78 at 2009-04-01 07:20:57