Trace number 1555869

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.06 1200.71

General information on the benchmark

NameAPPLICATIONS/bitverif/
maxor/maxor128.cnf
MD5SUMe050fe11c7c50ba82ac7126f49db3c10
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables200308
Number of clauses598619
Sum of the clauses size1396775
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2399078
Number of clauses of size 3199539
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Trying configuration 1
700.53/700.92	HOME/hydrasat-multi.sh: line 48:  9931 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.53/700.92	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1555869-1238743494/watcher-1555869-1238743494 -o /tmp/evaluation-result-1555869-1238743494/solver-1555869-1238743494 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1555869-1238743494.cnf 1800 622171428 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.03 3/64 9930
/proc/meminfo: memFree=1322144/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) R 9928 9930 9747 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 238 1992294400 4194304 4889804 548682068720 18446744073709551615 215418989215 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/9930/statm: 1340 238 196 169 0 51 0
[pid=9931] ppid=9930 vsize=3792 CPUtime=0
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 170 0 0 0 0 0 0 0 18 0 1 0 1147015759 3883008 152 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 948 152 117 317 0 628 0

[startup+0.093579 s]
/proc/loadavg: 1.00 1.00 1.03 3/64 9930
/proc/meminfo: memFree=1322144/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=7620 CPUtime=0.08
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 1201 0 0 0 8 0 0 0 19 0 1 0 1147015759 7802880 1183 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 1905 1184 117 317 0 1585 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 12980

[startup+0.10158 s]
/proc/loadavg: 1.00 1.00 1.03 3/64 9930
/proc/meminfo: memFree=1322144/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=8016 CPUtime=0.09
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 1295 0 0 0 9 0 0 0 19 0 1 0 1147015759 8208384 1277 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 2004 1277 117 317 0 1684 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 13376

[startup+0.301618 s]
/proc/loadavg: 1.00 1.00 1.03 3/64 9930
/proc/meminfo: memFree=1322144/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=16728 CPUtime=0.29
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 3617 0 0 0 27 2 0 0 21 0 1 0 1147015759 17129472 3599 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 4182 3600 117 317 0 3862 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 22088

[startup+0.701694 s]
/proc/loadavg: 1.00 1.00 1.03 3/64 9930
/proc/meminfo: memFree=1322144/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=33756 CPUtime=0.69
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 8199 0 0 0 65 4 0 0 25 0 1 0 1147015759 34566144 8181 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 8439 8181 117 317 0 8119 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 39116

[startup+1.50185 s]
/proc/loadavg: 1.00 1.00 1.03 2/66 9932
/proc/meminfo: memFree=1272712/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=62572 CPUtime=1.48
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 15840 0 0 0 142 6 0 0 25 0 1 0 1147015759 64073728 14649 1992294400 134512640 135813592 4294956160 18446744073709551615 134692398 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 15643 14650 126 317 0 15323 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 67932

[startup+3.10215 s]
/proc/loadavg: 1.00 1.00 1.03 2/66 9932
/proc/meminfo: memFree=1252808/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=92212 CPUtime=3.08
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 23831 0 0 0 297 11 0 0 25 0 1 0 1147015759 94425088 22156 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 23053 22156 126 317 0 22733 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 97572

[startup+6.30177 s]
/proc/loadavg: 1.00 1.00 1.03 2/66 9932
/proc/meminfo: memFree=1220104/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=104620 CPUtime=6.28
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 27261 0 0 0 615 13 0 0 25 0 1 0 1147015759 107130880 25586 1992294400 134512640 135813592 4294956160 18446744073709551615 134520789 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 26155 25586 126 317 0 25835 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 109980

[startup+12.703 s]
/proc/loadavg: 1.00 1.00 1.03 2/66 9932
/proc/meminfo: memFree=1185928/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=139132 CPUtime=12.68
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 38222 0 0 0 1251 17 0 0 25 0 1 0 1147015759 142471168 34075 1992294400 134512640 135813592 4294956160 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 34783 34075 150 317 0 34463 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 144492

[startup+25.5015 s]
/proc/loadavg: 1.00 1.00 1.02 2/66 9932
/proc/meminfo: memFree=1184136/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=141180 CPUtime=25.47
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 38715 0 0 0 2529 18 0 0 25 0 1 0 1147015759 144568320 34568 1992294400 134512640 135813592 4294956160 18446744073709551615 134665472 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 35295 34568 150 317 0 34975 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 146540

[startup+51.1014 s]
/proc/loadavg: 1.00 1.00 1.02 2/66 9932
/proc/meminfo: memFree=1182664/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=142524 CPUtime=51.06
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 39074 0 0 0 5088 18 0 0 25 0 1 0 1147015759 145944576 34927 1992294400 134512640 135813592 4294956160 18446744073709551615 134662685 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 35631 34927 150 317 0 35311 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 147884

[startup+102.305 s]
/proc/loadavg: 1.00 1.00 1.02 2/66 9932
/proc/meminfo: memFree=1177096/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=148084 CPUtime=102.23
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 40444 0 0 0 10204 19 0 0 25 0 1 0 1147015759 151638016 36297 1992294400 134512640 135813592 4294956160 18446744073709551615 134592479 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 37021 36297 150 317 0 36701 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 153444

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.01 2/66 9932
/proc/meminfo: memFree=1174856/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=150296 CPUtime=162.2
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 40994 0 0 0 16200 20 0 0 25 0 1 0 1147015759 153903104 36847 1992294400 134512640 135813592 4294956160 18446744073709551615 134591953 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 37574 36847 150 317 0 37254 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 155656

[startup+222.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9932
/proc/meminfo: memFree=1173128/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=152024 CPUtime=222.18
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 41437 0 0 0 22197 21 0 0 25 0 1 0 1147015759 155672576 37290 1992294400 134512640 135813592 4294956160 18446744073709551615 134664877 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 38006 37290 150 317 0 37686 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 157384

[startup+282.303 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9932
/proc/meminfo: memFree=1168328/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=157124 CPUtime=282.15
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 42696 0 0 0 28193 22 0 0 25 0 1 0 1147015759 160894976 38549 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 39281 38549 150 317 0 38961 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 162484

[startup+342.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9932
/proc/meminfo: memFree=1163208/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=162092 CPUtime=342.12
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 43912 0 0 0 34189 23 0 0 25 0 1 0 1147015759 165982208 39765 1992294400 134512640 135813592 4294956160 18446744073709551615 134664959 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 40523 39765 150 317 0 40203 0

################
# More data... #
################

/proc/9931/statm: 42741 41850 150 317 0 42421 0
Current children cumulated CPU time (s) 582.01
Current children cumulated vsize (KiB) 176324

[startup+642.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9932
/proc/meminfo: memFree=1154440/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5360 CPUtime=0
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1147015759 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9930/statm: 1340 239 197 169 0 51 0
[pid=9931] ppid=9930 vsize=171360 CPUtime=641.98
/proc/9931/stat : 9931 (hydrasat_cache4) R 9930 9930 9747 0 -1 4194304 46109 0 0 0 64173 25 0 0 25 0 1 0 1147015759 175472640 41962 1992294400 134512640 135813592 4294956160 18446744073709551615 134665395 0 0 4096 1 0 0 0 17 0 0 0
/proc/9931/statm: 42840 41962 150 317 0 42520 0
Current children cumulated CPU time (s) 641.98
Current children cumulated vsize (KiB) 176720

[startup+702.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9933
/proc/meminfo: memFree=1117192/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=51208 CPUtime=1.36
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 12965 0 0 0 130 6 0 0 25 0 1 0 1147085851 52436992 11775 1992294400 134512640 135995732 4294956032 18446744073709551615 134513235 0 0 4096 1 0 0 0 17 1 0 0
/proc/9933/statm: 12802 11775 151 362 0 12437 0
Current children cumulated CPU time (s) 701.91
Current children cumulated vsize (KiB) 56572

[startup+762.306 s]
/proc/loadavg: 1.03 1.01 1.00 2/66 9933
/proc/meminfo: memFree=1055376/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=101312 CPUtime=61.33
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 28931 0 0 0 6115 18 0 0 25 0 1 0 1147085851 103743488 24589 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 25328 24589 173 362 0 24963 0
Current children cumulated CPU time (s) 761.88
Current children cumulated vsize (KiB) 106676

[startup+822.301 s]
/proc/loadavg: 1.01 1.01 1.00 2/66 9933
/proc/meminfo: memFree=1053264/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=103684 CPUtime=121.3
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 29518 0 0 0 12112 18 0 0 25 0 1 0 1147085851 106172416 25176 1992294400 134512640 135995732 4294956032 18446744073709551615 134808018 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 25921 25176 173 362 0 25556 0
Current children cumulated CPU time (s) 821.85
Current children cumulated vsize (KiB) 109048

[startup+882.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9933
/proc/meminfo: memFree=1049936/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=107000 CPUtime=181.27
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 30380 0 0 0 18107 20 0 0 25 0 1 0 1147085851 109568000 26038 1992294400 134512640 135995732 4294956032 18446744073709551615 134806613 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 26750 26038 173 362 0 26385 0
Current children cumulated CPU time (s) 881.82
Current children cumulated vsize (KiB) 112364

[startup+942.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9933
/proc/meminfo: memFree=1046800/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=110232 CPUtime=241.23
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 31155 0 0 0 24103 20 0 0 25 0 1 0 1147085851 112877568 26813 1992294400 134512640 135995732 4294956032 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 27558 26813 173 362 0 27193 0
Current children cumulated CPU time (s) 941.78
Current children cumulated vsize (KiB) 115596

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9933
/proc/meminfo: memFree=1045456/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=111564 CPUtime=301.22
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 31489 0 0 0 30101 21 0 0 25 0 1 0 1147085851 114241536 27147 1992294400 134512640 135995732 4294956032 18446744073709551615 134589632 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 27891 27147 173 362 0 27526 0
Current children cumulated CPU time (s) 1001.77
Current children cumulated vsize (KiB) 116928

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9933
/proc/meminfo: memFree=1042064/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=115024 CPUtime=361.18
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 32382 0 0 0 36097 21 0 0 25 0 1 0 1147085851 117784576 28040 1992294400 134512640 135995732 4294956032 18446744073709551615 134808091 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 28756 28040 173 362 0 28391 0
Current children cumulated CPU time (s) 1061.73
Current children cumulated vsize (KiB) 120388

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9933
/proc/meminfo: memFree=1040912/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=115948 CPUtime=421.15
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 32619 0 0 0 42093 22 0 0 25 0 1 0 1147085851 118730752 28277 1992294400 134512640 135995732 4294956032 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 28987 28277 173 362 0 28622 0
Current children cumulated CPU time (s) 1121.7
Current children cumulated vsize (KiB) 121312

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9933
/proc/meminfo: memFree=1040592/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=116352 CPUtime=481.12
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 32705 0 0 0 48090 22 0 0 25 0 1 0 1147085851 119144448 28363 1992294400 134512640 135995732 4294956032 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 29088 28363 173 362 0 28723 0
Current children cumulated CPU time (s) 1181.67
Current children cumulated vsize (KiB) 121716



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9935
/proc/meminfo: memFree=1040080/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=116488 CPUtime=499.51
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 32730 0 0 0 49929 22 0 0 25 0 1 0 1147085851 119283712 28388 1992294400 134512640 135995732 4294956032 18446744073709551615 134589629 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 29122 28388 173 362 0 28757 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 121852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9935
/proc/meminfo: memFree=1040080/2055920 swapFree=4178400/4192956
[pid=9930] ppid=9928 vsize=5364 CPUtime=700.55
/proc/9930/stat : 9930 (hydrasat-multi.) S 9928 9930 9747 0 -1 4194304 321 47095 0 0 0 0 69963 92 16 0 1 0 1147015759 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 215418987332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9930/statm: 1341 245 202 169 0 52 0
[pid=9933] ppid=9930 vsize=116488 CPUtime=499.51
/proc/9933/stat : 9933 (hydrasat_cachew) R 9930 9930 9747 0 -1 4194304 32730 0 0 0 49929 22 0 0 25 0 1 0 1147085851 119283712 28388 1992294400 134512640 135995732 4294956032 18446744073709551615 134589629 0 0 4096 1 0 0 0 17 0 0 0
/proc/9933/statm: 29122 28388 173 362 0 28757 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 121852

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 9930 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=631639
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=925859
# CPU time returned by wait4() is 700.557
# while last known CPU time is 1200.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.71
CPU time (s): 1200.06
CPU user time (s): 1198.92
CPU system time (s): 1.14
CPU usage (%): 99.9456
Max. virtual memory (cumulated for all children) (KiB): 177824

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.632
system time used= 0.925859
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 47416
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 2717

runsolver used 0.954854 second user time and 3.41948 second system time

The end

Launcher Data 

Begin job on node9 at 2009-04-03 09:24:54
IDJOB=1555869
IDBENCH=70808
IDSOLVER=518
FILE ID=node9/1555869-1238743494
PBS_JOBID= 9086116
Free space on /tmp= 66532 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/APPLICATIONS/bitverif/maxor/maxor128.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1555869-1238743494/watcher-1555869-1238743494 -o /tmp/evaluation-result-1555869-1238743494/solver-1555869-1238743494 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1555869-1238743494.cnf 1800 622171428

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= e050fe11c7c50ba82ac7126f49db3c10
RANDOM SEED=622171428

node9.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1322624 kB
Buffers:        109028 kB
Cached:         517612 kB
SwapCached:       8344 kB
Active:         273284 kB
Inactive:       363212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1322624 kB
SwapTotal:     4192956 kB
SwapFree:      4178400 kB
Dirty:           14584 kB
Writeback:           0 kB
Mapped:          15580 kB
Slab:            82856 kB
Committed_AS:  3070904 kB
PageTables:       1392 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66364 MiB
End job on node9 at 2009-04-03 09:44:57