Trace number 1530387

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.07 1200.61

General information on the benchmark

NameRANDOM/MEDIUM/3SAT/UNKNOWN/400/
unif-k3-r4.25-v400-c1700-S1375576340-029.cnf
MD5SUM1b93ff755afc24c2ba01a5f3cf1dc449
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark73.5298
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses1700
Sum of the clauses size5100
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Trying configuration 1
699.91/700.28	HOME/hydrasat-multi.sh: line 48: 22276 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
699.91/700.28	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1530387-1238521491/watcher-1530387-1238521491 -o /tmp/evaluation-result-1530387-1238521491/solver-1530387-1238521491 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1530387-1238521491.cnf 1800 1449798125 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 22275
/proc/meminfo: memFree=1117048/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=1452 CPUtime=0
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 168 0 0 0 0 0 0 0 19 0 1 0 1124814034 1486848 150 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 363 150 116 317 0 43 0

[startup+0.0127869 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 22275
/proc/meminfo: memFree=1117048/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=1716 CPUtime=0
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 255 0 0 0 0 0 0 0 19 0 1 0 1124814034 1757184 236 1992294400 134512640 135813592 4294956176 18446744073709551615 134597141 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 429 236 150 317 0 109 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 7076

[startup+0.101797 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 22275
/proc/meminfo: memFree=1117048/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=1848 CPUtime=0.09
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 283 0 0 0 9 0 0 0 19 0 1 0 1124814034 1892352 264 1992294400 134512640 135813592 4294956176 18446744073709551615 134665972 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 462 264 150 317 0 142 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7208

[startup+0.301818 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 22275
/proc/meminfo: memFree=1117048/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=1980 CPUtime=0.29
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 323 0 0 0 29 0 0 0 21 0 1 0 1124814034 2027520 304 1992294400 134512640 135813592 4294956176 18446744073709551615 134661542 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 495 304 150 317 0 175 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7340

[startup+0.701863 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 22275
/proc/meminfo: memFree=1117048/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=2112 CPUtime=0.69
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 369 0 0 0 69 0 0 0 24 0 1 0 1124814034 2162688 350 1992294400 134512640 135813592 4294956176 18446744073709551615 134664934 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 528 350 150 317 0 208 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 7472

[startup+1.50195 s]
/proc/loadavg: 0.91 0.95 0.98 2/66 22277
/proc/meminfo: memFree=1115752/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=2512 CPUtime=1.49
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 468 0 0 0 149 0 0 0 25 0 1 0 1124814034 2572288 449 1992294400 134512640 135813592 4294956176 18446744073709551615 134661505 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 628 449 150 317 0 308 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 7872

[startup+3.10114 s]
/proc/loadavg: 0.91 0.95 0.98 2/66 22277
/proc/meminfo: memFree=1115432/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=2776 CPUtime=3.09
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 521 0 0 0 309 0 0 0 25 0 1 0 1124814034 2842624 502 1992294400 134512640 135813592 4294956176 18446744073709551615 134665432 0 0 4096 1 0 0 0 17 1 0 0
/proc/22276/statm: 694 502 150 317 0 374 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 8136

[startup+6.30149 s]
/proc/loadavg: 0.92 0.95 0.98 2/66 22277
/proc/meminfo: memFree=1114280/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=3848 CPUtime=6.28
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 791 0 0 0 628 0 0 0 25 0 1 0 1124814034 3940352 772 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 962 772 150 317 0 642 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 9208

[startup+12.7012 s]
/proc/loadavg: 0.93 0.95 0.98 2/66 22277
/proc/meminfo: memFree=1111912/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=6280 CPUtime=12.68
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 1378 0 0 0 1268 0 0 0 25 0 1 0 1124814034 6430720 1359 1992294400 134512640 135813592 4294956176 18446744073709551615 134664993 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 1570 1359 150 317 0 1250 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 11640

[startup+25.5016 s]
/proc/loadavg: 0.94 0.96 0.98 2/66 22277
/proc/meminfo: memFree=1108136/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=10280 CPUtime=25.48
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 2303 0 0 0 2546 2 0 0 25 0 1 0 1124814034 10526720 2284 1992294400 134512640 135813592 4294956176 18446744073709551615 134665006 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 2570 2284 150 317 0 2250 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 15640

[startup+51.1015 s]
/proc/loadavg: 0.96 0.96 0.98 2/66 22277
/proc/meminfo: memFree=1106984/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=11768 CPUtime=51.06
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 2620 0 0 0 5104 2 0 0 25 0 1 0 1124814034 12050432 2568 1992294400 134512640 135813592 4294956176 18446744073709551615 134597681 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 2942 2568 150 317 0 2622 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 17128

[startup+102.305 s]
/proc/loadavg: 0.98 0.96 0.98 2/66 22277
/proc/meminfo: memFree=1105000/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=13940 CPUtime=102.24
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 3103 0 0 0 10222 2 0 0 25 0 1 0 1124814034 14274560 3024 1992294400 134512640 135813592 4294956176 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 3485 3024 150 317 0 3165 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 19300

[startup+162.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22277
/proc/meminfo: memFree=1099944/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=19828 CPUtime=162.22
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 4559 0 0 0 16218 4 0 0 25 0 1 0 1124814034 20303872 4321 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 4957 4321 150 317 0 4637 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 25188

[startup+222.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22277
/proc/meminfo: memFree=1095080/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=24980 CPUtime=222.2
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 5823 0 0 0 22215 5 0 0 25 0 1 0 1124814034 25579520 5514 1992294400 134512640 135813592 4294956176 18446744073709551615 134665184 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 6245 5514 150 317 0 5925 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 30340

[startup+282.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22277
/proc/meminfo: memFree=1093864/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=26420 CPUtime=282.17
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 6120 0 0 0 28212 5 0 0 25 0 1 0 1124814034 27054080 5811 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 6605 5811 150 317 0 6285 0
Current children cumulated CPU time (s) 282.17
Current children cumulated vsize (KiB) 31780

[startup+342.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22277
/proc/meminfo: memFree=1093864/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=26420 CPUtime=342.14
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 6135 0 0 0 34209 5 0 0 25 0 1 0 1124814034 27054080 5826 1992294400 134512640 135813592 4294956176 18446744073709551615 134665868 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 6605 5826 150 317 0 6285 0

################
# More data... #
################

/proc/22276/statm: 7173 6291 150 317 0 6853 0
Current children cumulated CPU time (s) 522.08
Current children cumulated vsize (KiB) 34052

[startup+582.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22277
/proc/meminfo: memFree=1091112/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=29660 CPUtime=582.06
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 6883 0 0 0 58200 6 0 0 25 0 1 0 1124814034 30371840 6513 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 7415 6513 150 317 0 7095 0
Current children cumulated CPU time (s) 582.06
Current children cumulated vsize (KiB) 35020

[startup+642.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22277
/proc/meminfo: memFree=1089960/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5360 CPUtime=0
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1124814034 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1340 239 197 169 0 51 0
[pid=22276] ppid=22275 vsize=30952 CPUtime=642.03
/proc/22276/stat : 22276 (hydrasat_cache4) R 22275 22275 22050 0 -1 4194304 7166 0 0 0 64197 6 0 0 25 0 1 0 1124814034 31694848 6796 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/22276/statm: 7738 6796 150 317 0 7418 0
Current children cumulated CPU time (s) 642.03
Current children cumulated vsize (KiB) 36312

[startup+702.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22278
/proc/meminfo: memFree=1087208/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=3060 CPUtime=2
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 556 0 0 0 200 0 0 0 25 0 1 0 1124884063 3133440 539 1992294400 134512640 135995732 4294956032 18446744073709551615 134807833 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 765 539 172 362 0 400 0
Current children cumulated CPU time (s) 701.99
Current children cumulated vsize (KiB) 8424

[startup+762.307 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22278
/proc/meminfo: memFree=1074216/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=16648 CPUtime=61.97
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 3868 0 0 0 6193 4 0 0 25 0 1 0 1124884063 17047552 3753 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 4162 3753 172 362 0 3797 0
Current children cumulated CPU time (s) 761.96
Current children cumulated vsize (KiB) 22012

[startup+822.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22278
/proc/meminfo: memFree=1069032/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=21900 CPUtime=121.94
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 5190 0 0 0 12188 6 0 0 25 0 1 0 1124884063 22425600 5075 1992294400 134512640 135995732 4294956032 18446744073709551615 134807843 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 5475 5075 172 362 0 5110 0
Current children cumulated CPU time (s) 821.93
Current children cumulated vsize (KiB) 27264

[startup+882.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22278
/proc/meminfo: memFree=1064168/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=27632 CPUtime=181.91
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 6537 0 0 0 18184 7 0 0 25 0 1 0 1124884063 28295168 6293 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 6908 6293 172 362 0 6543 0
Current children cumulated CPU time (s) 881.9
Current children cumulated vsize (KiB) 32996

[startup+942.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22278
/proc/meminfo: memFree=1060456/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=31748 CPUtime=241.89
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 7484 0 0 0 24181 8 0 0 25 0 1 0 1124884063 32509952 7240 1992294400 134512640 135995732 4294956032 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 7937 7240 172 362 0 7572 0
Current children cumulated CPU time (s) 941.88
Current children cumulated vsize (KiB) 37112

[startup+1002.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22284
/proc/meminfo: memFree=1057320/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=34864 CPUtime=301.85
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 8272 0 0 0 30176 9 0 0 25 0 1 0 1124884063 35700736 8028 1992294400 134512640 135995732 4294956032 18446744073709551615 134807904 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 8716 8028 172 362 0 8351 0
Current children cumulated CPU time (s) 1001.84
Current children cumulated vsize (KiB) 40228

[startup+1062.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22284
/proc/meminfo: memFree=1054248/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=38184 CPUtime=361.83
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 9047 0 0 0 36173 10 0 0 25 0 1 0 1124884063 39100416 8803 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 9546 8803 172 362 0 9181 0
Current children cumulated CPU time (s) 1061.82
Current children cumulated vsize (KiB) 43548

[startup+1122.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22284
/proc/meminfo: memFree=1051560/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=40820 CPUtime=421.81
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 9700 0 0 0 42170 11 0 0 25 0 1 0 1124884063 41799680 9456 1992294400 134512640 135995732 4294956032 18446744073709551615 134807865 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 10205 9456 172 362 0 9840 0
Current children cumulated CPU time (s) 1121.8
Current children cumulated vsize (KiB) 46184

[startup+1182.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22284
/proc/meminfo: memFree=1048104/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=44660 CPUtime=481.78
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 10616 0 0 0 48167 11 0 0 25 0 1 0 1124884063 45731840 10335 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 11165 10335 172 362 0 10800 0
Current children cumulated CPU time (s) 1181.77
Current children cumulated vsize (KiB) 50024



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.6 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 22284
/proc/meminfo: memFree=1047080/2055920 swapFree=4176920/4192956
[pid=22275] ppid=22273 vsize=5364 CPUtime=699.99
/proc/22275/stat : 22275 (hydrasat-multi.) S 22273 22275 22050 0 -1 4194304 322 8261 0 0 0 0 69982 17 19 0 1 0 1124814034 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 266134414148 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22275/statm: 1341 245 202 169 0 52 0
[pid=22278] ppid=22275 vsize=45688 CPUtime=500.08
/proc/22278/stat : 22278 (hydrasat_cachew) R 22275 22275 22050 0 -1 4194304 10897 0 0 0 49996 12 0 0 25 0 1 0 1124884063 46784512 10567 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/22278/statm: 11422 10567 172 362 0 11057 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 51052

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22275 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=825610
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=179972
# CPU time returned by wait4() is 700.006
# while last known CPU time is 1200.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.61
CPU time (s): 1200.07
CPU user time (s): 1199.78
CPU system time (s): 0.29
CPU usage (%): 99.9547
Max. virtual memory (cumulated for all children) (KiB): 51052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.826
system time used= 0.179972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8583
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1988

runsolver used 0.931858 second user time and 3.44448 second system time

The end

Launcher Data 

Begin job on node35 at 2009-03-31 19:44:51
IDJOB=1530387
IDBENCH=70580
IDSOLVER=518
FILE ID=node35/1530387-1238521491
PBS_JOBID= 9062007
Free space on /tmp= 66504 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/RANDOM/MEDIUM/3SAT/UNKNOWN/400/unif-k3-r4.25-v400-c1700-S1375576340-029.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1530387-1238521491/watcher-1530387-1238521491 -o /tmp/evaluation-result-1530387-1238521491/solver-1530387-1238521491 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1530387-1238521491.cnf 1800 1449798125

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 1b93ff755afc24c2ba01a5f3cf1dc449
RANDOM SEED=1449798125

node35.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.229
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.229
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1117528 kB
Buffers:        108656 kB
Cached:         725012 kB
SwapCached:      10144 kB
Active:         312260 kB
Inactive:       533100 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1117528 kB
SwapTotal:     4192956 kB
SwapFree:      4176920 kB
Dirty:            4108 kB
Writeback:           0 kB
Mapped:          17524 kB
Slab:            79044 kB
Committed_AS:  2797828 kB
PageTables:       1404 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66472 MiB
End job on node35 at 2009-03-31 20:04:54