Trace number 1530423

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.02 1200.61

General information on the benchmark

NameRANDOM/MEDIUM/3SAT/UNKNOWN/440/
unif-k3-r4.25-v440-c1870-S492033085-065.cnf
MD5SUMcbe223815ecb4175f94b654d971303ac
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark167.116
Satisfiable
(Un)Satisfiability was proved
Number of variables440
Number of clauses1870
Sum of the clauses size5610
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31870
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Trying configuration 1
700.16/700.52	HOME/hydrasat-multi.sh: line 48: 20453 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.16/700.52	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1530423-1238531261/watcher-1530423-1238531261 -o /tmp/evaluation-result-1530423-1238531261/solver-1530423-1238531261 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1530423-1238531261.cnf 1800 1203068651 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.84 0.95 0.98 3/73 20452
/proc/meminfo: memFree=1515848/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=1452 CPUtime=0
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 173 0 0 0 0 0 0 0 19 0 1 0 909514790 1486848 155 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 363 155 116 317 0 43 0

[startup+0.0901711 s]
/proc/loadavg: 0.84 0.95 0.98 3/73 20452
/proc/meminfo: memFree=1515848/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=1844 CPUtime=0.08
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 284 0 0 0 8 0 0 0 19 0 1 0 909514790 1888256 265 1992294400 134512640 135813592 4294956176 18446744073709551615 135224169 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 461 265 149 317 0 141 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 7204

[startup+0.101173 s]
/proc/loadavg: 0.84 0.95 0.98 3/73 20452
/proc/meminfo: memFree=1515848/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=1844 CPUtime=0.09
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 287 0 0 0 9 0 0 0 19 0 1 0 909514790 1888256 268 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 461 268 149 317 0 141 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7204

[startup+0.301193 s]
/proc/loadavg: 0.84 0.95 0.98 3/73 20452
/proc/meminfo: memFree=1515848/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=1972 CPUtime=0.29
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 321 0 0 0 29 0 0 0 20 0 1 0 909514790 2019328 302 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 493 302 149 317 0 173 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7332

[startup+0.701235 s]
/proc/loadavg: 0.84 0.95 0.98 3/73 20452
/proc/meminfo: memFree=1515848/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=2236 CPUtime=0.69
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 380 0 0 0 69 0 0 0 25 0 1 0 909514790 2289664 361 1992294400 134512640 135813592 4294956176 18446744073709551615 135224115 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 559 361 149 317 0 239 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 7596

[startup+1.50132 s]
/proc/loadavg: 0.84 0.95 0.98 2/75 20454
/proc/meminfo: memFree=1514488/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=2628 CPUtime=1.49
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 496 0 0 0 149 0 0 0 25 0 1 0 909514790 2691072 477 1992294400 134512640 135813592 4294956176 18446744073709551615 135205447 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 657 477 149 317 0 337 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 7988

[startup+3.10149 s]
/proc/loadavg: 0.85 0.95 0.98 2/75 20454
/proc/meminfo: memFree=1513464/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=3808 CPUtime=3.09
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 781 0 0 0 309 0 0 0 25 0 1 0 909514790 3899392 762 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 952 762 149 317 0 632 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 9168

[startup+6.30183 s]
/proc/loadavg: 0.85 0.95 0.98 2/75 20454
/proc/meminfo: memFree=1511544/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=6052 CPUtime=6.28
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 1288 0 0 0 628 0 0 0 25 0 1 0 909514790 6197248 1269 1992294400 134512640 135813592 4294956176 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 1513 1269 149 317 0 1193 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 11412

[startup+12.7025 s]
/proc/loadavg: 0.88 0.95 0.98 2/75 20454
/proc/meminfo: memFree=1508664/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=8620 CPUtime=12.69
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 1897 0 0 0 1268 1 0 0 25 0 1 0 909514790 8826880 1878 1992294400 134512640 135813592 4294956176 18446744073709551615 134665950 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 2155 1878 149 317 0 1835 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 13980

[startup+25.5019 s]
/proc/loadavg: 0.89 0.95 0.98 2/75 20454
/proc/meminfo: memFree=1504760/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=12904 CPUtime=25.47
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 2923 0 0 0 2545 2 0 0 25 0 1 0 909514790 13213696 2835 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 3226 2835 149 317 0 2906 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 18264

[startup+51.1016 s]
/proc/loadavg: 0.93 0.96 0.98 2/75 20454
/proc/meminfo: memFree=1497016/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=21336 CPUtime=51.06
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 4924 0 0 0 5103 3 0 0 25 0 1 0 909514790 21848064 4728 1992294400 134512640 135813592 4294956176 18446744073709551615 134665544 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 5334 4728 149 317 0 5014 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 26696

[startup+102.307 s]
/proc/loadavg: 0.97 0.96 0.98 2/75 20454
/proc/meminfo: memFree=1489464/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=29872 CPUtime=102.24
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 7043 0 0 0 10220 4 0 0 25 0 1 0 909514790 30588928 6607 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 7468 6607 149 317 0 7148 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 35232

[startup+162.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/75 20454
/proc/meminfo: memFree=1481592/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=39412 CPUtime=162.2
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 9258 0 0 0 16215 5 0 0 25 0 1 0 909514790 40357888 8579 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 9853 8579 149 317 0 9533 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 44772

[startup+222.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/75 20454
/proc/meminfo: memFree=1476088/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=45116 CPUtime=222.17
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 10640 0 0 0 22210 7 0 0 25 0 1 0 909514790 46198784 9961 1992294400 134512640 135813592 4294956176 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 11279 9961 149 317 0 10959 0
Current children cumulated CPU time (s) 222.17
Current children cumulated vsize (KiB) 50476

[startup+282.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/75 20454
/proc/meminfo: memFree=1471288/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=50708 CPUtime=282.15
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 11852 0 0 0 28207 8 0 0 25 0 1 0 909514790 51924992 11173 1992294400 134512640 135813592 4294956176 18446744073709551615 135224174 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 12677 11173 149 317 0 12357 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 56068

[startup+342.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/75 20454
/proc/meminfo: memFree=1462136/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=60160 CPUtime=342.11
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 14413 0 0 0 34202 9 0 0 25 0 1 0 909514790 61603840 13452 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 15040 13452 149 317 0 14720 0

################
# More data... #
################

/proc/20453/statm: 18887 16447 149 317 0 18567 0
Current children cumulated CPU time (s) 522.05
Current children cumulated vsize (KiB) 80908

[startup+582.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/75 20454
/proc/meminfo: memFree=1446904/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=78892 CPUtime=582.02
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 19212 0 0 0 58187 15 0 0 25 0 1 0 909514790 80785408 17255 1992294400 134512640 135813592 4294956176 18446744073709551615 134665175 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 19723 17255 149 317 0 19403 0
Current children cumulated CPU time (s) 582.02
Current children cumulated vsize (KiB) 84252

[startup+642.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/75 20454
/proc/meminfo: memFree=1443448/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5360 CPUtime=0
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 909514790 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1340 239 197 169 0 51 0
[pid=20453] ppid=20452 vsize=82436 CPUtime=642
/proc/20453/stat : 20453 (hydrasat_cache4) R 20452 20452 20415 0 -1 4194304 20058 0 0 0 64184 16 0 0 25 0 1 0 909514790 84414464 18101 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/20453/statm: 20609 18101 149 317 0 20289 0
Current children cumulated CPU time (s) 642
Current children cumulated vsize (KiB) 87796

[startup+702.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/75 20455
/proc/meminfo: memFree=1432312/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=2664 CPUtime=1.76
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 484 0 0 0 176 0 0 0 25 0 1 0 909584843 2727936 467 1992294400 134512640 135995732 4294956032 18446744073709551615 134807735 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 666 467 171 362 0 301 0
Current children cumulated CPU time (s) 701.95
Current children cumulated vsize (KiB) 8028

[startup+762.307 s]
/proc/loadavg: 1.06 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1420344/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=16552 CPUtime=61.73
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 3846 0 0 0 6168 5 0 0 25 0 1 0 909584843 16949248 3731 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 4138 3731 171 362 0 3773 0
Current children cumulated CPU time (s) 761.92
Current children cumulated vsize (KiB) 21916

[startup+822.301 s]
/proc/loadavg: 1.02 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1414584/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=22872 CPUtime=121.69
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 5340 0 0 0 12163 6 0 0 25 0 1 0 909584843 23420928 5225 1992294400 134512640 135995732 4294956032 18446744073709551615 134807738 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 5718 5225 171 362 0 5353 0
Current children cumulated CPU time (s) 821.88
Current children cumulated vsize (KiB) 28236

[startup+882.302 s]
/proc/loadavg: 1.01 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1409400/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=28824 CPUtime=181.67
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 6774 0 0 0 18159 8 0 0 25 0 1 0 909584843 29515776 6530 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 7206 6530 171 362 0 6841 0
Current children cumulated CPU time (s) 881.86
Current children cumulated vsize (KiB) 34188

[startup+942.302 s]
/proc/loadavg: 1.00 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1405112/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=33124 CPUtime=241.64
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 7858 0 0 0 24155 9 0 0 25 0 1 0 909584843 33918976 7614 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 8281 7614 171 362 0 7916 0
Current children cumulated CPU time (s) 941.83
Current children cumulated vsize (KiB) 38488

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1401336/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=36868 CPUtime=301.62
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 8774 0 0 0 30152 10 0 0 25 0 1 0 909584843 37752832 8530 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 9217 8530 171 362 0 8852 0
Current children cumulated CPU time (s) 1001.81
Current children cumulated vsize (KiB) 42232

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1398200/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=39984 CPUtime=361.58
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 9571 0 0 0 36147 11 0 0 25 0 1 0 909584843 40943616 9327 1992294400 134512640 135995732 4294956032 18446744073709551615 134807904 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 9996 9327 171 362 0 9631 0
Current children cumulated CPU time (s) 1061.77
Current children cumulated vsize (KiB) 45348

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1394424/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=44332 CPUtime=421.56
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 10597 0 0 0 42144 12 0 0 25 0 1 0 909584843 45395968 10272 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 11083 10272 171 362 0 10718 0
Current children cumulated CPU time (s) 1121.75
Current children cumulated vsize (KiB) 49696

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1391544/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=48348 CPUtime=481.54
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 11553 0 0 0 48141 13 0 0 25 0 1 0 909584843 49508352 10971 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 12087 10971 171 362 0 11722 0
Current children cumulated CPU time (s) 1181.73
Current children cumulated vsize (KiB) 53712



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.6 s]
/proc/loadavg: 1.00 1.00 0.99 2/75 20455
/proc/meminfo: memFree=1390776/2055920 swapFree=4176824/4192956
[pid=20452] ppid=20450 vsize=5364 CPUtime=700.19
/proc/20452/stat : 20452 (hydrasat-multi.) S 20450 20452 20415 0 -1 4194304 322 24433 0 0 0 0 69972 47 19 0 1 0 909514790 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 224264774468 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20452/statm: 1341 245 202 169 0 52 0
[pid=20455] ppid=20452 vsize=49008 CPUtime=499.83
/proc/20455/stat : 20455 (hydrasat_cachew) R 20452 20452 20415 0 -1 4194304 11738 0 0 0 49970 13 0 0 25 0 1 0 909584843 50184192 11156 1992294400 134512640 135995732 4294956032 18446744073709551615 134808081 0 0 4096 1 0 0 0 17 0 0 0
/proc/20455/statm: 12252 11156 171 362 0 11887 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 54372

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20452 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=728625
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=473927
# CPU time returned by wait4() is 700.203
# while last known CPU time is 1200.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.61
CPU time (s): 1200.02
CPU user time (s): 1199.42
CPU system time (s): 0.6
CPU usage (%): 99.9506
Max. virtual memory (cumulated for all children) (KiB): 95736

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.729
system time used= 0.473927
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24755
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1999

runsolver used 1.15382 second user time and 3.2545 second system time

The end

Launcher Data 

Begin job on node82 at 2009-03-31 22:27:42
IDJOB=1530423
IDBENCH=70592
IDSOLVER=518
FILE ID=node82/1530423-1238531261
PBS_JOBID= 9062066
Free space on /tmp= 61636 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/RANDOM/MEDIUM/3SAT/UNKNOWN/440/unif-k3-r4.25-v440-c1870-S492033085-065.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1530423-1238531261/watcher-1530423-1238531261 -o /tmp/evaluation-result-1530423-1238531261/solver-1530423-1238531261 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1530423-1238531261.cnf 1800 1203068651

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= cbe223815ecb4175f94b654d971303ac
RANDOM SEED=1203068651

node82.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1516336 kB
Buffers:         88692 kB
Cached:         360460 kB
SwapCached:       7332 kB
Active:         335036 kB
Inactive:       123456 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1516336 kB
SwapTotal:     4192956 kB
SwapFree:      4176824 kB
Dirty:            4288 kB
Writeback:           0 kB
Mapped:          14884 kB
Slab:            66232 kB
Committed_AS:  2478596 kB
PageTables:       1996 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61556 MiB
End job on node82 at 2009-03-31 22:47:44