Trace number 1530537

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.06 1200.61

General information on the benchmark

NameRANDOM/MEDIUM/3SAT/UNKNOWN/380/
unif-k3-r4.25-v380-c1615-S1580204273-012.cnf
MD5SUMa8c5a2cea66d67c637fb35d0276c87d0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark78.2881
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses1615
Sum of the clauses size4845
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31615
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Trying configuration 1
700.08/700.45	HOME/hydrasat-multi.sh: line 48:  8979 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.08/700.45	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1530537-1238562871/watcher-1530537-1238562871 -o /tmp/evaluation-result-1530537-1238562871/solver-1530537-1238562871 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1530537-1238562871.cnf 1800 952487630 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 1.14 3/64 8978
/proc/meminfo: memFree=1523200/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) R 8976 8978 8941 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 238 1992294400 4194304 4889804 548682068736 18446744073709551615 235371293343 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/8978/statm: 1340 238 196 169 0 51 0
[pid=8979] ppid=8978 vsize=1452 CPUtime=0
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 167 0 0 0 0 0 0 0 18 0 1 0 1128949168 1486848 149 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 363 150 116 317 0 43 0

[startup+0.100863 s]
/proc/loadavg: 0.92 0.98 1.14 3/64 8978
/proc/meminfo: memFree=1523200/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=1848 CPUtime=0.09
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 278 0 0 0 9 0 0 0 19 0 1 0 1128949168 1892352 259 1992294400 134512640 135813592 4294956176 18446744073709551615 134667486 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 462 259 150 317 0 142 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7208

[startup+0.202872 s]
/proc/loadavg: 0.92 0.98 1.14 3/64 8978
/proc/meminfo: memFree=1523200/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=1848 CPUtime=0.19
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 301 0 0 0 19 0 0 0 20 0 1 0 1128949168 1892352 282 1992294400 134512640 135813592 4294956176 18446744073709551615 134665972 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 462 282 150 317 0 142 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 7208

[startup+0.302881 s]
/proc/loadavg: 0.92 0.98 1.14 3/64 8978
/proc/meminfo: memFree=1523200/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=1976 CPUtime=0.29
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 318 0 0 0 29 0 0 0 21 0 1 0 1128949168 2023424 299 1992294400 134512640 135813592 4294956176 18446744073709551615 134662395 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 494 299 150 317 0 174 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7336

[startup+0.701916 s]
/proc/loadavg: 0.92 0.98 1.14 3/64 8978
/proc/meminfo: memFree=1523200/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=2232 CPUtime=0.69
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 374 0 0 0 69 0 0 0 25 0 1 0 1128949168 2285568 355 1992294400 134512640 135813592 4294956176 18446744073709551615 134608997 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 558 355 150 317 0 238 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 7592

[startup+1.50299 s]
/proc/loadavg: 0.92 0.98 1.14 2/66 8980
/proc/meminfo: memFree=1521776/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=2768 CPUtime=1.49
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 521 0 0 0 149 0 0 0 25 0 1 0 1128949168 2834432 502 1992294400 134512640 135813592 4294956176 18446744073709551615 134665049 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 692 502 150 317 0 372 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 8128

[startup+3.10113 s]
/proc/loadavg: 0.92 0.98 1.14 2/66 8980
/proc/meminfo: memFree=1520560/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=4108 CPUtime=3.09
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 825 0 0 0 309 0 0 0 25 0 1 0 1128949168 4206592 806 1992294400 134512640 135813592 4294956176 18446744073709551615 134665347 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 1027 806 150 317 0 707 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 9468

[startup+6.30142 s]
/proc/loadavg: 0.93 0.98 1.14 2/66 8980
/proc/meminfo: memFree=1518904/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=5196 CPUtime=6.29
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 1106 0 0 0 629 0 0 0 25 0 1 0 1128949168 5320704 1087 1992294400 134512640 135813592 4294956176 18446744073709551615 134665688 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 1299 1087 150 317 0 979 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 10556

[startup+12.702 s]
/proc/loadavg: 0.93 0.98 1.14 2/66 8980
/proc/meminfo: memFree=1518272/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=5976 CPUtime=12.68
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 1281 0 0 0 1268 0 0 0 25 0 1 0 1128949168 6119424 1262 1992294400 134512640 135813592 4294956176 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 1494 1262 150 317 0 1174 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 11336

[startup+25.5011 s]
/proc/loadavg: 0.95 0.98 1.14 2/66 8980
/proc/meminfo: memFree=1515136/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=9428 CPUtime=25.48
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 2084 0 0 0 2546 2 0 0 25 0 1 0 1128949168 9654272 2065 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 2357 2065 150 317 0 2037 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 14788

[startup+51.1014 s]
/proc/loadavg: 0.96 0.98 1.13 2/66 8980
/proc/meminfo: memFree=1510656/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=14600 CPUtime=51.06
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 3348 0 0 0 5103 3 0 0 25 0 1 0 1128949168 14950400 3214 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 3650 3214 150 317 0 3330 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 19960

[startup+102.301 s]
/proc/loadavg: 0.98 0.98 1.12 2/66 8980
/proc/meminfo: memFree=1503552/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=22416 CPUtime=102.25
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 5277 0 0 0 10219 6 0 0 25 0 1 0 1128949168 22953984 4926 1992294400 134512640 135813592 4294956176 18446744073709551615 134665929 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 5604 4926 150 317 0 5284 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 27776

[startup+162.301 s]
/proc/loadavg: 0.99 0.98 1.11 2/66 8980
/proc/meminfo: memFree=1497472/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=28716 CPUtime=162.22
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 6794 0 0 0 16216 6 0 0 25 0 1 0 1128949168 29405184 6443 1992294400 134512640 135813592 4294956176 18446744073709551615 134664943 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 7179 6443 150 317 0 6859 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 34076

[startup+222.307 s]
/proc/loadavg: 0.99 0.98 1.10 2/66 8980
/proc/meminfo: memFree=1490880/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=36672 CPUtime=222.2
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 8580 0 0 0 22211 9 0 0 25 0 1 0 1128949168 37552128 8100 1992294400 134512640 135813592 4294956176 18446744073709551615 134665279 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 9168 8100 150 317 0 8848 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 42032

[startup+282.301 s]
/proc/loadavg: 0.99 0.98 1.09 2/66 8980
/proc/meminfo: memFree=1486464/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=41120 CPUtime=282.16
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 9814 0 0 0 28207 9 0 0 25 0 1 0 1128949168 42106880 9203 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 10280 9203 150 317 0 9960 0
Current children cumulated CPU time (s) 282.16
Current children cumulated vsize (KiB) 46480

[startup+342.302 s]
/proc/loadavg: 0.99 0.98 1.08 2/66 8980
/proc/meminfo: memFree=1481600/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=47448 CPUtime=342.14
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 11370 0 0 0 34204 10 0 0 25 0 1 0 1128949168 48586752 10386 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/8979/statm: 11862 10386 150 317 0 11542 0

################
# More data... #
################

/proc/8979/statm: 17091 14924 150 317 0 16771 0
Current children cumulated CPU time (s) 582.04
Current children cumulated vsize (KiB) 73724

[startup+642.303 s]
/proc/loadavg: 0.99 0.98 1.05 2/66 8980
/proc/meminfo: memFree=1460864/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5360 CPUtime=0
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1128949168 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/8978/statm: 1340 239 197 169 0 51 0
[pid=8979] ppid=8978 vsize=70924 CPUtime=642
/proc/8979/stat : 8979 (hydrasat_cache4) R 8978 8978 8941 0 -1 4194304 17552 0 0 0 64186 14 0 0 25 0 1 0 1128949168 72626176 15610 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/8979/statm: 17731 15610 150 317 0 17411 0
Current children cumulated CPU time (s) 642
Current children cumulated vsize (KiB) 76284

[startup+702.302 s]
/proc/loadavg: 0.99 0.98 1.05 2/66 8981
/proc/meminfo: memFree=1456064/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=2796 CPUtime=1.84
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 513 0 0 0 184 0 0 0 25 0 1 0 1129019213 2863104 496 1992294400 134512640 135995732 4294956032 18446744073709551615 135369318 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 699 496 172 362 0 334 0
Current children cumulated CPU time (s) 701.97
Current children cumulated vsize (KiB) 8160

[startup+762.302 s]
/proc/loadavg: 0.99 0.98 1.04 2/66 8981
/proc/meminfo: memFree=1443520/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=17244 CPUtime=61.8
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 3945 0 0 0 6178 2 0 0 25 0 1 0 1129019213 17657856 3830 1992294400 134512640 135995732 4294956032 18446744073709551615 134808105 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 4311 3830 172 362 0 3946 0
Current children cumulated CPU time (s) 761.93
Current children cumulated vsize (KiB) 22608

[startup+822.303 s]
/proc/loadavg: 0.99 0.98 1.04 2/66 8981
/proc/meminfo: memFree=1437696/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=23080 CPUtime=121.77
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 5420 0 0 0 12174 3 0 0 25 0 1 0 1129019213 23633920 5305 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 5770 5305 172 362 0 5405 0
Current children cumulated CPU time (s) 821.9
Current children cumulated vsize (KiB) 28444

[startup+882.306 s]
/proc/loadavg: 0.99 0.98 1.03 2/66 8981
/proc/meminfo: memFree=1432320/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=29052 CPUtime=181.76
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 6883 0 0 0 18171 5 0 0 25 0 1 0 1129019213 29749248 6639 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 7263 6639 172 362 0 6898 0
Current children cumulated CPU time (s) 881.89
Current children cumulated vsize (KiB) 34416

[startup+942.303 s]
/proc/loadavg: 0.99 0.98 1.03 2/66 8981
/proc/meminfo: memFree=1429184/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=32484 CPUtime=241.72
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 7703 0 0 0 24167 5 0 0 25 0 1 0 1129019213 33263616 7459 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 8121 7459 172 362 0 7756 0
Current children cumulated CPU time (s) 941.85
Current children cumulated vsize (KiB) 37848

[startup+1002.3 s]
/proc/loadavg: 0.99 0.98 1.02 2/66 8981
/proc/meminfo: memFree=1426176/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=35808 CPUtime=301.7
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 8458 0 0 0 30164 6 0 0 25 0 1 0 1129019213 36667392 8214 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 8952 8214 172 362 0 8587 0
Current children cumulated CPU time (s) 1001.83
Current children cumulated vsize (KiB) 41172

[startup+1062.3 s]
/proc/loadavg: 0.99 0.98 1.01 2/66 8981
/proc/meminfo: memFree=1422848/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=39232 CPUtime=361.68
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 9283 0 0 0 36161 7 0 0 25 0 1 0 1129019213 40173568 9039 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 9808 9039 172 362 0 9443 0
Current children cumulated CPU time (s) 1061.81
Current children cumulated vsize (KiB) 44596

[startup+1122.3 s]
/proc/loadavg: 0.99 0.98 1.01 2/66 8981
/proc/meminfo: memFree=1419968/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=42524 CPUtime=421.66
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 9993 0 0 0 42158 8 0 0 25 0 1 0 1129019213 43544576 9749 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 10631 9749 172 362 0 10266 0
Current children cumulated CPU time (s) 1121.79
Current children cumulated vsize (KiB) 47888

[startup+1182.3 s]
/proc/loadavg: 0.99 0.98 1.00 2/66 8981
/proc/meminfo: memFree=1416256/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=47356 CPUtime=481.63
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 11251 0 0 0 48154 9 0 0 25 0 1 0 1129019213 48492544 10692 1992294400 134512640 135995732 4294956032 18446744073709551615 134807721 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 11839 10692 172 362 0 11474 0
Current children cumulated CPU time (s) 1181.76
Current children cumulated vsize (KiB) 52720



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.6 s]
/proc/loadavg: 0.99 0.98 1.00 2/66 8981
/proc/meminfo: memFree=1415360/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=48064 CPUtime=499.93
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 11451 0 0 0 49984 9 0 0 25 0 1 0 1129019213 49217536 10892 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 12016 10892 172 362 0 11651 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 53428

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.6 s]
/proc/loadavg: 0.99 0.98 1.00 2/66 8981
/proc/meminfo: memFree=1415360/2055920 swapFree=4176708/4192956
[pid=8978] ppid=8976 vsize=5364 CPUtime=700.13
/proc/8978/stat : 8978 (hydrasat-multi.) S 8976 8978 8941 0 -1 4194304 322 20081 0 0 0 0 69973 40 16 0 1 0 1128949168 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 235371291460 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/8978/statm: 1341 245 202 169 0 52 0
[pid=8981] ppid=8978 vsize=48064 CPUtime=499.93
/proc/8981/stat : 8981 (hydrasat_cachew) R 8978 8978 8941 0 -1 4194304 11451 0 0 0 49984 9 0 0 25 0 1 0 1129019213 49217536 10892 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/8981/statm: 12016 10892 172 362 0 11651 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 53428

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8978 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=741623
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=405938
# CPU time returned by wait4() is 700.148
# while last known CPU time is 1200.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.61
CPU time (s): 1200.06
CPU user time (s): 1199.57
CPU system time (s): 0.49
CPU usage (%): 99.954
Max. virtual memory (cumulated for all children) (KiB): 78588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.742
system time used= 0.405938
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20403
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 2781

runsolver used 1.04784 second user time and 3.32749 second system time

The end

Launcher Data 

Begin job on node51 at 2009-04-01 07:14:31
IDJOB=1530537
IDBENCH=70630
IDSOLVER=518
FILE ID=node51/1530537-1238562871
PBS_JOBID= 9062174
Free space on /tmp= 65256 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/RANDOM/MEDIUM/3SAT/UNKNOWN/380/unif-k3-r4.25-v380-c1615-S1580204273-012.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1530537-1238562871/watcher-1530537-1238562871 -o /tmp/evaluation-result-1530537-1238562871/solver-1530537-1238562871 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1530537-1238562871.cnf 1800 952487630

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= a8c5a2cea66d67c637fb35d0276c87d0
RANDOM SEED=952487630

node51.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1523696 kB
Buffers:         90248 kB
Cached:         344352 kB
SwapCached:      10052 kB
Active:         218408 kB
Inactive:       227612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1523696 kB
SwapTotal:     4192956 kB
SwapFree:      4176708 kB
Dirty:            4136 kB
Writeback:           0 kB
Mapped:          17064 kB
Slab:            72292 kB
Committed_AS:  3105268 kB
PageTables:       1400 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 65188 MiB
End job on node51 at 2009-04-01 07:34:34