Trace number 1579969

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.1 1200.51

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UTI-15-5p0.cnf
MD5SUMb21b299f860c56270b509900cff82599
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark565.218
Satisfiable
(Un)Satisfiability was proved
Number of variables162926
Number of clauses821689
Sum of the clauses size1954581
Maximum clause length10
Minimum clause length1
Number of clauses of size 18386
Number of clauses of size 2618514
Number of clauses of size 3153189
Number of clauses of size 44620
Number of clauses of size 518480
Number of clauses of size over 518500

Solver Data

0.00/0.00	c Trying configuration 1
700.35/700.67	HOME/hydrasat-multi.sh: line 48: 10141 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.35/700.67	c Trying configuration 2

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1579969-1238913015/watcher-1579969-1238913015 -o /tmp/evaluation-result-1579969-1238913015/solver-1579969-1238913015 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1579969-1238913015.cnf 1800 1368530929 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.81 1.80 1.44 3/73 10140
/proc/meminfo: memFree=1600312/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) R 10138 10140 9953 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 238 1992294400 4194304 4889804 548682068720 18446744073709551615 234045893279 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/10140/statm: 1340 238 196 169 0 51 0
[pid=10141] ppid=10140 vsize=4664 CPUtime=0
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 179 0 0 0 0 0 0 0 18 0 1 0 1043720192 4775936 161 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 1166 161 117 317 0 846 0

[startup+0.053064 s]
/proc/loadavg: 1.81 1.80 1.44 3/73 10140
/proc/meminfo: memFree=1600312/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=7436 CPUtime=0.04
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 889 0 0 0 4 0 0 0 19 0 1 0 1043720192 7614464 871 1992294400 134512640 135813592 4294956160 18446744073709551615 134637411 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 1859 872 117 317 0 1539 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 12796

[startup+0.101067 s]
/proc/loadavg: 1.81 1.80 1.44 3/73 10140
/proc/meminfo: memFree=1600312/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=9944 CPUtime=0.09
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 1586 0 0 0 9 0 0 0 19 0 1 0 1043720192 10182656 1568 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 2486 1569 117 317 0 2166 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15304

[startup+0.301087 s]
/proc/loadavg: 1.81 1.80 1.44 3/73 10140
/proc/meminfo: memFree=1600312/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=20636 CPUtime=0.29
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 4439 0 0 0 28 1 0 0 21 0 1 0 1043720192 21131264 4421 1992294400 134512640 135813592 4294956160 18446744073709551615 134637411 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 5159 4422 117 317 0 4839 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 25996

[startup+0.701129 s]
/proc/loadavg: 1.81 1.80 1.44 3/73 10140
/proc/meminfo: memFree=1600312/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=40832 CPUtime=0.68
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 9845 0 0 0 65 3 0 0 25 0 1 0 1043720192 41811968 9827 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 10208 9828 117 317 0 9888 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 46192

[startup+1.50121 s]
/proc/loadavg: 1.81 1.80 1.44 2/75 10142
/proc/meminfo: memFree=1544104/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=74248 CPUtime=1.49
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 19010 0 0 0 141 8 0 0 25 0 1 0 1043720192 76029952 17876 1992294400 134512640 135813592 4294956160 18446744073709551615 134521196 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 18562 17876 124 317 0 18242 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 79608

[startup+3.10238 s]
/proc/loadavg: 1.81 1.80 1.44 2/75 10142
/proc/meminfo: memFree=1527976/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=91008 CPUtime=3.08
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 23599 0 0 0 299 9 0 0 25 0 1 0 1043720192 93192192 21178 1992294400 134512640 135813592 4294956160 18446744073709551615 134673547 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 22752 21178 126 317 0 22432 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 96368

[startup+6.30171 s]
/proc/loadavg: 1.83 1.80 1.44 2/75 10142
/proc/meminfo: memFree=1486448/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=121504 CPUtime=6.28
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 33432 0 0 0 614 14 0 0 25 0 1 0 1043720192 124420096 28540 1992294400 134512640 135813592 4294956160 18446744073709551615 134662226 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 30376 28540 150 317 0 30056 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 126864

[startup+12.7014 s]
/proc/loadavg: 1.84 1.81 1.44 2/75 10142
/proc/meminfo: memFree=1485360/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=122428 CPUtime=12.68
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 33663 0 0 0 1253 15 0 0 25 0 1 0 1043720192 125366272 28771 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 30607 28771 150 317 0 30287 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 127788

[startup+25.5017 s]
/proc/loadavg: 1.65 1.77 1.43 2/75 10142
/proc/meminfo: memFree=1484720/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=123220 CPUtime=25.47
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 33859 0 0 0 2532 15 0 0 25 0 1 0 1043720192 126177280 28967 1992294400 134512640 135813592 4294956160 18446744073709551615 134667888 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 30805 28967 150 317 0 30485 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 128580

[startup+51.1013 s]
/proc/loadavg: 1.43 1.70 1.42 2/75 10142
/proc/meminfo: memFree=1483056/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=124936 CPUtime=51.06
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 34285 0 0 0 5090 16 0 0 25 0 1 0 1043720192 127934464 29393 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 31234 29393 150 317 0 30914 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 130296

[startup+102.307 s]
/proc/loadavg: 1.18 1.59 1.40 2/75 10142
/proc/meminfo: memFree=1480624/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=127336 CPUtime=102.24
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 34882 0 0 0 10208 16 0 0 25 0 1 0 1043720192 130392064 29990 1992294400 134512640 135813592 4294956160 18446744073709551615 135212908 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 31834 29990 150 317 0 31514 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 132696

[startup+162.302 s]
/proc/loadavg: 1.07 1.48 1.37 2/75 10142
/proc/meminfo: memFree=1478256/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=129672 CPUtime=162.22
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 35455 0 0 0 16205 17 0 0 25 0 1 0 1043720192 132784128 30563 1992294400 134512640 135813592 4294956160 18446744073709551615 134662587 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 32418 30563 150 317 0 32098 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 135032

[startup+222.301 s]
/proc/loadavg: 1.02 1.39 1.34 2/75 10142
/proc/meminfo: memFree=1476144/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=131816 CPUtime=222.18
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 35995 0 0 0 22201 17 0 0 25 0 1 0 1043720192 134979584 31103 1992294400 134512640 135813592 4294956160 18446744073709551615 134665211 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 32954 31103 150 317 0 32634 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 137176

[startup+282.301 s]
/proc/loadavg: 1.01 1.32 1.32 2/75 10142
/proc/meminfo: memFree=1474736/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=133288 CPUtime=282.17
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 36375 0 0 0 28199 18 0 0 25 0 1 0 1043720192 136486912 31483 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 33322 31483 150 317 0 33002 0
Current children cumulated CPU time (s) 282.17
Current children cumulated vsize (KiB) 138648

[startup+342.302 s]
/proc/loadavg: 1.00 1.26 1.30 2/75 10142
/proc/meminfo: memFree=1472816/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=135048 CPUtime=342.14
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 36834 0 0 0 34196 18 0 0 25 0 1 0 1043720192 138289152 31942 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 33762 31942 150 317 0 33442 0

################
# More data... #
################

/proc/10141/statm: 35637 33771 150 317 0 35317 0
Current children cumulated CPU time (s) 582.08
Current children cumulated vsize (KiB) 147908

[startup+642.302 s]
/proc/loadavg: 1.00 1.08 1.20 2/75 10142
/proc/meminfo: memFree=1464368/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5360 CPUtime=0
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1043720192 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/10140/statm: 1340 239 197 169 0 51 0
[pid=10141] ppid=10140 vsize=143648 CPUtime=642.08
/proc/10141/stat : 10141 (hydrasat_cache4) R 10140 10140 9953 0 -1 4194304 38918 0 0 0 64187 21 0 0 25 0 1 0 1043720192 147095552 34026 1992294400 134512640 135813592 4294956160 18446744073709551615 134664934 0 0 4096 1 0 0 0 17 0 0 0
/proc/10141/statm: 35912 34026 150 317 0 35592 0
Current children cumulated CPU time (s) 642.08
Current children cumulated vsize (KiB) 149008

[startup+702.301 s]
/proc/loadavg: 1.00 1.07 1.18 2/75 10143
/proc/meminfo: memFree=1410928/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=62372 CPUtime=1.61
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 16058 0 0 0 154 7 0 0 25 0 1 0 1043790259 63868928 14892 1992294400 134512640 135995732 4294956016 18446744073709551615 134694417 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 15593 14892 151 362 0 15228 0
Current children cumulated CPU time (s) 702.02
Current children cumulated vsize (KiB) 67736

[startup+762.306 s]
/proc/loadavg: 1.97 1.34 1.27 2/75 10145
/proc/meminfo: memFree=1383536/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=85184 CPUtime=61.61
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 24654 0 0 0 6147 14 0 0 25 0 1 0 1043790259 87228416 19443 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 21296 19443 173 362 0 20931 0
Current children cumulated CPU time (s) 762.02
Current children cumulated vsize (KiB) 90548

[startup+822.302 s]
/proc/loadavg: 1.35 1.27 1.25 2/75 10145
/proc/meminfo: memFree=1381744/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=87452 CPUtime=121.58
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 25209 0 0 0 12144 14 0 0 25 0 1 0 1043790259 89550848 19998 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 21863 19998 173 362 0 21498 0
Current children cumulated CPU time (s) 821.99
Current children cumulated vsize (KiB) 92816

[startup+882.302 s]
/proc/loadavg: 1.13 1.22 1.23 2/75 10145
/proc/meminfo: memFree=1379888/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=89284 CPUtime=181.57
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 25668 0 0 0 18142 15 0 0 25 0 1 0 1043790259 91426816 20457 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 22321 20457 173 362 0 21956 0
Current children cumulated CPU time (s) 881.98
Current children cumulated vsize (KiB) 94648

[startup+942.301 s]
/proc/loadavg: 1.05 1.18 1.22 2/75 10145
/proc/meminfo: memFree=1378288/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=91016 CPUtime=241.55
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 26084 0 0 0 24140 15 0 0 25 0 1 0 1043790259 93200384 20873 1992294400 134512640 135995732 4294956016 18446744073709551615 134807843 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 22754 20873 173 362 0 22389 0
Current children cumulated CPU time (s) 941.96
Current children cumulated vsize (KiB) 96380

[startup+1002.3 s]
/proc/loadavg: 1.02 1.14 1.20 2/75 10145
/proc/meminfo: memFree=1376496/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=92748 CPUtime=301.53
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 26541 0 0 0 30138 15 0 0 25 0 1 0 1043790259 94973952 21330 1992294400 134512640 135995732 4294956016 18446744073709551615 134807904 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 23187 21330 173 362 0 22822 0
Current children cumulated CPU time (s) 1001.94
Current children cumulated vsize (KiB) 98112

[startup+1062.3 s]
/proc/loadavg: 1.00 1.11 1.18 2/75 10145
/proc/meminfo: memFree=1374640/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=94860 CPUtime=361.52
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 26993 0 0 0 36136 16 0 0 25 0 1 0 1043790259 97136640 21782 1992294400 134512640 135995732 4294956016 18446744073709551615 134841888 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 23715 21782 173 362 0 23350 0
Current children cumulated CPU time (s) 1061.93
Current children cumulated vsize (KiB) 100224

[startup+1122.3 s]
/proc/loadavg: 1.00 1.09 1.17 2/75 10145
/proc/meminfo: memFree=1373360/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=96072 CPUtime=421.5
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 27320 0 0 0 42134 16 0 0 25 0 1 0 1043790259 98377728 22109 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 24018 22109 173 362 0 23653 0
Current children cumulated CPU time (s) 1121.91
Current children cumulated vsize (KiB) 101436

[startup+1182.3 s]
/proc/loadavg: 1.00 1.07 1.16 2/75 10145
/proc/meminfo: memFree=1372208/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=97280 CPUtime=481.49
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 27626 0 0 0 48132 17 0 0 25 0 1 0 1043790259 99614720 22415 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 24320 22415 173 362 0 23955 0
Current children cumulated CPU time (s) 1181.9
Current children cumulated vsize (KiB) 102644



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.07 1.15 2/75 10145
/proc/meminfo: memFree=1371248/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=98208 CPUtime=499.69
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 27850 0 0 0 49952 17 0 0 25 0 1 0 1043790259 100564992 22639 1992294400 134512640 135995732 4294956016 18446744073709551615 134638011 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 24552 22639 173 362 0 24187 0
Current children cumulated CPU time (s) 1200.1
Current children cumulated vsize (KiB) 103572

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.07 1.15 2/75 10145
/proc/meminfo: memFree=1371248/2055920 swapFree=4172852/4192956
[pid=10140] ppid=10138 vsize=5364 CPUtime=700.41
/proc/10140/stat : 10140 (hydrasat-multi.) S 10138 10140 9953 0 -1 4194304 321 40432 0 0 0 0 69968 73 16 0 1 0 1043720192 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 234045891396 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/10140/statm: 1341 245 202 169 0 52 0
[pid=10143] ppid=10140 vsize=98208 CPUtime=499.69
/proc/10143/stat : 10143 (hydrasat_cachew) R 10140 10140 9953 0 -1 4194304 27850 0 0 0 49952 17 0 0 25 0 1 0 1043790259 100564992 22639 1992294400 134512640 135995732 4294956016 18446744073709551615 134638011 0 0 4096 1 0 0 0 17 0 0 0
/proc/10143/statm: 24552 22639 173 362 0 24187 0
Current children cumulated CPU time (s) 1200.1
Current children cumulated vsize (KiB) 103572

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10140 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=683631
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=741887
# CPU time returned by wait4() is 700.425
# while last known CPU time is 1200.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.51
CPU time (s): 1200.1
CPU user time (s): 1199.2
CPU system time (s): 0.9
CPU usage (%): 99.9656
Max. virtual memory (cumulated for all children) (KiB): 150240

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.684
system time used= 0.741887
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 40753
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1944

runsolver used 1.08983 second user time and 3.2975 second system time

The end

Launcher Data

Begin job on node79 at 2009-04-05 08:30:16
IDJOB=1579969
IDBENCH=71008
IDSOLVER=518
FILE ID=node79/1579969-1238913015
PBS_JOBID= 9101363
Free space on /tmp= 66528 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UTI-15-5p0.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1579969-1238913015/watcher-1579969-1238913015 -o /tmp/evaluation-result-1579969-1238913015/solver-1579969-1238913015 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1579969-1238913015.cnf 1800 1368530929

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= b21b299f860c56270b509900cff82599
RANDOM SEED=1368530929

node79.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1600792 kB
Buffers:         46240 kB
Cached:         333180 kB
SwapCached:      11580 kB
Active:         122332 kB
Inactive:       270240 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1600792 kB
SwapTotal:     4192956 kB
SwapFree:      4172852 kB
Dirty:           18960 kB
Writeback:           0 kB
Mapped:          18992 kB
Slab:            47588 kB
Committed_AS:  3177528 kB
PageTables:       2004 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66392 MiB
End job on node79 at 2009-04-05 08:50:19