Trace number 1715959

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.06 1200.41

General information on the benchmark

Nameindustrial/anbulagan/
medium-sat/partial-5-15-s.cnf
MD5SUMaeddf6934ba21adf4a25a76bc314ef43
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark158.308
Satisfiable
(Un)Satisfiability was proved
Number of variables218494
Number of clauses1013700
Sum of the clauses size2333596
Maximum clause length10
Minimum clause length1
Number of clauses of size 116379
Number of clauses of size 2796846
Number of clauses of size 3159775
Number of clauses of size 44520
Number of clauses of size 518080
Number of clauses of size over 518100

Solver Data 

0.00/0.00	c Trying configuration 1
700.51/700.73	HOME/hydrasat-multi.sh: line 48: 18757 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.51/700.73	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1715959-1240609361/watcher-1715959-1240609361 -o /tmp/evaluation-result-1715959-1240609361/solver-1715959-1240609361 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1715959-1240609361.cnf 1800 379587920 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.95 0.90 3/64 18756
/proc/meminfo: memFree=1547896/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) R 18754 18756 18627 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 238 1992294400 4194304 4889804 548682068736 18446744073709551615 255236565663 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/18756/statm: 1340 238 196 169 0 51 0
[pid=18757] ppid=18756 vsize=5412 CPUtime=0
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 162 0 0 0 0 0 0 0 18 0 1 0 88969559 5541888 144 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 1353 144 117 317 0 1033 0

[startup+0.0662699 s]
/proc/loadavg: 0.91 0.95 0.90 3/64 18756
/proc/meminfo: memFree=1547896/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=8712 CPUtime=0.05
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 1051 0 0 0 5 0 0 0 19 0 1 0 88969559 8921088 1033 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 2178 1034 117 317 0 1858 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 14072

[startup+0.102276 s]
/proc/loadavg: 0.91 0.95 0.90 3/64 18756
/proc/meminfo: memFree=1547896/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=10560 CPUtime=0.09
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 1556 0 0 0 9 0 0 0 19 0 1 0 88969559 10813440 1538 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 2640 1539 117 317 0 2320 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15920

[startup+0.301295 s]
/proc/loadavg: 0.91 0.95 0.90 3/64 18756
/proc/meminfo: memFree=1547896/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=21120 CPUtime=0.29
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 4373 0 0 0 28 1 0 0 21 0 1 0 88969559 21626880 4355 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 5280 4355 117 317 0 4960 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26480

[startup+0.701339 s]
/proc/loadavg: 0.91 0.95 0.90 3/64 18756
/proc/meminfo: memFree=1547896/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=39864 CPUtime=0.68
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 9384 0 0 0 64 4 0 0 25 0 1 0 88969559 40820736 9366 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 9966 9366 117 317 0 9646 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 45224

[startup+1.50242 s]
/proc/loadavg: 0.92 0.95 0.90 2/66 18758
/proc/meminfo: memFree=1495976/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=76472 CPUtime=1.49
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 18928 0 0 0 141 8 0 0 25 0 1 0 88969559 78307328 18910 1992294400 134512640 135813592 4294956176 18446744073709551615 135205843 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 19118 18910 122 317 0 18798 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 81832

[startup+3.10159 s]
/proc/loadavg: 0.92 0.95 0.90 2/66 18758
/proc/meminfo: memFree=1459368/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=107148 CPUtime=3.09
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 27797 0 0 0 297 12 0 0 25 0 1 0 88969559 109719552 24810 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 26787 24810 126 317 0 26467 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 112508

[startup+6.30194 s]
/proc/loadavg: 0.92 0.95 0.90 2/66 18758
/proc/meminfo: memFree=1415016/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=148008 CPUtime=6.29
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 41433 0 0 0 612 17 0 0 25 0 1 0 88969559 151560192 35004 1992294400 134512640 135813592 4294956176 18446744073709551615 134664993 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 37002 35004 149 317 0 36682 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 153368

[startup+12.7016 s]
/proc/loadavg: 0.93 0.96 0.91 2/66 18758
/proc/meminfo: memFree=1403632/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=152100 CPUtime=12.68
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 42468 0 0 0 1251 17 0 0 25 0 1 0 88969559 155750400 36039 1992294400 134512640 135813592 4294956176 18446744073709551615 134664998 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 38025 36039 149 317 0 37705 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 157460

[startup+25.502 s]
/proc/loadavg: 0.94 0.96 0.91 2/66 18758
/proc/meminfo: memFree=1402352/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=153684 CPUtime=25.48
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 42867 0 0 0 2530 18 0 0 25 0 1 0 88969559 157372416 36438 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 38421 36438 149 317 0 38101 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 159044

[startup+51.1017 s]
/proc/loadavg: 0.96 0.96 0.91 2/66 18758
/proc/meminfo: memFree=1401008/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=155004 CPUtime=51.07
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 43198 0 0 0 5089 18 0 0 25 0 1 0 88969559 158724096 36769 1992294400 134512640 135813592 4294956176 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 38751 36769 149 317 0 38431 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 160364

[startup+102.305 s]
/proc/loadavg: 0.98 0.96 0.91 2/66 18758
/proc/meminfo: memFree=1399152/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=156996 CPUtime=102.27
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 43674 0 0 0 10208 19 0 0 25 0 1 0 88969559 160763904 37245 1992294400 134512640 135813592 4294956176 18446744073709551615 134664877 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 39249 37245 149 317 0 38929 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 162356

[startup+162.302 s]
/proc/loadavg: 0.99 0.97 0.91 2/66 18758
/proc/meminfo: memFree=1395440/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=160592 CPUtime=162.25
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 44590 0 0 0 16205 20 0 0 25 0 1 0 88969559 164446208 38161 1992294400 134512640 135813592 4294956176 18446744073709551615 135213000 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 40148 38161 149 317 0 39828 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 165952

[startup+222.301 s]
/proc/loadavg: 0.99 0.97 0.91 2/66 18758
/proc/meminfo: memFree=1395312/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=160724 CPUtime=222.23
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 44616 0 0 0 22203 20 0 0 25 0 1 0 88969559 164581376 38187 1992294400 134512640 135813592 4294956176 18446744073709551615 134661796 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 40181 38187 149 317 0 39861 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 166084

[startup+282.302 s]
/proc/loadavg: 0.99 0.97 0.91 2/66 18758
/proc/meminfo: memFree=1391408/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=164604 CPUtime=282.22
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 45592 0 0 0 28201 21 0 0 25 0 1 0 88969559 168554496 39163 1992294400 134512640 135813592 4294956176 18446744073709551615 134664877 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 41151 39163 149 317 0 40831 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 169964

[startup+342.302 s]
/proc/loadavg: 0.99 0.97 0.91 2/66 18758
/proc/meminfo: memFree=1391408/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=164604 CPUtime=342.2
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 45592 0 0 0 34199 21 0 0 25 0 1 0 88969559 168554496 39163 1992294400 134512640 135813592 4294956176 18446744073709551615 134664877 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 41151 39163 149 317 0 40831 0

################
# More data... #
################

/proc/18757/statm: 42554 40557 149 317 0 42234 0
Current children cumulated CPU time (s) 522.15
Current children cumulated vsize (KiB) 175576

[startup+582.302 s]
/proc/loadavg: 0.99 0.97 0.91 2/66 18758
/proc/meminfo: memFree=1385712/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=170216 CPUtime=582.14
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 46986 0 0 0 58191 23 0 0 25 0 1 0 88969559 174301184 40557 1992294400 134512640 135813592 4294956176 18446744073709551615 134661791 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 42554 40557 149 317 0 42234 0
Current children cumulated CPU time (s) 582.14
Current children cumulated vsize (KiB) 175576

[startup+642.301 s]
/proc/loadavg: 0.99 0.97 0.91 2/66 18758
/proc/meminfo: memFree=1383920/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5360 CPUtime=0
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 88969559 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18756/statm: 1340 239 197 169 0 51 0
[pid=18757] ppid=18756 vsize=172100 CPUtime=642.12
/proc/18757/stat : 18757 (hydrasat_cache4) R 18756 18756 18627 0 -1 4194304 47430 0 0 0 64189 23 0 0 25 0 1 0 88969559 176230400 41001 1992294400 134512640 135813592 4294956176 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 1 0 0
/proc/18757/statm: 43025 41001 149 317 0 42705 0
Current children cumulated CPU time (s) 642.12
Current children cumulated vsize (KiB) 177460

[startup+702.302 s]
/proc/loadavg: 0.99 0.97 0.91 2/66 18759
/proc/meminfo: memFree=1334128/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=77008 CPUtime=1.55
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 19795 0 0 0 147 8 0 0 25 0 1 0 89039633 78856192 18284 1992294400 134512640 135995732 4294956032 18446744073709551615 134689603 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 19252 18284 150 362 0 18887 0
Current children cumulated CPU time (s) 702.09
Current children cumulated vsize (KiB) 82372

[startup+762.306 s]
/proc/loadavg: 1.03 0.99 0.91 2/66 18759
/proc/meminfo: memFree=1282672/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=105736 CPUtime=61.54
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 30835 0 0 0 6141 13 0 0 25 0 1 0 89039633 108273664 24408 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 26434 24408 172 362 0 26069 0
Current children cumulated CPU time (s) 762.08
Current children cumulated vsize (KiB) 111100

[startup+822.301 s]
/proc/loadavg: 1.01 0.99 0.91 2/66 18759
/proc/meminfo: memFree=1280496/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=107884 CPUtime=121.53
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 31393 0 0 0 12139 14 0 0 25 0 1 0 89039633 110473216 24966 1992294400 134512640 135995732 4294956032 18446744073709551615 134841833 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 26971 24966 172 362 0 26606 0
Current children cumulated CPU time (s) 822.07
Current children cumulated vsize (KiB) 113248

[startup+882.302 s]
/proc/loadavg: 1.00 0.99 0.91 2/66 18759
/proc/meminfo: memFree=1280368/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=108016 CPUtime=181.51
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 31413 0 0 0 18137 14 0 0 25 0 1 0 89039633 110608384 24986 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 27004 24986 172 362 0 26639 0
Current children cumulated CPU time (s) 882.05
Current children cumulated vsize (KiB) 113380

[startup+942.302 s]
/proc/loadavg: 1.00 0.99 0.91 2/66 18759
/proc/meminfo: memFree=1276848/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=111516 CPUtime=241.5
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 32294 0 0 0 24135 15 0 0 25 0 1 0 89039633 114192384 25867 1992294400 134512640 135995732 4294956032 18446744073709551615 135385625 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 27879 25867 172 362 0 27514 0
Current children cumulated CPU time (s) 942.04
Current children cumulated vsize (KiB) 116880

[startup+1002.3 s]
/proc/loadavg: 1.00 0.99 0.91 2/66 18759
/proc/meminfo: memFree=1276912/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=111516 CPUtime=301.48
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 32294 0 0 0 30133 15 0 0 25 0 1 0 89039633 114192384 25867 1992294400 134512640 135995732 4294956032 18446744073709551615 134807654 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 27879 25867 172 362 0 27514 0
Current children cumulated CPU time (s) 1002.02
Current children cumulated vsize (KiB) 116880

[startup+1062.3 s]
/proc/loadavg: 1.00 0.99 0.91 2/66 18759
/proc/meminfo: memFree=1276336/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=112048 CPUtime=361.46
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 32430 0 0 0 36131 15 0 0 25 0 1 0 89039633 114737152 26003 1992294400 134512640 135995732 4294956032 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 28012 26003 172 362 0 27647 0
Current children cumulated CPU time (s) 1062
Current children cumulated vsize (KiB) 117412

[startup+1122.3 s]
/proc/loadavg: 1.00 0.99 0.91 2/66 18765
/proc/meminfo: memFree=1276264/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=112048 CPUtime=421.44
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 32430 0 0 0 42129 15 0 0 25 0 1 0 89039633 114737152 26003 1992294400 134512640 135995732 4294956032 18446744073709551615 134807654 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 28012 26003 172 362 0 27647 0
Current children cumulated CPU time (s) 1121.98
Current children cumulated vsize (KiB) 117412

[startup+1182.3 s]
/proc/loadavg: 1.00 0.99 0.91 2/66 18765
/proc/meminfo: memFree=1275304/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=113128 CPUtime=481.42
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 32699 0 0 0 48127 15 0 0 25 0 1 0 89039633 115843072 26272 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 28282 26272 172 362 0 27917 0
Current children cumulated CPU time (s) 1181.96
Current children cumulated vsize (KiB) 118492



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.4 s]
/proc/loadavg: 1.00 0.99 0.91 2/66 18765
/proc/meminfo: memFree=1275176/2055920 swapFree=4181324/4192956
[pid=18756] ppid=18754 vsize=5364 CPUtime=700.54
/proc/18756/stat : 18756 (hydrasat-multi.) S 18754 18756 18627 0 -1 4194304 322 48317 0 0 0 0 69965 89 16 0 1 0 88969559 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18756/statm: 1341 245 202 169 0 52 0
[pid=18759] ppid=18756 vsize=113128 CPUtime=499.52
/proc/18759/stat : 18759 (hydrasat_cachew) R 18756 18756 18627 0 -1 4194304 32699 0 0 0 49937 15 0 0 25 0 1 0 89039633 115843072 26272 1992294400 134512640 135995732 4294956032 18446744073709551615 134682235 0 0 4096 1 0 0 0 17 1 0 0
/proc/18759/statm: 28282 26272 172 362 0 27917 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 118492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18756 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=655636
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=897863
# CPU time returned by wait4() is 700.554
# while last known CPU time is 1200.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.41
CPU time (s): 1200.06
CPU user time (s): 1199.02
CPU system time (s): 1.04
CPU usage (%): 99.9707
Max. virtual memory (cumulated for all children) (KiB): 177684

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.656
system time used= 0.897863
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 48639
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1396

runsolver used 1.41878 second user time and 2.95055 second system time

The end

Launcher Data 

Begin job on node19 at 2009-04-24 23:42:43
IDJOB=1715959
IDBENCH=20362
IDSOLVER=518
FILE ID=node19/1715959-1240609361
PBS_JOBID= 9186295
Free space on /tmp= 66224 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT07/industrial/anbulagan/medium-sat/partial-5-15-s.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1715959-1240609361/watcher-1715959-1240609361 -o /tmp/evaluation-result-1715959-1240609361/solver-1715959-1240609361 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1715959-1240609361.cnf 1800 379587920

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= aeddf6934ba21adf4a25a76bc314ef43
RANDOM SEED=379587920

node19.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1548376 kB
Buffers:         66588 kB
Cached:         364872 kB
SwapCached:       6324 kB
Active:         142340 kB
Inactive:       297884 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1548376 kB
SwapTotal:     4192956 kB
SwapFree:      4181324 kB
Dirty:           22324 kB
Writeback:           0 kB
Mapped:          13408 kB
Slab:            53304 kB
Committed_AS:   287964 kB
PageTables:       1452 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66060 MiB
End job on node19 at 2009-04-25 00:02:45