Trace number 1562525

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.05 1200.51

General information on the benchmark

NameCRAFTED/edgematching/
fbcolors/em_12_2_4_fbc.cnf
MD5SUM9fee570f53de23cb47dfa378d421371e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables12584
Number of clauses202912
Sum of the clauses size618320
Maximum clause length100
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 264604
Number of clauses of size 3103200
Number of clauses of size 417828
Number of clauses of size 517000
Number of clauses of size over 5280

Solver Data 

0.00/0.00	c Trying configuration 1
700.63/700.95	HOME/hydrasat-multi.sh: line 48: 26944 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.63/700.95	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1562525-1238776255/watcher-1562525-1238776255 -o /tmp/evaluation-result-1562525-1238776255/solver-1562525-1238776255 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1562525-1238776255.cnf 1800 1573135055 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 26943
/proc/meminfo: memFree=1901344/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) R 26941 26943 26430 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 238 1992294400 4194304 4889804 548682068720 18446744073709551615 248761608863 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/26943/statm: 1340 238 196 169 0 51 0
[pid=26944] ppid=26943 vsize=2248 CPUtime=0
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 163 0 0 0 0 0 0 0 18 0 1 0 1150287406 2301952 145 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 562 145 117 317 0 242 0

[startup+0.0253161 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 26943
/proc/meminfo: memFree=1901344/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=3168 CPUtime=0.01
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 397 0 0 0 1 0 0 0 18 0 1 0 1150287406 3244032 379 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 792 380 117 317 0 472 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8528

[startup+0.102328 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 26943
/proc/meminfo: memFree=1901344/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=6336 CPUtime=0.08
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 1253 0 0 0 8 0 0 0 19 0 1 0 1150287406 6488064 1235 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 1584 1236 117 317 0 1264 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 11696

[startup+0.302362 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 26943
/proc/meminfo: memFree=1901344/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=16136 CPUtime=0.29
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 3845 0 0 0 27 2 0 0 21 0 1 0 1150287406 16523264 3827 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 4034 3828 122 317 0 3714 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 21496

[startup+0.70143 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 26943
/proc/meminfo: memFree=1901344/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=19920 CPUtime=0.68
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 4960 0 0 0 66 2 0 0 25 0 1 0 1150287406 20398080 4392 1992294400 134512640 135813592 4294956160 18446744073709551615 134520752 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 4980 4392 126 317 0 4660 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 25280

[startup+1.50157 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1883728/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=29344 CPUtime=1.48
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 7577 0 0 0 145 3 0 0 25 0 1 0 1150287406 30048256 6744 1992294400 134512640 135813592 4294956160 18446744073709551615 134665442 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 7336 6744 150 317 0 7016 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 34704

[startup+3.10184 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1873744/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=30804 CPUtime=3.09
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 7962 0 0 0 305 4 0 0 25 0 1 0 1150287406 31543296 7129 1992294400 134512640 135813592 4294956160 18446744073709551615 134592012 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 7701 7129 150 317 0 7381 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 36164

[startup+6.30139 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1871888/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=32260 CPUtime=6.29
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 8317 0 0 0 625 4 0 0 25 0 1 0 1150287406 33034240 7484 1992294400 134512640 135813592 4294956160 18446744073709551615 134592202 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 8065 7484 150 317 0 7745 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 37620

[startup+12.7015 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1869520/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=34124 CPUtime=12.68
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 8787 0 0 0 1264 4 0 0 25 0 1 0 1150287406 34942976 7954 1992294400 134512640 135813592 4294956160 18446744073709551615 134591947 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 8531 7954 150 317 0 8211 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 39484

[startup+25.5027 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1861264/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=42488 CPUtime=25.48
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 10868 0 0 0 2543 5 0 0 25 0 1 0 1150287406 43507712 10035 1992294400 134512640 135813592 4294956160 18446744073709551615 134665442 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 10622 10035 150 317 0 10302 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 47848

[startup+51.102 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1833552/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=71172 CPUtime=51.07
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 17810 0 0 0 5099 8 0 0 25 0 1 0 1150287406 72880128 16977 1992294400 134512640 135813592 4294956160 18446744073709551615 134665511 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 17793 16977 150 317 0 17473 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 76532

[startup+102.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1833488/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=71172 CPUtime=102.26
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 17821 0 0 0 10218 8 0 0 25 0 1 0 1150287406 72880128 16988 1992294400 134512640 135813592 4294956160 18446744073709551615 135202021 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 17793 16988 150 317 0 17473 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 76532

[startup+162.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1822864/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=81812 CPUtime=162.23
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 20464 0 0 0 16213 10 0 0 25 0 1 0 1150287406 83775488 19631 1992294400 134512640 135813592 4294956160 18446744073709551615 134592088 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 20453 19631 150 317 0 20133 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 87172

[startup+222.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1811408/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=93504 CPUtime=222.21
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 23310 0 0 0 22209 12 0 0 25 0 1 0 1150287406 95748096 22477 1992294400 134512640 135813592 4294956160 18446744073709551615 134665395 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 23376 22477 150 317 0 23056 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 98864

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1794128/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=111072 CPUtime=282.19
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 27622 0 0 0 28205 14 0 0 25 0 1 0 1150287406 113737728 26789 1992294400 134512640 135813592 4294956160 18446744073709551615 134662603 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 27768 26789 150 317 0 27448 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 116432

[startup+342.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26945
/proc/meminfo: memFree=1788752/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=116572 CPUtime=342.17
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 29015 0 0 0 34201 16 0 0 25 0 1 0 1150287406 119369728 28182 1992294400 134512640 135813592 4294956160 18446744073709551615 134665452 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 29143 28182 150 317 0 28823 0

################
# More data... #
################

/proc/26944/statm: 41735 40396 150 317 0 41415 0
Current children cumulated CPU time (s) 582.09
Current children cumulated vsize (KiB) 172300

[startup+642.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26947
/proc/meminfo: memFree=1727376/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5360 CPUtime=0
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1150287406 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/26943/statm: 1340 239 197 169 0 51 0
[pid=26944] ppid=26943 vsize=179228 CPUtime=642.07
/proc/26944/stat : 26944 (hydrasat_cache4) R 26943 26943 26430 0 -1 4194304 44348 0 0 0 64179 28 0 0 25 0 1 0 1150287406 183529472 43386 1992294400 134512640 135813592 4294956160 18446744073709551615 134665574 0 0 4096 1 0 0 0 17 1 0 0
/proc/26944/statm: 44807 43386 150 317 0 44487 0
Current children cumulated CPU time (s) 642.07
Current children cumulated vsize (KiB) 184588

[startup+702.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26948
/proc/meminfo: memFree=1681616/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=18940 CPUtime=1.34
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 4957 0 0 0 132 2 0 0 25 0 1 0 1150357501 19394560 4126 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 4735 4126 172 362 0 4370 0
Current children cumulated CPU time (s) 702.03
Current children cumulated vsize (KiB) 24304

[startup+762.307 s]
/proc/loadavg: 1.07 1.03 1.01 2/66 26948
/proc/meminfo: memFree=1667408/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=35580 CPUtime=61.32
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 9129 0 0 0 6127 5 0 0 25 0 1 0 1150357501 36433920 8298 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 8895 8298 172 362 0 8530 0
Current children cumulated CPU time (s) 762.01
Current children cumulated vsize (KiB) 40944

[startup+822.302 s]
/proc/loadavg: 1.02 1.02 1.00 2/66 26948
/proc/meminfo: memFree=1660048/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=43300 CPUtime=121.29
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 11042 0 0 0 12123 6 0 0 25 0 1 0 1150357501 44339200 10211 1992294400 134512640 135995732 4294956016 18446744073709551615 134847338 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 10825 10211 172 362 0 10460 0
Current children cumulated CPU time (s) 821.98
Current children cumulated vsize (KiB) 48664

[startup+882.301 s]
/proc/loadavg: 1.01 1.01 1.00 2/66 26948
/proc/meminfo: memFree=1651920/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=51640 CPUtime=181.27
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 13056 0 0 0 18120 7 0 0 25 0 1 0 1150357501 52879360 12225 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 12910 12225 172 362 0 12545 0
Current children cumulated CPU time (s) 881.96
Current children cumulated vsize (KiB) 57004

[startup+942.301 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 26948
/proc/meminfo: memFree=1633616/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=70112 CPUtime=241.25
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 17696 0 0 0 24115 10 0 0 25 0 1 0 1150357501 71794688 16865 1992294400 134512640 135995732 4294956016 18446744073709551615 134807763 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 17528 16865 172 362 0 17163 0
Current children cumulated CPU time (s) 941.94
Current children cumulated vsize (KiB) 75476

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26948
/proc/meminfo: memFree=1616912/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=86364 CPUtime=301.23
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 21770 0 0 0 30110 13 0 0 25 0 1 0 1150357501 88436736 20939 1992294400 134512640 135995732 4294956016 18446744073709551615 134807600 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 21591 20939 172 362 0 21226 0
Current children cumulated CPU time (s) 1001.92
Current children cumulated vsize (KiB) 91728

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 3/66 26948
/proc/meminfo: memFree=1616848/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=86364 CPUtime=361.2
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 21778 0 0 0 36107 13 0 0 25 0 1 0 1150357501 88436736 20947 1992294400 134512640 135995732 4294956016 18446744073709551615 134807877 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 21591 20947 172 362 0 21226 0
Current children cumulated CPU time (s) 1061.89
Current children cumulated vsize (KiB) 91728

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 26948
/proc/meminfo: memFree=1603600/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=99620 CPUtime=421.18
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 25132 0 0 0 42103 15 0 0 25 0 1 0 1150357501 102010880 24301 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 24905 24301 172 362 0 24540 0
Current children cumulated CPU time (s) 1121.87
Current children cumulated vsize (KiB) 104984

[startup+1182.3 s]
/proc/loadavg: 1.04 1.01 1.00 2/66 26948
/proc/meminfo: memFree=1580368/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=123356 CPUtime=481.17
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 31069 0 0 0 48098 19 0 0 25 0 1 0 1150357501 126316544 30109 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 30839 30109 172 362 0 30474 0
Current children cumulated CPU time (s) 1181.86
Current children cumulated vsize (KiB) 128720



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.11 1.03 1.01 2/66 26948
/proc/meminfo: memFree=1574544/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=128948 CPUtime=499.36
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 32459 0 0 0 49916 20 0 0 25 0 1 0 1150357501 132042752 31499 1992294400 134512640 135995732 4294956016 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 32237 31499 172 362 0 31872 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 134312

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.11 1.03 1.01 2/66 26948
/proc/meminfo: memFree=1574544/2055920 swapFree=4175328/4192956
[pid=26943] ppid=26941 vsize=5364 CPUtime=700.69
/proc/26943/stat : 26943 (hydrasat-multi.) S 26941 26943 26430 0 -1 4194304 321 51738 0 0 0 0 69956 113 16 0 1 0 1150287406 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 248761606980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26943/statm: 1341 245 202 169 0 52 0
[pid=26948] ppid=26943 vsize=128948 CPUtime=499.36
/proc/26948/stat : 26948 (hydrasat_cachew) R 26943 26943 26430 0 -1 4194304 32459 0 0 0 49916 20 0 0 25 0 1 0 1150357501 132042752 31499 1992294400 134512640 135995732 4294956016 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 1 0 0
/proc/26948/statm: 32237 31499 172 362 0 31872 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 134312

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26943 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=565649
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=133827
# CPU time returned by wait4() is 700.7
# while last known CPU time is 1200.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.51
CPU time (s): 1200.05
CPU user time (s): 1198.72
CPU system time (s): 1.33
CPU usage (%): 99.9615
Max. virtual memory (cumulated for all children) (KiB): 209136

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.566
system time used= 1.13383
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 52059
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1742

runsolver used 1.46578 second user time and 2.90456 second system time

The end

Launcher Data 

Begin job on node55 at 2009-04-03 18:30:55
IDJOB=1562525
IDBENCH=70936
IDSOLVER=518
FILE ID=node55/1562525-1238776255
PBS_JOBID= 9085531
Free space on /tmp= 66532 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/APPLICATIONS/edgematching/fbcolors/em_12_2_4_fbc.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1562525-1238776255/watcher-1562525-1238776255 -o /tmp/evaluation-result-1562525-1238776255/solver-1562525-1238776255 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1562525-1238776255.cnf 1800 1573135055

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 9fee570f53de23cb47dfa378d421371e
RANDOM SEED=1573135055

node55.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1901760 kB
Buffers:          6660 kB
Cached:          80996 kB
SwapCached:      11692 kB
Active:          37600 kB
Inactive:        63368 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1901760 kB
SwapTotal:     4192956 kB
SwapFree:      4175328 kB
Dirty:            8204 kB
Writeback:           0 kB
Mapped:          18968 kB
Slab:            39208 kB
Committed_AS:  2934540 kB
PageTables:       1372 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66336 MiB
End job on node55 at 2009-04-03 18:50:58