Trace number 1716843

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.06 1200.51

General information on the benchmark

Nameindustrial/fuhs/medium/
AProVE07-16.cnf
MD5SUM65057bcebbeecf6a7f3bc3fcfb2de009
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark199.757
Satisfiable
(Un)Satisfiability was proved
Number of variables52382
Number of clauses182485
Sum of the clauses size472601
Maximum clause length131
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 285834
Number of clauses of size 387884
Number of clauses of size 47609
Number of clauses of size 5700
Number of clauses of size over 5457

Solver Data 

0.00/0.00	c Trying configuration 1
700.07/700.34	HOME/hydrasat-multi.sh: line 48:  9432 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.07/700.34	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1716843-1240620996/watcher-1716843-1240620996 -o /tmp/evaluation-result-1716843-1240620996/solver-1716843-1240620996 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1716843-1240620996.cnf 1800 573926458 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 9431
/proc/meminfo: memFree=1271956/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) R 9429 9431 9364 0 -1 4194304 270 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 238 1992294400 4194304 4889804 548682068736 18446744073709551615 256364833439 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/9431/statm: 1340 238 196 169 0 51 0
[pid=9432] ppid=9431 vsize=2168 CPUtime=0
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 167 0 0 0 0 0 0 0 20 0 1 0 90128729 2220032 149 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 542 149 117 317 0 222 0

[startup+0.00975811 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 9431
/proc/meminfo: memFree=1271956/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=2432 CPUtime=0
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 231 0 0 0 0 0 0 0 20 0 1 0 90128729 2490368 213 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 608 213 117 317 0 288 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 7792

[startup+0.101767 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 9431
/proc/meminfo: memFree=1271956/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=6524 CPUtime=0.08
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 1346 0 0 0 8 0 0 0 21 0 1 0 90128729 6680576 1328 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 1664 1329 117 317 0 1344 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 11884

[startup+0.301787 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 9431
/proc/meminfo: memFree=1271956/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=16392 CPUtime=0.28
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 3895 0 0 0 27 1 0 0 23 0 1 0 90128729 16785408 3877 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 4098 3877 122 317 0 3778 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 21752

[startup+0.701829 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 9431
/proc/meminfo: memFree=1271956/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=25592 CPUtime=0.68
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 6405 0 0 0 66 2 0 0 25 0 1 0 90128729 26206208 6053 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 6398 6053 126 317 0 6078 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 30952

[startup+1.50191 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9433
/proc/meminfo: memFree=1243780/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=37724 CPUtime=1.49
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 10126 0 0 0 145 4 0 0 25 0 1 0 90128729 38629376 8922 1992294400 134512640 135813592 4294956176 18446744073709551615 134665809 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 9431 8922 149 317 0 9111 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 43084

[startup+3.10935 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9433
/proc/meminfo: memFree=1236036/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=38256 CPUtime=3.1
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 10259 0 0 0 306 4 0 0 25 0 1 0 90128729 39174144 9055 1992294400 134512640 135813592 4294956176 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 9564 9055 149 317 0 9244 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 43616

[startup+6.30141 s]
/proc/loadavg: 1.16 1.03 1.01 2/66 9433
/proc/meminfo: memFree=1235396/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=38668 CPUtime=6.28
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 10346 0 0 0 624 4 0 0 25 0 1 0 90128729 39596032 9142 1992294400 134512640 135813592 4294956176 18446744073709551615 134664971 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 9667 9142 149 317 0 9347 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 44028

[startup+12.7011 s]
/proc/loadavg: 1.31 1.07 1.02 2/66 9433
/proc/meminfo: memFree=1234884/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=39076 CPUtime=12.68
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 10460 0 0 0 1263 5 0 0 25 0 1 0 90128729 40013824 9256 1992294400 134512640 135813592 4294956176 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 9769 9256 149 317 0 9449 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 44436

[startup+25.5014 s]
/proc/loadavg: 1.37 1.09 1.03 2/66 9433
/proc/meminfo: memFree=1234244/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=39780 CPUtime=25.47
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 10643 0 0 0 2542 5 0 0 25 0 1 0 90128729 40734720 9439 1992294400 134512640 135813592 4294956176 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 9945 9439 149 317 0 9625 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 45140

[startup+51.101 s]
/proc/loadavg: 1.25 1.08 1.03 2/66 9433
/proc/meminfo: memFree=1233156/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=41012 CPUtime=51.06
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 10955 0 0 0 5101 5 0 0 25 0 1 0 90128729 41996288 9751 1992294400 134512640 135813592 4294956176 18446744073709551615 134662603 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 10253 9751 149 317 0 9933 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 46372

[startup+102.301 s]
/proc/loadavg: 1.10 1.07 1.02 2/66 9433
/proc/meminfo: memFree=1231044/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=43192 CPUtime=102.25
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 11483 0 0 0 10220 5 0 0 25 0 1 0 90128729 44228608 10279 1992294400 134512640 135813592 4294956176 18446744073709551615 134662685 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 10798 10279 149 317 0 10478 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 48552

[startup+162.302 s]
/proc/loadavg: 1.04 1.05 1.02 2/66 9433
/proc/meminfo: memFree=1228932/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=45464 CPUtime=162.23
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 12008 0 0 0 16218 5 0 0 25 0 1 0 90128729 46555136 10804 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 11366 10804 149 317 0 11046 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 50824

[startup+222.306 s]
/proc/loadavg: 1.01 1.04 1.01 2/66 9433
/proc/meminfo: memFree=1226052/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=48652 CPUtime=222.22
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 12716 0 0 0 22216 6 0 0 25 0 1 0 90128729 49819648 11512 1992294400 134512640 135813592 4294956176 18446744073709551615 134664983 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 12163 11512 149 317 0 11843 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 54012

[startup+282.302 s]
/proc/loadavg: 1.00 1.03 1.01 2/66 9439
/proc/meminfo: memFree=1222852/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=51756 CPUtime=282.2
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 13487 0 0 0 28213 7 0 0 25 0 1 0 90128729 52998144 12283 1992294400 134512640 135813592 4294956176 18446744073709551615 134664983 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 12939 12283 149 317 0 12619 0
Current children cumulated CPU time (s) 282.2
Current children cumulated vsize (KiB) 57116

[startup+342.301 s]
/proc/loadavg: 1.00 1.02 1.00 2/66 9439
/proc/meminfo: memFree=1221892/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=52788 CPUtime=342.18
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 13764 0 0 0 34211 7 0 0 25 0 1 0 90128729 54054912 12560 1992294400 134512640 135813592 4294956176 18446744073709551615 134664954 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 13197 12560 149 317 0 12877 0

################
# More data... #
################

/proc/9432/statm: 14654 13931 149 317 0 14334 0
Current children cumulated CPU time (s) 582.11
Current children cumulated vsize (KiB) 63976

[startup+642.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9439
/proc/meminfo: memFree=1212868/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5360 CPUtime=0
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 289 0 0 0 0 0 0 0 20 0 1 0 90128729 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/9431/statm: 1340 239 197 169 0 51 0
[pid=9432] ppid=9431 vsize=62224 CPUtime=642.09
/proc/9432/stat : 9432 (hydrasat_cache4) R 9431 9431 9364 0 -1 4194304 16030 0 0 0 64200 9 0 0 25 0 1 0 90128729 63717376 14826 1992294400 134512640 135813592 4294956176 18446744073709551615 135224188 0 0 4096 1 0 0 0 17 1 0 0
/proc/9432/statm: 15556 14826 149 317 0 15236 0
Current children cumulated CPU time (s) 642.09
Current children cumulated vsize (KiB) 67584

[startup+702.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 9440
/proc/meminfo: memFree=1184452/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=27272 CPUtime=1.94
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 7342 0 0 0 192 2 0 0 25 0 1 0 90198763 27926528 6245 1992294400 134512640 135995732 4294956032 18446744073709551615 134843026 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 6818 6245 172 362 0 6453 0
Current children cumulated CPU time (s) 702.05
Current children cumulated vsize (KiB) 32636

[startup+762.302 s]
/proc/loadavg: 1.95 1.26 1.09 2/66 9440
/proc/meminfo: memFree=1181060/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=28972 CPUtime=61.91
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 7771 0 0 0 6188 3 0 0 25 0 1 0 90198763 29667328 6674 1992294400 134512640 135995732 4294956032 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 7243 6674 172 362 0 6878 0
Current children cumulated CPU time (s) 762.02
Current children cumulated vsize (KiB) 34336

[startup+822.306 s]
/proc/loadavg: 2.20 1.45 1.16 2/66 9440
/proc/meminfo: memFree=1180804/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=30036 CPUtime=121.87
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 8050 0 0 0 12183 4 0 0 25 0 1 0 90198763 30756864 6953 1992294400 134512640 135995732 4294956032 18446744073709551615 134807904 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 7509 6953 172 362 0 7144 0
Current children cumulated CPU time (s) 821.98
Current children cumulated vsize (KiB) 35400

[startup+882.305 s]
/proc/loadavg: 1.92 1.53 1.20 2/66 9440
/proc/meminfo: memFree=1181252/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=31644 CPUtime=181.84
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 8439 0 0 0 18180 4 0 0 25 0 1 0 90198763 32403456 7342 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 7911 7342 172 362 0 7546 0
Current children cumulated CPU time (s) 881.95
Current children cumulated vsize (KiB) 37008

[startup+942.301 s]
/proc/loadavg: 1.33 1.43 1.19 2/66 9440
/proc/meminfo: memFree=1178244/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=34844 CPUtime=241.82
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 9220 0 0 0 24177 5 0 0 25 0 1 0 90198763 35680256 8123 1992294400 134512640 135995732 4294956032 18446744073709551615 134841584 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 8711 8123 172 362 0 8346 0
Current children cumulated CPU time (s) 941.93
Current children cumulated vsize (KiB) 40208

[startup+1002.3 s]
/proc/loadavg: 1.12 1.35 1.17 2/66 9440
/proc/meminfo: memFree=1176452/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=36744 CPUtime=301.79
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 9669 0 0 0 30174 5 0 0 25 0 1 0 90198763 37625856 8572 1992294400 134512640 135995732 4294956032 18446744073709551615 134807915 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 9186 8572 172 362 0 8821 0
Current children cumulated CPU time (s) 1001.9
Current children cumulated vsize (KiB) 42108

[startup+1062.3 s]
/proc/loadavg: 1.04 1.28 1.16 2/66 9440
/proc/meminfo: memFree=1175684/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=37436 CPUtime=361.78
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 9859 0 0 0 36173 5 0 0 25 0 1 0 90198763 38334464 8762 1992294400 134512640 135995732 4294956032 18446744073709551615 135385595 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 9359 8762 172 362 0 8994 0
Current children cumulated CPU time (s) 1061.89
Current children cumulated vsize (KiB) 42800

[startup+1122.3 s]
/proc/loadavg: 1.01 1.23 1.15 2/66 9440
/proc/meminfo: memFree=1174660/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=38540 CPUtime=421.76
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 10109 0 0 0 42171 5 0 0 25 0 1 0 90198763 39464960 9012 1992294400 134512640 135995732 4294956032 18446744073709551615 134807747 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 9635 9012 172 362 0 9270 0
Current children cumulated CPU time (s) 1121.87
Current children cumulated vsize (KiB) 43904

[startup+1182.3 s]
/proc/loadavg: 1.00 1.18 1.14 2/66 9440
/proc/meminfo: memFree=1172356/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=40924 CPUtime=481.75
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 10691 0 0 0 48169 6 0 0 25 0 1 0 90198763 41906176 9594 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 10231 9594 172 362 0 9866 0
Current children cumulated CPU time (s) 1181.86
Current children cumulated vsize (KiB) 46288



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.17 1.13 2/66 9440
/proc/meminfo: memFree=1172100/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=41192 CPUtime=499.95
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 10763 0 0 0 49989 6 0 0 25 0 1 0 90198763 42180608 9666 1992294400 134512640 135995732 4294956032 18446744073709551615 134682179 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 10298 9666 172 362 0 9933 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 46556

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.17 1.13 2/66 9440
/proc/meminfo: memFree=1172100/2055920 swapFree=4192956/4192956
[pid=9431] ppid=9429 vsize=5364 CPUtime=700.11
/proc/9431/stat : 9431 (hydrasat-multi.) S 9429 9431 9364 0 -1 4194304 322 17243 0 0 0 0 69979 32 16 0 1 0 90128729 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9431/statm: 1341 245 202 169 0 52 0
[pid=9440] ppid=9431 vsize=41192 CPUtime=499.95
/proc/9440/stat : 9440 (hydrasat_cachew) R 9431 9431 9364 0 -1 4194304 10763 0 0 0 49989 6 0 0 25 0 1 0 90198763 42180608 9666 1992294400 134512640 135995732 4294956032 18446744073709551615 134682179 0 0 4096 1 0 0 0 17 1 0 0
/proc/9440/statm: 10298 9666 172 362 0 9933 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 46556

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 9431 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=800614
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=328949
# CPU time returned by wait4() is 700.13
# while last known CPU time is 1200.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.51
CPU time (s): 1200.06
CPU user time (s): 1199.68
CPU system time (s): 0.38
CPU usage (%): 99.9623
Max. virtual memory (cumulated for all children) (KiB): 70192

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.801
system time used= 0.328949
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17565
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 962

runsolver used 1.9597 second user time and 4.49632 second system time

The end

Launcher Data 

Begin job on node90 at 2009-04-25 02:56:37
IDJOB=1716843
IDBENCH=20398
IDSOLVER=518
FILE ID=node90/1716843-1240620996
PBS_JOBID= 9186338
Free space on /tmp= 66520 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT07/industrial/fuhs/medium/AProVE07-16.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1716843-1240620996/watcher-1716843-1240620996 -o /tmp/evaluation-result-1716843-1240620996/solver-1716843-1240620996 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1716843-1240620996.cnf 1800 573926458

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 65057bcebbeecf6a7f3bc3fcfb2de009
RANDOM SEED=573926458

node90.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1272436 kB
Buffers:         85772 kB
Cached:         596404 kB
SwapCached:          0 kB
Active:         290248 kB
Inactive:       405652 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1272436 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:            7268 kB
Writeback:           0 kB
Mapped:          23444 kB
Slab:            73608 kB
Committed_AS:   193788 kB
PageTables:       1428 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66460 MiB
End job on node90 at 2009-04-25 03:16:39