Trace number 1723211

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.03 1200.61

General information on the benchmark

Namemanol-pipe-c10nidw_s.cnf
MD5SUM7989bb134c6f50cb418407e85e733980
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark21.7277
Satisfiable
(Un)Satisfiability was proved
Number of variables404382
Number of clauses1204273
Sum of the clauses size2809969
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2802848
Number of clauses of size 3401424
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Trying configuration 1
701.15/701.58	HOME/hydrasat-multi.sh: line 48: 18354 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
701.15/701.58	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1723211-1240684174/watcher-1723211-1240684174 -o /tmp/evaluation-result-1723211-1240684174/solver-1723211-1240684174 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1723211-1240684174.cnf 1800 872465438 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.89 1.94 1.68 3/64 18353
/proc/meminfo: memFree=1548896/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) R 18351 18353 18069 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 238 1992294400 4194304 4889804 548682068720 18446744073709551615 226913479327 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/18353/statm: 1340 238 196 169 0 51 0
[pid=18354] ppid=18353 vsize=6160 CPUtime=0
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 172 0 0 0 0 0 0 0 18 0 1 0 96451455 6307840 154 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 1540 155 117 317 0 1220 0

[startup+0.077371 s]
/proc/loadavg: 1.89 1.94 1.68 3/64 18353
/proc/meminfo: memFree=1548896/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=9856 CPUtime=0.06
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 1150 0 0 0 6 0 0 0 19 0 1 0 96451455 10092544 1132 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 2464 1133 117 317 0 2144 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 15216

[startup+0.102385 s]
/proc/loadavg: 1.89 1.94 1.68 3/64 18353
/proc/meminfo: memFree=1548896/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=11044 CPUtime=0.09
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 1483 0 0 0 9 0 0 0 19 0 1 0 96451455 11309056 1465 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 2761 1466 117 317 0 2441 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 16404

[startup+0.301395 s]
/proc/loadavg: 1.89 1.94 1.68 3/64 18353
/proc/meminfo: memFree=1548896/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=20944 CPUtime=0.29
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 4139 0 0 0 28 1 0 0 21 0 1 0 96451455 21446656 4121 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 5269 4122 117 317 0 4949 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26304

[startup+0.701439 s]
/proc/loadavg: 1.89 1.94 1.68 3/64 18353
/proc/meminfo: memFree=1548896/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=40612 CPUtime=0.69
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 9396 0 0 0 66 3 0 0 25 0 1 0 96451455 41586688 9378 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 10153 9379 117 317 0 9833 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 45972

[startup+1.50153 s]
/proc/loadavg: 1.82 1.93 1.68 2/66 18355
/proc/meminfo: memFree=1495696/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=87972 CPUtime=1.49
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 21801 0 0 0 139 10 0 0 25 0 1 0 96451455 90083328 21783 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 21993 21784 122 317 0 21673 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 93332

[startup+3.10171 s]
/proc/loadavg: 1.82 1.93 1.68 2/66 18355
/proc/meminfo: memFree=1438288/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=130640 CPUtime=3.09
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 33514 0 0 0 294 15 0 0 25 0 1 0 96451455 133775360 30907 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 32660 30908 126 317 0 32340 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 136000

[startup+6.30106 s]
/proc/loadavg: 1.75 1.91 1.67 2/66 18355
/proc/meminfo: memFree=1378320/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=198800 CPUtime=6.29
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 50662 0 0 0 607 22 0 0 25 0 1 0 96451455 203571200 47285 1992294400 134512640 135813592 4294956160 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 49700 47287 126 317 0 49380 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 204160

[startup+12.7018 s]
/proc/loadavg: 1.69 1.90 1.67 2/66 18355
/proc/meminfo: memFree=1328848/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=268628 CPUtime=12.68
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 75203 0 0 0 1236 32 0 0 25 0 1 0 96451455 275075072 64407 1992294400 134512640 135813592 4294956160 18446744073709551615 134606915 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 67157 64407 127 317 0 66837 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 273988

[startup+25.5022 s]
/proc/loadavg: 1.59 1.87 1.66 2/66 18355
/proc/meminfo: memFree=1267728/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=291900 CPUtime=25.47
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 81111 0 0 0 2512 35 0 0 25 0 1 0 96451455 298905600 70314 1992294400 134512640 135813592 4294956160 18446744073709551615 134665099 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 72975 70314 149 317 0 72655 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 297260

[startup+51.1021 s]
/proc/loadavg: 1.35 1.78 1.64 2/66 18355
/proc/meminfo: memFree=1264848/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=294776 CPUtime=51.05
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 81782 0 0 0 5069 36 0 0 25 0 1 0 96451455 301850624 70985 1992294400 134512640 135813592 4294956160 18446744073709551615 134665097 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 73694 70985 149 317 0 73374 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 300136

[startup+102.307 s]
/proc/loadavg: 1.15 1.66 1.60 2/66 18355
/proc/meminfo: memFree=1257424/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=302760 CPUtime=102.22
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 83660 0 0 0 10185 37 0 0 25 0 1 0 96451455 310026240 72863 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 75690 72863 149 317 0 75370 0
Current children cumulated CPU time (s) 102.22
Current children cumulated vsize (KiB) 308120

[startup+162.302 s]
/proc/loadavg: 1.05 1.54 1.56 2/66 18355
/proc/meminfo: memFree=1247504/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=313508 CPUtime=162.19
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 86245 0 0 0 16180 39 0 0 25 0 1 0 96451455 321032192 75448 1992294400 134512640 135813592 4294956160 18446744073709551615 134591941 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 78377 75448 149 317 0 78057 0
Current children cumulated CPU time (s) 162.19
Current children cumulated vsize (KiB) 318868

[startup+222.302 s]
/proc/loadavg: 1.02 1.44 1.52 2/66 18355
/proc/meminfo: memFree=1244240/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=316244 CPUtime=222.18
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 86935 0 0 0 22178 40 0 0 25 0 1 0 96451455 323833856 76138 1992294400 134512640 135813592 4294956160 18446744073709551615 134667821 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 79061 76138 149 317 0 78741 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 321604

[startup+282.303 s]
/proc/loadavg: 1.00 1.35 1.49 2/66 18355
/proc/meminfo: memFree=1243472/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=317036 CPUtime=282.15
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 87130 0 0 0 28174 41 0 0 25 0 1 0 96451455 324644864 76333 1992294400 134512640 135813592 4294956160 18446744073709551615 134664957 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 79259 76333 149 317 0 78939 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 322396

[startup+342.303 s]
/proc/loadavg: 1.00 1.29 1.45 2/66 18355
/proc/meminfo: memFree=1242448/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=318092 CPUtime=342.13
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 87380 0 0 0 34172 41 0 0 25 0 1 0 96451455 325726208 76583 1992294400 134512640 135813592 4294956160 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 79523 76583 149 317 0 79203 0

################
# More data... #
################

/proc/18354/statm: 82649 79604 149 317 0 82329 0
Current children cumulated CPU time (s) 522.06
Current children cumulated vsize (KiB) 335956

[startup+582.301 s]
/proc/loadavg: 1.00 1.12 1.34 2/66 18357
/proc/meminfo: memFree=1225808/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=335032 CPUtime=582.02
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 91648 0 0 0 58157 45 0 0 25 0 1 0 96451455 343072768 80722 1992294400 134512640 135813592 4294956160 18446744073709551615 134664861 0 0 4096 1 0 0 0 17 0 0 0
/proc/18354/statm: 83758 80722 149 317 0 83438 0
Current children cumulated CPU time (s) 582.02
Current children cumulated vsize (KiB) 340392

[startup+642.301 s]
/proc/loadavg: 1.06 1.11 1.32 2/66 18357
/proc/meminfo: memFree=1221200/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5360 CPUtime=0
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 96451454 5488640 239 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1340 239 197 169 0 51 0
[pid=18354] ppid=18353 vsize=339600 CPUtime=642
/proc/18354/stat : 18354 (hydrasat_cache4) R 18353 18353 18069 0 -1 4194304 92785 0 0 0 64154 46 0 0 25 0 1 0 96451455 347750400 81859 1992294400 134512640 135813592 4294956160 18446744073709551615 134592479 0 0 4096 1 0 0 0 17 1 0 0
/proc/18354/statm: 84900 81859 149 317 0 84580 0
Current children cumulated CPU time (s) 642
Current children cumulated vsize (KiB) 344960

[startup+702.302 s]
/proc/loadavg: 1.02 1.09 1.30 2/66 18358
/proc/meminfo: memFree=1197072/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=33928 CPUtime=0.71
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 7786 0 0 0 66 5 0 0 24 0 1 0 96521613 34742272 7769 1992294400 134512640 135995732 4294956016 18446744073709551615 135369318 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 8482 7769 142 362 0 8117 0
Current children cumulated CPU time (s) 701.94
Current children cumulated vsize (KiB) 39292

[startup+762.306 s]
/proc/loadavg: 1.11 1.11 1.29 2/66 18358
/proc/meminfo: memFree=1006032/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=216084 CPUtime=60.68
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 62172 0 0 0 6029 39 0 0 25 0 1 0 96521613 221270016 51376 1992294400 134512640 135995732 4294956016 18446744073709551615 134638079 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 54021 51376 172 362 0 53656 0
Current children cumulated CPU time (s) 761.91
Current children cumulated vsize (KiB) 221448

[startup+822.301 s]
/proc/loadavg: 1.04 1.09 1.27 2/66 18358
/proc/meminfo: memFree=1002064/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=220656 CPUtime=120.66
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 63262 0 0 0 12026 40 0 0 25 0 1 0 96521613 225951744 52466 1992294400 134512640 135995732 4294956016 18446744073709551615 134807701 0 0 4096 1 0 0 0 17 1 0 0
/proc/18358/statm: 55164 52466 172 362 0 54799 0
Current children cumulated CPU time (s) 821.89
Current children cumulated vsize (KiB) 226020

[startup+882.302 s]
/proc/loadavg: 1.01 1.07 1.25 2/66 18358
/proc/meminfo: memFree=995344/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=227584 CPUtime=180.63
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 64970 0 0 0 18021 42 0 0 25 0 1 0 96521613 233046016 54174 1992294400 134512640 135995732 4294956016 18446744073709551615 134807654 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 56896 54174 172 362 0 56531 0
Current children cumulated CPU time (s) 881.86
Current children cumulated vsize (KiB) 232948

[startup+942.302 s]
/proc/loadavg: 1.00 1.05 1.23 2/66 18358
/proc/meminfo: memFree=990992/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=232324 CPUtime=240.6
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 66107 0 0 0 24017 43 0 0 25 0 1 0 96521613 237899776 55311 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 58081 55311 172 362 0 57716 0
Current children cumulated CPU time (s) 941.83
Current children cumulated vsize (KiB) 237688

[startup+1002.3 s]
/proc/loadavg: 1.00 1.04 1.22 2/66 18358
/proc/meminfo: memFree=984272/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=239544 CPUtime=300.57
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 67875 0 0 0 30013 44 0 0 25 0 1 0 96521613 245293056 56950 1992294400 134512640 135995732 4294956016 18446744073709551615 134807691 0 0 4096 1 0 0 0 17 1 0 0
/proc/18358/statm: 59886 56950 172 362 0 59521 0
Current children cumulated CPU time (s) 1001.8
Current children cumulated vsize (KiB) 244908

[startup+1062.3 s]
/proc/loadavg: 1.00 1.03 1.20 2/66 18358
/proc/meminfo: memFree=982864/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=240744 CPUtime=360.55
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 68190 0 0 0 36010 45 0 0 25 0 1 0 96521613 246521856 57265 1992294400 134512640 135995732 4294956016 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 60186 57265 172 362 0 59821 0
Current children cumulated CPU time (s) 1061.78
Current children cumulated vsize (KiB) 246108

[startup+1122.3 s]
/proc/loadavg: 1.00 1.02 1.18 2/66 18358
/proc/meminfo: memFree=982480/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=241140 CPUtime=420.53
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 68282 0 0 0 42008 45 0 0 25 0 1 0 96521613 246927360 57357 1992294400 134512640 135995732 4294956016 18446744073709551615 134589359 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 60285 57357 172 362 0 59920 0
Current children cumulated CPU time (s) 1121.76
Current children cumulated vsize (KiB) 246504

[startup+1182.3 s]
/proc/loadavg: 1.00 1.02 1.17 2/66 18358
/proc/meminfo: memFree=981904/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=241668 CPUtime=480.49
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 68429 0 0 0 48004 45 0 0 25 0 1 0 96521613 247468032 57504 1992294400 134512640 135995732 4294956016 18446744073709551615 134589582 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 60417 57504 172 362 0 60052 0
Current children cumulated CPU time (s) 1181.72
Current children cumulated vsize (KiB) 247032



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.6 s]
/proc/loadavg: 1.00 1.02 1.17 2/66 18358
/proc/meminfo: memFree=980240/2055920 swapFree=4192956/4192956
[pid=18353] ppid=18351 vsize=5364 CPUtime=701.23
/proc/18353/stat : 18353 (hydrasat-multi.) S 18351 18353 18069 0 -1 4194304 321 95926 0 0 0 0 69942 181 16 0 1 0 96451454 5492736 245 1992294400 4194304 4889804 548682068720 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18353/statm: 1341 245 202 169 0 52 0
[pid=18358] ppid=18353 vsize=243588 CPUtime=498.8
/proc/18358/stat : 18358 (hydrasat_cachew) R 18353 18353 18069 0 -1 4194304 68854 0 0 0 49834 46 0 0 25 0 1 0 96521613 249434112 57929 1992294400 134512640 135995732 4294956016 18446744073709551615 134841888 0 0 4096 1 0 0 0 17 0 0 0
/proc/18358/statm: 60897 57929 172 362 0 60532 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 248952

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18353 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=426670
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=814724
# CPU time returned by wait4() is 701.241
# while last known CPU time is 1200.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.61
CPU time (s): 1200.03
CPU user time (s): 1197.76
CPU system time (s): 2.27
CPU usage (%): 99.9515
Max. virtual memory (cumulated for all children) (KiB): 350132

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.427
system time used= 1.81472
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 96247
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1704

runsolver used 1.02884 second user time and 3.34749 second system time

The end

Launcher Data 

Begin job on node5 at 2009-04-25 20:29:35
IDJOB=1723211
IDBENCH=71688
IDSOLVER=518
FILE ID=node5/1723211-1240684174
PBS_JOBID= 9186672
Free space on /tmp= 66328 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT_RACE06/manol-pipe-c10nidw_s.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1723211-1240684174/watcher-1723211-1240684174 -o /tmp/evaluation-result-1723211-1240684174/solver-1723211-1240684174 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1723211-1240684174.cnf 1800 872465438

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 7989bb134c6f50cb418407e85e733980
RANDOM SEED=872465438

node5.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1549440 kB
Buffers:         56880 kB
Cached:         365468 kB
SwapCached:          0 kB
Active:         120072 kB
Inactive:       316136 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1549440 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:           26156 kB
Writeback:           0 kB
Mapped:          23664 kB
Slab:            56384 kB
Committed_AS:   339896 kB
PageTables:       1388 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66000 MiB
End job on node5 at 2009-04-25 20:49:38