Trace number 3493892

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Haifa-MUC-A 2011-04-07? (TO) 1800.09 1800.11

General information on the benchmark

NameSAT02/industrial/goldberg/rand_net/
rand_net60-25-5.shuffled.cnf
MD5SUMe9dc2458de00cdb276423afd8a0018b5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark661.508
Satisfiable
(Un)Satisfiability was proved
Number of variables3000
Number of clauses8881
Sum of the clauses size20940
Maximum clause length60
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 25760
Number of clauses of size 33120
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 988)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3493892-1307804301/watcher-3493892-1307804301 -o /tmp/evaluation-result-3493892-1307804301/solver-3493892-1307804301 -C 1800 -W 1850 -M 7680 HOME/hmuc-a HOME/instance-3493892-1307804301.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1850 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.15 1.90 2.68 5/185 2503
/proc/meminfo: memFree=31481812/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=20792 CPUtime=0 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 704 0 0 0 0 0 0 0 25 0 1 0 892029945 21291008 646 33554432000 4194304 4311632 140734776881520 18446744073709551615 248089698048 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 5198 647 218 29 0 1827 0

[startup+0.020338 s]
/proc/loadavg: 1.15 1.90 2.68 5/185 2503
/proc/meminfo: memFree=31481812/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=20448 CPUtime=0.01 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 1015 0 0 0 1 0 0 0 25 0 1 0 892029945 20938752 895 33554432000 4194304 4311632 140734776881520 18446744073709551615 4277442 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 5112 895 225 29 0 1741 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 20448

[startup+0.100324 s]
/proc/loadavg: 1.15 1.90 2.68 5/185 2503
/proc/meminfo: memFree=31481812/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=17800 CPUtime=0.09 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 1372 0 0 0 9 0 0 0 25 0 1 0 892029945 18227200 1167 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264210 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 4450 1168 245 29 0 1079 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17800

[startup+0.30029 s]
/proc/loadavg: 1.15 1.90 2.68 5/185 2503
/proc/meminfo: memFree=31481812/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=27564 CPUtime=0.29 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 3522 0 0 0 29 0 0 0 25 0 1 0 892029945 28225536 3315 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264447 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 6891 3316 246 29 0 3520 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 27564

[startup+0.700219 s]
/proc/loadavg: 1.15 1.90 2.68 5/185 2503
/proc/meminfo: memFree=31481812/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=27584 CPUtime=0.69 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 5321 0 0 0 69 0 0 0 25 0 1 0 892029945 28246016 3673 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264416 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 6896 3673 246 29 0 3525 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 27584

[startup+1.50008 s]
/proc/loadavg: 1.15 1.90 2.68 6/190 2515
/proc/meminfo: memFree=31366380/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=41820 CPUtime=1.49 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 9992 0 0 0 148 1 0 0 25 0 1 0 892029945 42823680 4631 33554432000 4194304 4311632 140734776881520 18446744073709551615 4282542 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 10455 4631 247 29 0 7084 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 41820

[startup+3.1008 s]
/proc/loadavg: 1.15 1.90 2.68 6/190 2515
/proc/meminfo: memFree=31350632/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=41820 CPUtime=3.1 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 18183 0 0 0 308 2 0 0 25 0 1 0 892029945 42823680 7280 33554432000 4194304 4311632 140734776881520 18446744073709551615 4272979 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 10455 7280 249 29 0 7084 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 41820

[startup+6.30023 s]
/proc/loadavg: 1.38 1.94 2.69 6/190 2515
/proc/meminfo: memFree=31192620/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=6.29 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 30003 0 0 0 627 2 0 0 25 0 1 0 892029945 74014720 10199 33554432000 4194304 4311632 140734776881520 18446744073709551615 4272464 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 10199 247 29 0 14699 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 72280

[startup+12.7001 s]
/proc/loadavg: 1.59 1.97 2.70 6/190 2515
/proc/meminfo: memFree=31061524/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=12.69 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 64863 0 0 0 1263 6 0 0 25 0 1 0 892029945 74014720 10199 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264186 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 10199 247 29 0 14699 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 72280

[startup+25.5008 s]
/proc/loadavg: 2.12 2.07 2.72 6/190 2516
/proc/meminfo: memFree=31215872/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=25.5 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 127675 0 0 0 2536 14 0 0 25 0 1 0 892029945 74014720 10199 33554432000 4194304 4311632 140734776881520 18446744073709551615 4286219 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 10199 247 29 0 14699 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 72280

[startup+51.1003 s]
/proc/loadavg: 2.83 2.24 2.76 6/190 2516
/proc/meminfo: memFree=31152428/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=152420 CPUtime=51.09 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 230243 0 0 0 5083 26 0 0 25 0 1 0 892029945 156078080 24513 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264427 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 38105 24513 246 29 0 34734 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 152420

[startup+102.306 s]
/proc/loadavg: 3.49 2.51 2.82 6/190 2518
/proc/meminfo: memFree=31259768/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=102.3 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 496696 0 0 0 10169 61 0 0 25 0 1 0 892029945 74014720 10199 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264437 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 10199 246 29 0 14699 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 72280

[startup+162.301 s]
/proc/loadavg: 3.81 2.78 2.89 5/185 2553
/proc/meminfo: memFree=31218468/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=162.29 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 843271 0 0 0 16119 110 0 0 25 0 1 0 892029945 74014720 10199 33554432000 4194304 4311632 140734776881520 18446744073709551615 4271553 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 10199 246 29 0 14699 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 72280

[startup+222.3 s]
/proc/loadavg: 3.93 3.00 2.96 6/190 2569
/proc/meminfo: memFree=31097836/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=222.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 1181260 0 0 0 22074 154 0 0 25 0 1 0 892029945 74014720 10199 33554432000 4194304 4311632 140734776881520 18446744073709551615 4271848 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 10199 246 29 0 14699 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 72280

[startup+282.301 s]
/proc/loadavg: 3.97 3.18 3.02 6/190 2571
/proc/meminfo: memFree=31210508/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=282.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 1526913 0 0 0 28025 203 0 0 25 0 1 0 892029945 74014720 10199 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264281 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 10199 246 29 0 14699 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 72280

[startup+342.301 s]
/proc/loadavg: 3.99 3.32 3.08 5/190 2612
/proc/meminfo: memFree=31208652/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=152420 CPUtime=342.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 1912446 0 0 0 33974 253 0 0 25 0 1 0 892029945 156078080 26757 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264210 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 38105 26757 246 29 0 34734 0
Current children cumulated CPU time (s) 342.27
Current children cumulated vsize (KiB) 152420

[startup+402.3 s]
/proc/loadavg: 3.99 3.44 3.13 5/190 2615
/proc/meminfo: memFree=31215616/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=152420 CPUtime=402.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 2314384 0 0 0 39919 309 0 0 25 0 1 0 892029945 156078080 28694 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264447 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 38105 28694 246 29 0 34734 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 152420

[startup+462.301 s]
/proc/loadavg: 4.05 3.56 3.19 5/190 2616
/proc/meminfo: memFree=31131632/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=72280 CPUtime=462.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 2711344 0 0 0 45869 359 0 0 25 0 1 0 892029945 74014720 14867 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264427 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 18070 14867 246 29 0 14699 0
Current children cumulated CPU time (s) 462.28
Current children cumulated vsize (KiB) 72280

[startup+522.3 s]
/proc/loadavg: 4.02 3.64 3.24 5/190 2618
/proc/meminfo: memFree=31210456/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=121600 CPUtime=522.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 3117750 0 0 0 51819 408 0 0 25 0 1 0 892029945 124518400 24015 33554432000 4194304 4311632 140734776881520 18446744073709551615 4272621 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 30400 24017 246 29 0 27029 0
Current children cumulated CPU time (s) 522.27
Current children cumulated vsize (KiB) 121600

[startup+582.301 s]
/proc/loadavg: 4.00 3.70 3.28 5/190 2620
/proc/meminfo: memFree=31210652/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=152420 CPUtime=582.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 3491012 0 0 0 57769 458 0 0 25 0 1 0 892029945 156078080 28258 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264437 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 38105 28259 246 29 0 34734 0
Current children cumulated CPU time (s) 582.27
Current children cumulated vsize (KiB) 152420

[startup+642.301 s]

################
# More data... #
################

[startup+882.301 s]
/proc/loadavg: 3.99 3.89 3.47 5/190 2666
/proc/meminfo: memFree=31150360/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=164544 CPUtime=882.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 5389545 0 0 0 87509 719 0 0 25 0 1 0 892029945 168493056 37437 33554432000 4194304 4311632 140734776881520 18446744073709551615 4282542 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 41136 37437 246 29 0 37765 0
Current children cumulated CPU time (s) 882.28
Current children cumulated vsize (KiB) 164544

[startup+942.301 s]
/proc/loadavg: 4.06 3.92 3.51 5/190 2705
/proc/meminfo: memFree=30759636/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=133724 CPUtime=942.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 5754105 0 0 0 93457 770 0 0 25 0 1 0 892029945 136933376 26670 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264400 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 33431 26670 246 29 0 30060 0
Current children cumulated CPU time (s) 942.27
Current children cumulated vsize (KiB) 133724

[startup+1002.3 s]
/proc/loadavg: 4.10 3.95 3.54 5/190 2745
/proc/meminfo: memFree=29860728/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=164544 CPUtime=1002.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 6148424 0 0 0 99402 826 0 0 25 0 1 0 892029945 168493056 31203 33554432000 4194304 4311632 140734776881520 18446744073709551615 4271538 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 41136 31203 246 29 0 37765 0
Current children cumulated CPU time (s) 1002.28
Current children cumulated vsize (KiB) 164544

[startup+1062.3 s]
/proc/loadavg: 4.04 3.95 3.57 5/190 2750
/proc/meminfo: memFree=30013692/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=84404 CPUtime=1062.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 6541207 0 0 0 105350 878 0 0 25 0 1 0 892029945 86429696 17898 33554432000 4194304 4311632 140734776881520 18446744073709551615 4271785 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 21101 17898 246 29 0 17730 0
Current children cumulated CPU time (s) 1062.28
Current children cumulated vsize (KiB) 84404

[startup+1122.3 s]
/proc/loadavg: 4.01 3.96 3.59 5/190 2752
/proc/meminfo: memFree=29995120/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=84404 CPUtime=1122.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 6915909 0 0 0 111296 931 0 0 25 0 1 0 892029945 86429696 17898 33554432000 4194304 4311632 140734776881520 18446744073709551615 4272502 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 21101 17898 246 29 0 17730 0
Current children cumulated CPU time (s) 1122.27
Current children cumulated vsize (KiB) 84404

[startup+1182.3 s]
/proc/loadavg: 4.06 3.98 3.62 5/190 2754
/proc/meminfo: memFree=30039600/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=133724 CPUtime=1182.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 7310737 0 0 0 117243 984 0 0 25 0 1 0 892029945 136933376 28091 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264369 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 33431 28091 246 29 0 30060 0
Current children cumulated CPU time (s) 1182.27
Current children cumulated vsize (KiB) 133724

[startup+1242.3 s]
/proc/loadavg: 4.02 3.98 3.64 5/190 2755
/proc/meminfo: memFree=30038136/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=133724 CPUtime=1242.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 7688122 0 0 0 123190 1037 0 0 25 0 1 0 892029945 136933376 28703 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264437 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 33431 28703 246 29 0 30060 0
Current children cumulated CPU time (s) 1242.27
Current children cumulated vsize (KiB) 133724

[startup+1302.3 s]
/proc/loadavg: 4.01 3.98 3.66 5/190 2757
/proc/meminfo: memFree=29951468/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=164544 CPUtime=1302.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 8042694 0 0 0 129141 1087 0 0 25 0 1 0 892029945 168493056 37551 33554432000 4194304 4311632 140734776881520 18446744073709551615 4282542 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 41136 37551 246 29 0 37765 0
Current children cumulated CPU time (s) 1302.28
Current children cumulated vsize (KiB) 164544

[startup+1362.3 s]
/proc/loadavg: 4.00 3.98 3.68 5/187 2915
/proc/meminfo: memFree=29972700/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=214632 CPUtime=1362.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 8406531 0 0 0 135084 1143 0 0 25 0 1 0 892029945 219783168 39511 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264437 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 53658 39511 246 29 0 50287 0
Current children cumulated CPU time (s) 1362.27
Current children cumulated vsize (KiB) 214632

[startup+1422.31 s]
/proc/loadavg: 4.00 3.98 3.69 5/190 2927
/proc/meminfo: memFree=25351816/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=84404 CPUtime=1422.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 8759752 0 0 0 141036 1192 0 0 25 0 1 0 892029945 86429696 17898 33554432000 4194304 4311632 140734776881520 18446744073709551615 4273008 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 21101 17898 246 29 0 17730 0
Current children cumulated CPU time (s) 1422.28
Current children cumulated vsize (KiB) 84404

[startup+1482.3 s]
/proc/loadavg: 4.06 4.00 3.72 5/190 2929
/proc/meminfo: memFree=26113656/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=214632 CPUtime=1482.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 9128221 0 0 0 146982 1245 0 0 25 0 1 0 892029945 219783168 39108 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264235 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 53658 39108 246 29 0 50287 0
Current children cumulated CPU time (s) 1482.27
Current children cumulated vsize (KiB) 214632

[startup+1542.3 s]
/proc/loadavg: 4.02 4.00 3.73 5/190 2930
/proc/meminfo: memFree=26046088/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=214632 CPUtime=1542.28 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 9499219 0 0 0 152929 1299 0 0 25 0 1 0 892029945 219783168 41526 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264427 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 53658 41526 246 29 0 50287 0
Current children cumulated CPU time (s) 1542.28
Current children cumulated vsize (KiB) 214632

[startup+1602.3 s]
/proc/loadavg: 4.05 4.01 3.75 5/190 2934
/proc/meminfo: memFree=26109236/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=133724 CPUtime=1602.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 9849020 0 0 0 158874 1353 0 0 25 0 1 0 892029945 136933376 28162 33554432000 4194304 4311632 140734776881520 18446744073709551615 4271553 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 33431 28164 246 29 0 30060 0
Current children cumulated CPU time (s) 1602.27
Current children cumulated vsize (KiB) 133724

[startup+1662.3 s]
/proc/loadavg: 4.02 4.00 3.76 5/190 2935
/proc/meminfo: memFree=26083604/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=133724 CPUtime=1662.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 10219392 0 0 0 164819 1408 0 0 25 0 1 0 892029945 136933376 27769 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264639 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 33431 27769 246 29 0 30060 0
Current children cumulated CPU time (s) 1662.27
Current children cumulated vsize (KiB) 133724

[startup+1722.3 s]
/proc/loadavg: 4.00 4.00 3.77 5/190 2937
/proc/meminfo: memFree=26138568/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=164544 CPUtime=1722.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 10595336 0 0 0 170762 1465 0 0 25 0 1 0 892029945 168493056 34405 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264235 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 41136 34405 246 29 0 37765 0
Current children cumulated CPU time (s) 1722.27
Current children cumulated vsize (KiB) 164544

[startup+1782.3 s]
/proc/loadavg: 4.00 4.00 3.78 5/190 2939
/proc/meminfo: memFree=26070144/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=214632 CPUtime=1782.27 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 10968253 0 0 0 176702 1525 0 0 25 0 1 0 892029945 219783168 42904 33554432000 4194304 4311632 140734776881520 18446744073709551615 4264355 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 53658 42904 246 29 0 50287 0
Current children cumulated CPU time (s) 1782.27
Current children cumulated vsize (KiB) 214632



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.1 s]
/proc/loadavg: 4.00 4.00 3.79 4/188 2940
/proc/meminfo: memFree=26108280/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=214632 CPUtime=1800.07 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 11069079 0 0 0 178468 1539 0 0 25 0 1 0 892029945 219783168 43707 33554432000 4194304 4311632 140734776881520 18446744073709551615 4282542 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 53658 43707 246 29 0 50287 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 214632

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.1 s]
/proc/loadavg: 4.00 4.00 3.79 4/188 2940
/proc/meminfo: memFree=26108280/32950928 swapFree=67055156/67111528
[pid=2503] ppid=2501 vsize=214632 CPUtime=1800.07 cores=5,7
/proc/2503/stat : 2503 (hmuc-a) R 2501 2503 1663 0 -1 4202496 11069079 0 0 0 178468 1539 0 0 25 0 1 0 892029945 219783168 43707 33554432000 4194304 4311632 140734776881520 18446744073709551615 4282542 0 0 4096 8388610 0 0 0 17 5 0 0 0
/proc/2503/statm: 53658 43707 246 29 0 50287 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 214632

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.11
CPU time (s): 1800.09
CPU user time (s): 1784.69
CPU system time (s): 15.4027
CPU usage (%): 99.9987
Max. virtual memory (cumulated for all children) (KiB): 296020

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1784.69
system time used= 15.4027
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11069090
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 3529

runsolver used 2.89756 second user time and 6.67399 second system time

The end

Launcher Data 

Begin job on node123 at 2011-06-11 16:58:21
IDJOB=3493892
IDBENCH=88008
IDSOLVER=1983
FILE ID=node123/3493892-1307804301
RUNJOBID= node123-1307804301-2459
PBS_JOBID= 13551056
Free space on /tmp= 74180 MiB

SOLVER NAME= Haifa-MUC-A 2011-04-07
BENCH NAME= SAT02/industrial/goldberg/rand_net/rand_net60-25-5.shuffled.cnf
COMMAND LINE= HOME/hmuc-a BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3493892-1307804301/watcher-3493892-1307804301 -o /tmp/evaluation-result-3493892-1307804301/solver-3493892-1307804301 -C 1800 -W 1850 -M 7680  HOME/hmuc-a HOME/instance-3493892-1307804301.cnf

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= e9dc2458de00cdb276423afd8a0018b5
RANDOM SEED=1412020248

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31483348 kB
Buffers:        295264 kB
Cached:         958852 kB
SwapCached:      10356 kB
Active:         464980 kB
Inactive:       810824 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31483348 kB
SwapTotal:    67111528 kB
SwapFree:     67055156 kB
Dirty:            2336 kB
Writeback:           0 kB
AnonPages:       18820 kB
Mapped:          13104 kB
Slab:           126892 kB
PageTables:       5304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   215560 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73732 MiB
End job on node123 at 2011-06-11 17:28:24