Trace number 3273221

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: SATzilla2009_C 2009-03-22? (TO) 1300 1300.01

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2400c266431g10.cnf
MD5SUM885d1d8595262b8f0aa94d123211b47c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

23.07/23.11	c SATzilla is building models for class 2
23.07/23.11	c run presolver march_dl2004 for 5 seconds ... 
23.07/23.11	c Bin: Executing march_dl2004
23.07/23.11	c spawning binary file with 5 seconds ...
23.07/23.11	c child exit by a signal
23.07/23.11	c march_dl2004 returned code 137.
23.07/23.11	c run presolver mxc-sr08 for 5 seconds ... 
23.07/23.11	c Bin: Executing mxc-sr08
23.07/23.11	c spawning binary file with 5 seconds ...
23.07/23.11	c child exit by a signal
23.07/23.11	c mxc-sr08 returned code 137.
23.07/23.11	c Orignal number of varibales is 2400, number of clauses is 266431 
23.07/23.11	c predicted feature computation time is 13.019305 
23.07/23.11	c Bin: Executing satelite
23.07/23.11	c spawning binary file with 240 seconds ...
23.07/23.11	c child exited successfully
23.07/23.11	c satzilla computing base features
23.07/23.11	c Number of variabe is: 2325, Number of clause is : 263357 
23.07/23.11	c Initializing...
23.07/23.11	c satzilla compute diameter ...
23.07/23.11	c start diameter features ...
23.07/23.11	c satzilla doing clause learning
23.07/23.11	c start clause learning features ...
23.07/23.11	c Bin: Executing zchaff07
23.07/23.11	c spawning binary file with 2 seconds ...
23.07/23.11	c child exit by a signal
23.07/23.11	c satzilla doing survey propogation probe
23.07/23.11	c do survay propogation for 2 second ...
23.07/23.11	c satzilla doing local search probe
23.07/23.11	c satzilla doing lobjois search-space size estimate
23.07/23.11	c features are:2400 266431 2325 263357 0.0322581 0.0116724 0.00882832 0.997196 0.0130174 0.184748 0.00144859 1.8728 0.000860215 0.0258065 0.195481 0.954719 0.954719 0.00144859 0.20308 0.000698671 0.00247573 5.6261 0.164582 0.0388742 0.0679612 0.314815 2.7519 0.000821264 0.18923 0.000406293 0.00142013 5.05315 0.954719 0.00175249 0.200427 0.000858151 0.00269216 3.00676 0.0272457 3 4 0.0404988 141.1 0.221216 58 209 173 115 158 137 147 66.0307 0.126604 57.4684 93.4828 79.8312 58 67.475 62.6545 64.2571 0.837285 0.0847655 0.510364 0.931465 0.909463 0.726855 0.889388 0.802756 0.860316 1.55434e-09 12.0931 -1.11022e-16 4.57874e-07 7.12446e-11 0 1.74527e-12 2.22045e-16 2.09832e-14 350.357 3.09105 1011.14 0.288734 1089 1059 1111 57.2662 0.0996491 1.00477 0.0181622 0.805811 0.901671 
23.07/23.11	c satzilla's ranking:
23.07/23.11	c 1) mxc-sr08: 3.241520
23.07/23.11	c 2) march_dl2004: 2.152002
23.07/23.11	c 3) minisat20SAT07: 1.793973
23.07/23.11	c 4) minisat20: 1.501599
23.07/23.11	c 5) zchaff_rand: 1.166534
23.07/23.11	c 6) vallst: 1.161221
23.07/23.11	c 7) tts-4-0: 0.180766
23.07/23.11	c 8) SATenstein: -10000.000000
23.07/23.11	c 9) gnovelty+: -10000.000000
23.07/23.11	c 10) adaptg2wsat+: -10000.000000
23.07/23.11	c 11) adaptg2wsat0: -10000.000000
23.07/23.11	c 12) picosat846: -10000.000000
23.07/23.11	c 13) kcnfs04SAT07: -10000.000000
23.07/23.11	c satzilla running mxc-sr08 ...

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273221-1303600608/watcher-3273221-1303600608 -o /tmp/evaluation-result-3273221-1303600608/solver-3273221-1303600608 -C 2400 -W 1300 -M 7680 HOME/SATzilla2009_C HOME/instance-3273221-1303600608.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.60 2/180 14685
/proc/meminfo: memFree=16878348/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=0 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 162 0 0 0 0 0 0 0 20 0 1 0 550291497 2187264 114 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 114 97 400 0 131 0

[startup+0.105808 s]
/proc/loadavg: 0.00 0.00 0.60 2/180 14685
/proc/meminfo: memFree=16878348/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=0 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 162 0 0 0 0 0 0 0 20 0 1 0 550291497 2187264 114 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+0.200801 s]
/proc/loadavg: 0.00 0.00 0.60 2/180 14685
/proc/meminfo: memFree=16878348/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=0 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 162 0 0 0 0 0 0 0 20 0 1 0 550291497 2187264 114 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+0.300776 s]
/proc/loadavg: 0.00 0.00 0.60 2/180 14685
/proc/meminfo: memFree=16878348/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=0 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 162 0 0 0 0 0 0 0 20 0 1 0 550291497 2187264 114 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+0.700702 s]
/proc/loadavg: 0.00 0.00 0.60 2/180 14685
/proc/meminfo: memFree=16878348/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=0 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 162 0 0 0 0 0 0 0 20 0 1 0 550291497 2187264 114 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+1.50055 s]
/proc/loadavg: 0.00 0.00 0.60 3/182 14687
/proc/meminfo: memFree=16850060/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=0 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 162 0 0 0 0 0 0 0 20 0 1 0 550291497 2187264 114 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 114 97 400 0 131 0
[pid=14686] ppid=14685 vsize=35656 CPUtime=1.49 cores=5,7
/proc/14686/stat : 14686 (march_dl2004) R 14685 14685 14643 0 -1 4202496 31284 0 0 0 144 5 0 0 25 0 1 0 550291497 36511744 5456 33554432000 134512640 134996440 4291460320 18446744073709551615 134527835 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14686/statm: 8914 5456 75 119 0 8793 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 37792

[startup+3.10025 s]
/proc/loadavg: 0.16 0.03 0.61 3/182 14687
/proc/meminfo: memFree=16851248/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=0 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 162 0 0 0 0 0 0 0 20 0 1 0 550291497 2187264 114 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 114 97 400 0 131 0
[pid=14686] ppid=14685 vsize=40196 CPUtime=3.09 cores=5,7
/proc/14686/stat : 14686 (march_dl2004) R 14685 14685 14643 0 -1 4202496 32405 0 0 0 304 5 0 0 25 0 1 0 550291497 41160704 6577 33554432000 134512640 134996440 4291460320 18446744073709551615 134565255 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14686/statm: 10049 6577 75 119 0 9928 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 42332

[startup+6.30067 s]
/proc/loadavg: 0.16 0.03 0.61 5/194 14711
/proc/meminfo: memFree=16776252/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=2136 CPUtime=4.99 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 186 32503 0 0 0 0 494 5 18 0 1 0 550291497 2187264 127 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 534 127 108 400 0 131 0
[pid=14711] ppid=14685 vsize=20756 CPUtime=1.29 cores=5,7
/proc/14711/stat : 14711 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 5764 0 0 0 128 1 0 0 22 0 1 0 550291997 21254144 4884 33554432000 134512640 135078026 4286908128 18446744073709551615 134561546 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14711/statm: 5189 4884 57 139 0 5048 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 22892

[startup+12.7005 s]
/proc/loadavg: 0.75 0.16 0.65 5/193 14716
/proc/meminfo: memFree=16769004/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=20404 CPUtime=12.68 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) R 14683 14685 14643 0 -1 4202496 7142 44331 0 0 131 0 1128 9 19 0 1 0 550291497 20893696 4745 33554432000 134512640 136149437 4294889392 18446744073709551615 134532697 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/14685/statm: 5101 4745 136 400 0 4698 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 20404

[startup+25.5011 s]
/proc/loadavg: 1.25 0.29 0.68 5/194 14725
/proc/meminfo: memFree=16723980/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=20756 CPUtime=2.37 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 5804 0 0 0 237 0 0 0 25 0 1 0 550293808 21254144 4924 33554432000 134512640 135078026 4286981712 18446744073709551615 134561546 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 5189 4924 57 139 0 5048 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 53532

[startup+51.1004 s]
/proc/loadavg: 2.19 0.59 0.77 5/194 14726
/proc/meminfo: memFree=16668404/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=42308 CPUtime=27.98 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 11908 0 0 0 2797 1 0 0 25 0 1 0 550293808 43323392 10404 33554432000 134512640 135078026 4286981712 18446744073709551615 134534478 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 10577 10404 73 139 0 10436 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 75084

[startup+102.301 s]
/proc/loadavg: 3.32 1.17 0.96 5/194 14727
/proc/meminfo: memFree=16614808/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=80876 CPUtime=79.19 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 21442 0 0 0 7916 3 0 0 25 0 1 0 550293808 82817024 19938 33554432000 134512640 135078026 4286981712 18446744073709551615 134533771 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 20219 19938 73 139 0 20078 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 113652

[startup+162.301 s]
/proc/loadavg: 3.78 1.70 1.15 5/194 14729
/proc/meminfo: memFree=16581288/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=106572 CPUtime=139.18 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 27902 0 0 0 13913 5 0 0 25 0 1 0 550293808 109129728 26398 33554432000 134512640 135078026 4286981712 18446744073709551615 134534318 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 26643 26398 73 139 0 26502 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 139348

[startup+222.307 s]
/proc/loadavg: 3.92 2.12 1.33 5/194 14730
/proc/meminfo: memFree=16567608/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=118080 CPUtime=199.18 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 30774 0 0 0 19912 6 0 0 25 0 1 0 550293808 120913920 29270 33554432000 134512640 135078026 4286981712 18446744073709551615 134534215 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 29520 29270 73 139 0 29379 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 150856

[startup+282.301 s]
/proc/loadavg: 3.97 2.46 1.49 5/194 14732
/proc/meminfo: memFree=16531616/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=145164 CPUtime=259.18 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 37236 0 0 0 25909 9 0 0 25 0 1 0 550293808 148647936 35732 33554432000 134512640 135078026 4286981712 18446744073709551615 134534215 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 36291 35732 73 139 0 36150 0
Current children cumulated CPU time (s) 282.26
Current children cumulated vsize (KiB) 177940

[startup+342.301 s]
/proc/loadavg: 4.04 2.75 1.65 5/194 14734
/proc/meminfo: memFree=16523484/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=145164 CPUtime=319.19 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 37244 0 0 0 31909 10 0 0 25 0 1 0 550293808 148647936 35740 33554432000 134512640 135078026 4286981712 18446744073709551615 134534454 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 36291 35740 73 139 0 36150 0
Current children cumulated CPU time (s) 342.27
Current children cumulated vsize (KiB) 177940

[startup+402.301 s]
/proc/loadavg: 4.01 2.97 1.79 5/194 14735
/proc/meminfo: memFree=16493572/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=162684 CPUtime=379.19 cores=5,7

################
# More data... #
################

/proc/14723/statm: 42466 41840 73 139 0 42325 0
Current children cumulated CPU time (s) 642.28
Current children cumulated vsize (KiB) 202640

[startup+702.301 s]
/proc/loadavg: 4.02 3.63 2.39 5/194 14743
/proc/meminfo: memFree=16444944/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=171500 CPUtime=679.2 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 43675 0 0 0 67908 12 0 0 25 0 1 0 550293808 175616000 42171 33554432000 134512640 135078026 4286981712 18446744073709551615 134534502 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 42875 42171 73 139 0 42734 0
Current children cumulated CPU time (s) 702.28
Current children cumulated vsize (KiB) 204276

[startup+762.301 s]
/proc/loadavg: 4.01 3.69 2.49 5/194 14745
/proc/meminfo: memFree=16443532/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=171632 CPUtime=739.21 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 43722 0 0 0 73909 12 0 0 25 0 1 0 550293808 175751168 42218 33554432000 134512640 135078026 4286981712 18446744073709551615 134534619 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 42908 42218 73 139 0 42767 0
Current children cumulated CPU time (s) 762.29
Current children cumulated vsize (KiB) 204408

[startup+822.301 s]
/proc/loadavg: 4.00 3.75 2.58 5/194 14746
/proc/meminfo: memFree=16442224/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=172948 CPUtime=799.2 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 43963 0 0 0 79908 12 0 0 25 0 1 0 550293808 177098752 42459 33554432000 134512640 135078026 4286981712 18446744073709551615 134534215 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 43237 42459 73 139 0 43096 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 205724

[startup+882.307 s]
/proc/loadavg: 4.08 3.81 2.68 5/194 14748
/proc/meminfo: memFree=16435468/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=179552 CPUtime=859.21 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 45577 0 0 0 85908 13 0 0 25 0 1 0 550293808 183861248 44073 33554432000 134512640 135078026 4286981712 18446744073709551615 134534350 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 44888 44073 73 139 0 44747 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 212328

[startup+942.301 s]
/proc/loadavg: 4.03 3.84 2.76 5/194 14750
/proc/meminfo: memFree=16434440/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=179852 CPUtime=919.2 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 45649 0 0 0 91907 13 0 0 25 0 1 0 550293808 184168448 44145 33554432000 134512640 135078026 4286981712 18446744073709551615 134533771 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 44963 44145 73 139 0 44822 0
Current children cumulated CPU time (s) 942.28
Current children cumulated vsize (KiB) 212628

[startup+1002.3 s]
/proc/loadavg: 4.01 3.87 2.83 5/194 14751
/proc/meminfo: memFree=16430788/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=181324 CPUtime=979.21 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 45909 0 0 0 97908 13 0 0 25 0 1 0 550293808 185675776 44405 33554432000 134512640 135078026 4286981712 18446744073709551615 134534329 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 45331 44405 73 139 0 45190 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 214100

[startup+1062.3 s]
/proc/loadavg: 4.00 3.89 2.90 5/194 14753
/proc/meminfo: memFree=16428516/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=182348 CPUtime=1039.21 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 46148 0 0 0 103908 13 0 0 25 0 1 0 550293808 186724352 44644 33554432000 134512640 135078026 4286981712 18446744073709551615 134534925 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 45587 44644 73 139 0 45446 0
Current children cumulated CPU time (s) 1062.29
Current children cumulated vsize (KiB) 215124

[startup+1122.3 s]
/proc/loadavg: 4.00 3.90 2.97 5/194 14754
/proc/meminfo: memFree=16419660/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=191548 CPUtime=1099.21 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 48391 0 0 0 109907 14 0 0 25 0 1 0 550293808 196145152 46887 33554432000 134512640 135078026 4286981712 18446744073709551615 134534249 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 47887 46887 73 139 0 47746 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 224324

[startup+1182.3 s]
/proc/loadavg: 4.00 3.92 3.03 5/194 14756
/proc/meminfo: memFree=16418628/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=191880 CPUtime=1159.21 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 48469 0 0 0 115907 14 0 0 25 0 1 0 550293808 196485120 46965 33554432000 134512640 135078026 4286981712 18446744073709551615 134534215 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 47970 46965 73 139 0 47829 0
Current children cumulated CPU time (s) 1182.29
Current children cumulated vsize (KiB) 224656

[startup+1242.3 s]
/proc/loadavg: 4.00 3.93 3.09 5/194 14758
/proc/meminfo: memFree=16414228/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=192520 CPUtime=1219.21 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 48584 0 0 0 121907 14 0 0 25 0 1 0 550293808 197140480 47080 33554432000 134512640 135078026 4286981712 18446744073709551615 134534329 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 48130 47080 73 139 0 47989 0
Current children cumulated CPU time (s) 1242.29
Current children cumulated vsize (KiB) 225296



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 3.94 3.14 4/191 14760
/proc/meminfo: memFree=16439136/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=195328 CPUtime=1276.92 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 49219 0 0 0 127677 15 0 0 25 0 1 0 550293808 200015872 47715 33554432000 134512640 135078026 4286981712 18446744073709551615 134534215 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 48832 47715 73 139 0 48691 0
Current children cumulated CPU time (s) 1300
Current children cumulated vsize (KiB) 228104

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.00 3.94 3.14 4/191 14760
/proc/meminfo: memFree=16439136/32951124 swapFree=67111528/67111528
[pid=14685] ppid=14683 vsize=32776 CPUtime=23.08 cores=5,7
/proc/14685/stat : 14685 (SATzilla2009_C) S 14683 14685 14643 0 -1 4202496 12577 51923 0 0 970 2 1323 13 25 0 1 0 550291497 33562624 7956 33554432000 134512640 136149437 4294889392 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 5 0 0 0
/proc/14685/statm: 8194 7956 221 400 0 7791 0
[pid=14723] ppid=14685 vsize=195328 CPUtime=1276.92 cores=5,7
/proc/14723/stat : 14723 (mxc-sr08) R 14685 14685 14643 0 -1 4202496 49219 0 0 0 127677 15 0 0 25 0 1 0 550293808 200015872 47715 33554432000 134512640 135078026 4286981712 18446744073709551615 134534215 0 0 8392704 0 0 0 0 17 5 0 0 0
/proc/14723/statm: 48832 47715 73 139 0 48691 0
Current children cumulated CPU time (s) 1300
Current children cumulated vsize (KiB) 228104

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14685 and gives
#  childrusage.ru_utime.tv_sec=22
#  childrusage.ru_utime.tv_usec=935513
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=170974
# CPU time returned by wait4() is 23.1065
# while last known CPU time is 1300
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300
CPU user time (s): 1299.7
CPU system time (s): 0.3
CPU usage (%): 99.9989
Max. virtual memory (cumulated for all children) (KiB): 228104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 22.9355
system time used= 0.170974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 64500
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13
involuntary context switches= 81

runsolver used 2.01769 second user time and 5.08023 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-24 01:16:49
IDJOB=3273221
IDBENCH=71270
IDSOLVER=1675
FILE ID=node110/3273221-1303600608
RUNJOBID= node110-1303600605-14664
PBS_JOBID= 13150594
Free space on /tmp= 71924 MiB

SOLVER NAME= SAT09 reference solver: SATzilla2009_C 2009-03-22
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2400c266431g10.cnf
COMMAND LINE= HOME/SATzilla2009_C BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273221-1303600608/watcher-3273221-1303600608 -o /tmp/evaluation-result-3273221-1303600608/solver-3273221-1303600608 -C 2400 -W 1300 -M 7680  HOME/SATzilla2009_C HOME/instance-3273221-1303600608.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 885d1d8595262b8f0aa94d123211b47c
RANDOM SEED=1703867344

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16878504 kB
Buffers:       2316152 kB
Cached:       13116860 kB
SwapCached:          0 kB
Active:        8077684 kB
Inactive:      7427696 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16878504 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           67336 kB
Writeback:           0 kB
AnonPages:       71892 kB
Mapped:          15612 kB
Slab:           504460 kB
PageTables:       5184 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   215644 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71856 MiB
End job on node110 at 2011-04-24 01:38:31