Tip:

I messed around with my favicon.ico (see my first post) and didn't know what I was doing for a minute.  I thought I created the file correctly (I did) but it wasn't updating.  To ensure it updates correctly copy the favicon.ico to the following:

1.  To the root of the website  (for browser compatibility and avoid errors in the logs)
2. Copy it to files/ as is
3. Make another copy in files/ named with your theme (for example, garland_favicon.ico)

I'm not sure if #2 is absolutely necessary, but I think that will make things easier if you have multiple themes.