Make your websites run faster, automatically -- try mod_pagespeed for Apache

Webmaster Level: All

Last year, as part of Google’s initiative to make the web faster, we introduced Page Speed, a tool that gives developers suggestions to speed up web pages. It’s usually pretty straightforward for developers and webmasters to implement these suggestions by updating their web server configuration, HTML, JavaScript, CSS and images. But we thought we could make it even easier -- ideally these optimizations should happen with minimal developer and webmaster effort.

So today, we’re introducing a module for the Apache HTTP Server called mod_pagespeed to perform many speed optimizations automatically. We’re starting with more than 15 on-the-fly optimizations that address various aspects of web performance, including optimizing caching, minimizing client-server round trips and minimizing payload size. We’ve seen mod_pagespeed reduce page load times by up to 50% (an average across a rough sample of sites we tried) -- in other words, essentially speeding up websites by about 2x, and sometimes even faster.

Comparison of the AdSense blog site with and without mod_pagespeed

Here are a few simple optimizations that are a pain to do manually, but that mod_pagespeed excels at:

• Making changes to the pages built by the Content Management Systems (CMS) with no need to make changes to the CMS itself,
• Recompressing an image when its HTML context changes to serve only the bytes required (typically tedious to optimize manually), and
• Extending the cache lifetime of the logo and images of your website to a year, while still allowing you to update these at any time.

We’re working with Go Daddy to get mod_pagespeed running for many of its 8.5 million customers. Warren Adelman, President and COO of Go Daddy, says:

"Go Daddy is continually looking for ways to provide our customers the best user experience possible. That's the reason we partnered with Google on the 'Make the Web Faster' initiative. Go Daddy engineers are seeing a dramatic decrease in load times of customers' websites using mod_pagespeed and other technologies provided. We hope to provide the technology to our customers soon - not only for their benefit, but for their website visitors as well.”

We’re also working with Cotendo to integrate the core engine of mod_pagespeed as part of their Content Delivery Network (CDN) service.

mod_pagespeed integrates as a module for the Apache HTTP Server, and we’ve released it as open-source for Apache for many Linux distributions. Download mod_pagespeed for your platform and let us know what you think on the project’s mailing list. We hope to work with the hosting, developer and webmaster community to improve mod_pagespeed and make the web faster.

Richard Rabbat, Product Manager, ‘Make the Web Faster’ initiative

Rich snippets for shopping sites

Webmaster Level: All

In time for the holiday season, we now support rich snippets for shopping (e-commerce) sites! As many of you know, rich snippets are search results that have been enhanced using structured data from your web pages. Our new format shows price, availability, and product reviews on pages offering a product for sale. Here’s a result for [office lava lamp]:

As a webmaster, there are two ways that you can provide the information needed for product rich snippets to show up for your site, both described on the Product rich snippets help page:

Option 1: Provide a Merchant Center feed.

Many sites already provide Merchant Center feeds for use in Google Product Search, which means that most of the work needed for rich snippets is already done. For Google to make use of Merchant Center feeds for rich snippets, you should also use the rel=”canonical” link element on your product pages. By adding rel=”canonical” to your pages, Google can match the URLs in your feed to the pages found by our crawler.

Update on November 4, 2010: In order to have your product review information in your rich snippets, you can submit your product ratings directly in your feed, or you can work with one of our reviews partners to submit this information. If you work with a partner, your reviews information will appear in rich snippets, and shoppers on Google Product Search will be able to see your full-length reviews on relevant product pages, branded with your logo.

Option 2: Add markup to your site.

If prices for your products tend to change only infrequently, then adding markup is an alternative method to provide product data for rich snippets. We’ve updated our product markup format to allow a variety of different types of shopping sites to participate. In addition to the Google format, we support two other standards: the hProduct microformat and GoodRelations. You can use the rich snippets testing tool to test your markup and make sure it’s being parsed correctly.

This feature is currently available to merchants located in the US, but we will be rolling it out in more markets soon. Additionally, there are a number of rich snippets formats that can be used world-wide in various languages—make your snippets compelling and useful! Should you have any questions about the use of rich snippets, check out our FAQs and feel free to post in our Webmaster Help Forum.

Q&A

Which should I provide -- a Merchant Center feed or markup?

For most merchants, providing a Merchant Center feed is the best bet. That way your product prices and availability are updated quickly, and the data can be shown in rich snippets as well as in other applications like Google Shopping and Product Ads. If prices and availability change only infrequently, and you don’t want to set up a feed, then adding markup is also a valid option.

If I add markup to my site, will Google show product rich snippets for my pages?

We can’t guarantee that providing a feed or adding markup will result in rich snippets being shown. Note also that it may take a few weeks after providing data for rich snippets to be shown. If you mark up your pages, we encourage you to make sure that the data is parsed correctly by Google by using the rich snippets testing tool. The testing tool updates are rolling out over the next few days, so in this interim period the testing tool may not show previews for some types of markup.

I’ve already done reviews markup for my product offer pages. Should I add product/offer markup as well?

Yes, absolutely. Rich snippets are shown if the information provided accurately represents the main focus of the page. Therefore, for product pages you should add markup using the relevant offer/product fields which can include nested reviews.

Written by Nitin Shetti and Mircea Ciurumelea, Search Quality team

Best practices for running multiple sites

Webmaster Level: All

Running a single compelling, high quality site can be time- and resource-consuming, not to mention the creativity it requires to make the site a great one. At times–particularly when it comes to rather commercial topics like foreign currency exchange or online gambling–we see that some webmasters try to compete for visibility in Google search results with a large

number of sites on the same topic. There are a few things to keep in mind when considering a strategy like this for sites that you want to have listed in our search results.

Some less creative webmasters, or those short on time but with substantial resources on their hands, might be tempted to create a multitude of similar sites without necessarily adding unique information to any of these. From a user’s perspective, these sorts of repetitive sites can constitute a poor user experience when visible in search results. Luckily, over time our algorithms have gotten pretty good at recognizing similar content so as to serve users with a diverse range of information. We don’t recommend creating similar sites like that; it’s not a good use of your time and resources.

If all of your sites offer essentially the same content, additional sites are not contributing much to the Internet.

While you’re free to run as many sites as you want, keep in mind that users prefer to see unique and compelling content. It is a good idea to give each site its own content, personality and function. This is true of any website, regardless of whether it’s a single-page hobby-site or part of a large portfolio. When you create a website, try to add something new or some value to the Internet; make something your users have never seen before, something that inspires and fascinates them, something they can’t wait to recommend to their friends.

When coming up with an idea for a website, scan the web first. There are many websites dealing with common and popular services like holiday planning, price comparisons or foreign exchange currency trading. It frequently doesn’t make sense to reinvent the wheel and compete with existing broad topic sites. It’s often more practical and rewarding to focus on smaller or niche topics where your expertise is best and where competition for user attention might be less fierce.

A few webmasters choose to focus their resources on one domain but make use of their domain portfolio by creating a multitude of smaller sites linking to it. In some situations these sites may be perceived as doorways. Without value of their own, these doorway sites are unlikely to stand the test of time in our search results. If you registered several domains but only want to focus on one topic, we recommend you create unique and compelling content on each domain or simply 301 redirect all users to your preferred domain. Think of your web endeavour as if it were a restaurant: You want each dish to reflect the high quality of the service you provide; repeat the same item over and over on your menu and your restaurant might not do so well. Identify and promote your strength or uniqueness. Ask yourself the following questions: What makes you better than the competition? What new service do you provide that others don’t? What makes your sites unique and compelling enough to make users want to revisit them, link to them or even recommend them to their friends?

We suggest not spreading out your efforts too broadly, though. It can be difficult to maintain multiple sites while keeping the content fresh and engaging. It’s better to have one or a few good sites than a multitude of shallow, low value-add sites. As always, we encourage you to share your thoughts via comments as well as by contributing to the Google Webmaster community.

Posted by Tomer Honen & Kaspar Szymanski, Search Quality Team

Website clinic: Call for submissions

Webmaster Level: Beginner

Cross-posted on the Google Grants Blog

Googlers often participate in live site clinics at conferences, giving advice about real-world sites and allowing webmasters to learn by example. Now Google’s Search Quality team is excited to host an online site clinic right here on this blog. In future posts, we’ll be looking at some user-submitted examples and offering broad advice that you can apply to your site.

This site clinic will focus on non-profit organizations, but chances are that our advice will benefit small business and government sites as well. If you work for a non-profit and would like us to consider your site, read on for submission instructions.

How to Submit Your Site:

To register your site for our clinic, fill in the information requested on our form. From there, we will determine trends and share corresponding best practices to improve site quality and user experience. Our analysis will be available in a follow-up post, and will adhere to public standards of webmaster guidance. Please note that by submitting your site, you permit us to use your site as an example in our follow-up site clinic posts.

We have a few guidelines:

1. Your site must belong to an officially registered non-profit organization.
2. In order to ensure that you’re the site owner, you must verify ownership of your site in Google Webmaster Tools. You can do that (for free) here.
3. To the best of your ability, make sure your site meets our webmaster quality guidelines. We will be using the same principles as a basis for our analysis.

All set? Submit your site for consideration here.

The site clinic goes live today, and submissions will be accepted until Monday, November 8, 2010. Stay tuned for some useful webmaster tips when we review the sites.

Posted by Alexi Douvas and Jen Lee, Search Quality Team

Optimizing sites for TV

Webmaster Level: All

Just as mobile phones make your site accessible to people on the go, Google TV makes your site easily viewable to people lounging on their couch. Google TV is a platform that combines your current TV programming with the web and, before long, more apps. It’s the web you love, with the TV you love, all available on the sofa made for you. Woohoo!

Because Google TV has a fully functioning web browser built in, users can easily visit your site from their TV. Current sites should already work, but you may want to provide your users with an enhanced TV experience -- what's called the “10-foot UI” (user interface). They'll be several feet away from the screen, not several inches away, and rather than a mouse on their desktop, they'll have a remote with a keyboard and a pointing device.

For example, here’s YouTube for desktop users versus what we’re calling “YouTube Leanback” -- our site optimized for large screens:

YouTube desktop version on the left, YouTube Leanback on the right

See our Spotlight Gallery for more examples of TV-optimized sites.

What does "optimized for TV" mean?

It means that, for the user sitting on their couch, your site on their TV is an even more enjoyable experience:

• Text is large enough to be viewable from the sofa-to-TV distance.
• Site navigation can be performed through button arrows on the remote (a D-pad), rather than mouse/touchpad usage
• Selectable elements provide a visual queue when selected (when you’re 10 feet away, it needs to be really, really obvious what selections are highlighted)
• and more...

How can webmasters gain a general idea of their site’s appearance on TV?

First, remember that appearance alone doesn't incorporate whether your site can be easily navigated by TV users (i.e. users with a remote rather than a mouse). With that said, here’s a quick workaround to give you a ballpark idea of how your site looks on TV. (For more in-depth info, please see the “Design considerations” in our optimization guide.)

1. On a large monitor, make your window size 1920 x 1080.
2. In a browser, visit your site at full screen.
3. Zoom the browser to 1.5x the normal size. This is performed in different ways with different keyboards. For example, in Chrome if you press ctrl+ (press ctrl and + at the same time) twice, that’ll zoom the browser to nearly 1.5x the initial size.
4. Move back 3 x (the distance between you and the monitor).
5. Check out your site!

And don’t forget, if you want to see your site with the real thing, Google TV enabled devices are now available in stores.

How can you learn more?

Our team just published a developer site, with TV optimization techniques, at code.google.com/tv/web/.

Written by Maile Ohye, Developer Programs Tech Lead

Webmaster Tools - Links to your site updated

Webmaster Level: All

The "Links to your site" feature in Webmaster Tools is now updated to show you which domains link the most to your site, in addition to other improvements. On the overview page you'll notice that there are three main sections: the domains linking most to your site, the pages on your site with the most links, and a sampling of the anchor text external sites are using when they link to your site.


Who links the most
Clicking the “More »” link under the “Who links the most” section will take you to a new view that shows a listing of all the domains that link to your site. Each domain in the list can be expanded to display a sample of pages from your site which are linked to by that domain.


The "More »" link under each specific domain lists all the pages linked to by that domain. At the top of the page there's a total count of links from that domain and a total count of your site's pages linked to from that domain.


Your most linked content
If you drill into the “Your most linked content” view from the overview page, you’ll see a listing of all your site’s most important linked pages. There's also a link count for each page as well as a count of domains linking to that page. Clicking any of the pages listed will expand the view to show you examples of the leading domains linking to that page and the number of links to the given page from each domain listed. The data used for link counts and throughout the "Links to your site" feature is more comprehensive now, including links redirected using 301 or 302 HTTP redirects.


Each page listed in the "All linked pages" view has an associated "More »" link which displays all the domains linking to that specific page on your site.


Each domain listed leads to a report of all the pages from that domain linking to your specific page.


We hope the updated “Links to your site” feature in Webmaster Tools will help you better understand where the links to your site are coming from and improve your ability to track changes to your site’s link profile. Please post any comments you have about this updated feature or post your questions in the Webmaster Help Forum. We appreciate your feedback since it helps us to continue to improve the functionality of Webmaster Tools.

Posted by Jonathan Simon, Webmaster Trends Analyst

Webmaster Tools: Updates to Search queries, Parameter handling and Messages

Webmaster level: All

We've just released updates to several features in Webmaster Tools to provide you with more detail and more control of how your site appears in search results.

Search queries: Time does not stand still and neither should your site. With that in mind we've added a "Change" column next to the impressions, clicks, clickthrough rate (CTR) and position columns, making it easier to identify trends for each of these important metrics. The change column is tied to the date range you specify, which should help when you're trying to pinpoint when a particular change occurred.



Each query listed in Search queries now links to a query details page which includes a graph of impressions and clicks for that specific query, providing a quick visual of its performance in the search results over time. Below the graph is a table listing of the pages returned in search results for that query, along with impressions, clicks and CTR. Each column in the table is sortable, offering a quick way to re-sort the data based on what's most interesting to you. If you'd rather use your own favorite tool to slice and dice the data you can use the "Download this table" link to export all the information from the main Search queries page or from each individual query details page.



Better Parameter Handling: We've moved this feature under its own tab in the Settings section of Webmaster Tools, and introduced a new action to manage parameters. When we introduced Parameter Handling last year, we allowed you to specify URL parameters and whether they should be ignored or not. When you choose to ignore a parameter, you are telling us that this parameter has no impact on the displayed content. For example, consider a session id parameter, like “sid” in the following URLs:

http://example.com/product.php?item=swedish-fish
http://example.com/product.php?item=swedish-fish&sid=1234
http://example.com/product.php?item=swedish-fish&sid=5678

Assuming that these three URLs display exactly the same product page for tasty Swedish fish candy, Google only needs to crawl and index one of them. You can simply select action “Ignore” for parameter “sid” in Webmaster Tools and Google will just crawl and index one of these URLs, avoiding duplicates.

In addition to the old functionality, you now have the ability to choose a specific value among the known values for a given URL parameter. This is important when a parameter is relevant to the content, but different values of this parameter lead to similar pages. For example, consider a sorting parameter, like “sort-by” in the following URLs:

http://example.com/shop.php?category=candy&sort-by=asc-price&page=1
http://example.com/shop.php?category=candy&sort-by=desc-price&page=1
http://example.com/shop.php?category=candy&sort-by=asc-price&page=2
http://example.com/shop.php?category=candy&sort-by=desc-price&page=2

These four URLs show products in the candy category. There are enough items in this category to fill two pages, and the products shown can be sorted by price, in ascending or descending order. Selecting action “Ignore” for parameter “sort-by” would be incorrect and could potentially limit our indexing of the site. This is because, after ignoring “sort-by”, we would consider the first two URLs equivalent and may choose to index the URL with ascending sort order. We would also consider the last two URLs equivalent and may choose to index the URL with descending sort order. In this scenario, we would be indexing the candy category inconsistently, with some candy products appearing in both of the pages selected for the index, while other candy products not appearing in either of them. The right solution comes from the new action “Use specific value” now available in Webmaster Tools. To avoid duplicates but still keep our indexing consistent, you can simply select action “Use specific value” for parameter “sort-by” and choose one of the valid values, say “asc-price”. After this, our indexing would be fully consistent, as we would focus only on the pages with products sorted by ascending price.



Messages: Some sites receive lots of messages in the Webmaster Tools Message Center. With this update we've added the ability to "star" specific messages that you deem important. There's now a separate "Starred" view where you can see all the messages that you’ve starred, making tracking and finding the most important messages for your site a breeze.



We hope these updates make Webmaster Tools even more useful for your site. Please post a comment if you have feedback on any of these updates; or if you have questions, post them in our Webmaster Help Forum.

Posted by Jonathan Simon, Webmaster Trends Analyst