The Search for Secret Google Services

Since stumbling across Google Base almost a month before its release and more recently uncovering some more secret Google services, several people have asked how I go about finding these new services. By way of a response, here’s a quick guide to just some of the many different ways you could use to try and find new services that Google are working on.

1. Finding a new service

The details of new services can sometimes be leaked accidentally. Other times, they’re kept secret right up until their release. Here are a few things to look out for if you want to discover new services before anyone outside the Googleplex has even heard about them:

* New domain names

While Google tends to use their google.com domain to host new services, they often register new domain names well in advance of new services being released in order to stop domain cybersquatters snapping them up first. Gary Price has made a couple of posts about this recently. Whilst reverse DNS lookups can help, don’t get fooled into thinking that Google owns all the domain names that are resolving to its IP address ranges or servers. New domains can sometimes give useful hints about new services but can’t be relied upon. (Google has owned GBrowser.com for years, yet we still haven’t seen an official release.)

* New subdomains

When I found the base.google.com subdomain, I simply used a script and a large list of around 65,000 English words to send requests in the format *.google.com to see which ones resolved. It’s probably also worth checking subdomains in the format of *.l.google.com as sometimes these are active well before the normal subdomain, as Garett Rogers pointed out when he found the writely.l.google.com subdomain was resolving back in June 2006 (whereas the writely.google.com subdomain still doesn’t resolve at the time of writing this).

* New subfolders

Google has also been known to just use subfolders instead of subdomains when launching new services, including Google Notebook. Using a similar word list technique as I did for sniffing out subdomains, you could query all Google’s domains and subdomains for new subfolders. Be warned though – if you send too many requests to Google’s servers in a short period of time, you may get temporarily blocked!

* New Google Account service names

Back in May, I tried a new approach to finding new services. I’d noticed that services requiring a Google Account used a series of similar URLs for creating new accounts and signing in. By appending various words to the end of these pages – i.e. https://www.google.com/accounts/Login?se... – I was able to find several new services such as Google Weaver (known back then as M Scrapbook), Google RS2, SSD, Mobile Download Console and LH2 (now known to be Picasa Web Albums). More recently, I tried a similar approach with the sandbox.google.com version of Google Accounts and found even more services , which Google swiftly removed. (I try to maintain a list of these Google Account service names on my website.)

* Clues in JavaScript / HTML code

Another technique often used by Garett Rogers involves sifting through the JavaScript source code used by Google services such as Gmail and Google Calendar. This can reveal new domains, subdomains, links, labels and other hints at new services or features for existing services.

* Changes to Google’s robots.txt files

Google try their best to not index their own SERPs, so when they create a new service that could clutter up their index, they’ll usually add a new entry to their robots.txt file. (One of the most recent additions to the file was www.google.com/call, as Garett Rogers discovered.) By scheduling a simple script, you could easily monitor this file and be alerted of any changes. Don’t forget that each Google domain and subdomain may have its own robots.txt file, so to do this thoroughly you would need to monitor all those for changes too!

* Changes to Blogger profile pages

Since Google don’t use standard naming conventions for their official blogs, it’s hard to detect when a new official blog has been created. One of the best (if not only) ways to check if a blog is official is to see whether it appears on any Blogger profiles belonging to Googlers (such as Eric Case, for example). Quite often, the titles of new official Google blogs appear on these profiles pages before they (or their related services) are officially released. Monitoring these pages for changes could give clues about the names of any new services.