Five years ago, the social gaming company Zynga was cruising along with a fairly standard IT infrastructure. Servers were racked and stacked in a retail data center where Zynga rented space. Customer demand for games like Zynga Poker, launched in 2007, was being met.
Then along came FarmVille. After the game’s 2009 release, 10 million users were hitting FarmVille servers within six weeks, and 25 million within five months.
Read the comments on this post
Consider the tech it takes to back the search box on Google’s home page: behind the algorithms, the cached search terms, and the other features that spring to life as you type in a query sits a data store that essentially contains a full-text snapshot of most of the Web. While you and thousands of other people are simultaneously submitting searches, that snapshot is constantly being updated with a firehose of changes. At the same time, the data is being processed by thousands of individual server processes, each doing everything from figuring out which contextual ads you will be served to determining in what order to cough up search results.
The storage system backing Google’s search engine has to be able to serve millions of data reads and writes daily from thousands of individual processes running on thousands of servers, can almost never be down for a backup or maintenance, and has to perpetually grow to accommodate the ever-expanding number of pages added by Google’s Web-crawling robots. In total, Google processes over 20 petabytes of data per day.
Read the comments on this post