At the intersection of technology, finance and the Pacific Rim.

Wednesday, September 23, 2009

The Technology behind Facebook

Facebook--how it works. that is the subject of an interview with the CTO of the Company by the Technology Review. How do you scale a system that is so personalized--300MN users, 1.2MN photos per second.

He notes of the internally developed system that can serve up in near real time customized information:

Your best weapon in most computer science problems is caching. But if, like the Facebook home page, it's basically updating every minute or less than a minute, then pretty much every time I load it, it's a new page, or at least has new content. That kind of throws the whole caching idea out the window. Doing things in or near real time puts a lot of pressure on the system because the live-ness or freshness of the data requires you to query more in real time.

We've built a couple systems behind that. One of them is a custom in-memory database that keeps track of what's happening in your friends network and is able to return the core set of results very quickly, much more quickly than having to go and touch a database, for example. And then we have a lot of novel system architecture around how to shard and split out all of this data. There's too much data updated too fast to stick it in a big central database. That doesn't work. So we have to separate it out, split it out, to thousands of databases, and then be able to query those databases at high speed.


Anonymous Anonymous said...

This is a topic that is near to my heart...
Thank you! Where are your contact details though?

Here is my web page top 10 products

4:22 PM  
Anonymous Anonymous said...

Quality posts is the crucial to invite the viewers to pay a quick visit the site,
that's what this web page is providing.

Also visit my page: special compilation

1:28 AM  

Post a Comment

Links to this post:

Create a Link

<< Home