Pages

Tuesday, January 27, 2009

Sharding

Joe Gregorio's article on sharding counters highlights an example of the counter(heh ;)intuitive techniques that work well on applications with large data sets. "Large" meaning "too big to fit into RAM on a single machine."

One of the reasons sharding works so well is that accessing another computer's RAM over a fast network is orders of magnitude faster than accessing your own disk. (memcached also takes advantage of these constraints)

Here's a presentation with some more details and examples of sharding in appengine:

App Engine Google

2 comments:

  1. Thank you for helpful review. It was easy to read, but I'd like to add that if your business needs to be updated try software development services.

    ReplyDelete
  2. Thanks for the post. It was very interesting and meaningful. I really appreciate it! Keep updating stuff like this.
    Plant Engineering Services
    Offshore Engineering Services India
    Reverse Engineering Services

    ReplyDelete