About Citizizen Science

This blog is a summary of various news items and pointers on how scientific research is being transformed by new web 2.0 tools, web services and Service Oriented Architectures (SOA). Not only will this transform science through the development of cyber-infrastructure and eSceince but it will enable greater participation by students and the general public in the scientific process in the analysis of data and control of instruments

Wednesday, April 7, 2010

Cool new Middleware from Twitter for distributed data

http://bit.ly/a6ZwyV

"Twitter last night offered up the code for Gizzard, an open-source framework for accessing distributed data quickly, which Twitter built to help the site deal with the millions of requests it gets from users needing access to their friends and their own tweets. It could become an important component of building out web-based businesses, much likeFacebook’s Cassandra project has swept through the ranks of webscale startups and even big companies.
Gizzard is a middleware networking service that sits between the front-end web site client and the database and attempts to divide and replicate data in storage in intelligent ways that allows it to be accessed quickly by the site. Gizzard’s function it to take the requests coming in through the fire hose and allocate the stream of requests across multiple databases without slowing things down. It’s also fault-tolerant, which means if one section of data is compromised, the service will try to route to other sections. From the Twitter blog post:"
[...]