Friday, January 18, 2008

Google to Host Terabytes of Open-Source Science Data

Sources at Google have disclosed that the humble domain,, will soon provide a home for terabytes of open-source scientific datasets. The storage will be free to scientists and access to the data will be free for all. The project, known as Palimpsest and first previewed to the scientific community at the Science Foo camp at the Googleplex last August, missed its original launch date this week, but will debut soon.

Building on the company's acquisition of the data visualization technology, Trendalyzer, from the oft-lauded, TED presenting Gapminder team, Google will also be offering algorithms for the examination and probing of the information. The new site will have YouTube-style annotating and commenting features.

Sounds cool.

And the series of tubes that make up the Internet are not big enough to handle this data, so Google is using a truck suitcase instead:
(Google people) are providing a 3TB drive array (Linux RAID5). The array is provided in “suitcase” and shipped to anyone who wants to send they data to Google. Anyone interested gives Google the file tree, and they SLURP the data off the drive. I believe they can extend this to a larger array (my memory says 20TB).
via Wired

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.