An Amazingly Critical Software Program for Super-Sized Datasets

by Harry on March 17, 2009

How much would you pay for this software program:

  • It determines what 300 million Yahoo users see each month, and helps Yahoo customize its home page content.
  • Facebook uses it to manage 40 billion stored photographs.
  • Microsoft changed its internal policies so that its team could develop on this software

The software is Hadoop, named after a stuffed toy elephant.  Hadoop was developed by a consultant, Doug Cutting, based on papers published by Google concerning its extremely valuable MapReduce technology.  According to Google, MapReduce is used to distribute searches and information-intensive processing across batteries of commodity computers, and is intended to enable even inexperienced programmers to easily use a large distributed system — terabytes of data on thousands of machines.

The price is zero — it is open source under the relatively lenient Apache License.

[Source: "Hadoop, a Free Software Program Finds Uses beyond Search, by Ashee Vance, The New York Times, March 17, 2009. The name "Hadoop" and depictions of the Hadoop logo and mascot are reserved for use by The Apache Software Foundation.]

{ 0 comments… add one now }

Leave a Comment

You can use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Older post: Contract Provisions for Troubled Times - How Third Parties Can Assure Performance (Technology Law Letter #3)

Newer post: Big Ideas in Business and Law

-->