“An Introduction to MapReduce” by Pete Warden; O’Reilly Media

Founder of OpenHeatMap Pete Warden provides a simple introduction to MapReduce, the Google-created framework for examining large datasets. This video tutorial includes four videos: an intro to the topic, writing your first MapReduce job, and then two videos on running MapReduce jobs on the Amazon Elastic MapReduce cloud service. By the time you’re done watching the videos, you’ll understand what MapReduce is and how to write simple MapReduce jobs, and you’ll be ready to move on to more advanced MapReduce topics.

The videos use Python as the language for writing your mapper and reducer, but the code stays simple and even programmers unfamiliar with Python should follow along just fine. The tutorial has you writing real code, working on real data, and producing real results. You learn the principles necessary to apply to more advanced mapping and reducing scenarios. You can reasonably launch from the course material to write complex MapReduce jobs, depending on your programming skills and imagination.

This is definitely an introduction; the material moves a little slow, and some of the questions from the audience are pretty basic. Part of the Amazon foray is troubleshooting some of the audience members’ setups, for example, though Warden’s lead is straightforward throughout. For novice programmers, I’m sure the troubleshooting scenes are valuable; for professional programmers, they can be a bit tedious. It’s a small price to pay, however, for the information you’ll extract.

If you’re looking to take the mystery out of MapReduce and understand how to use the Amazon Elastic MapReduce service to run your own MapReduce jobs, you’ll find what you need here.

4 Responses

  1. Steven Bristol says:

    Got a link?

    Also, why are you reading yogananda?

  2. Rob Warner says:

    Sorry–here’s a link:

    http://shop.oreilly.com/product/0636920020226.do

    And I need enlightenment. Peace. Meditative serenity. Lark was reading it, and I need some of that Zen. Have you read it?

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.