15-440 - Distributed Systems

Home Syllabus Schedule Lectures Assignments Projects Exams Resources

Project 3: Clustering Data Points and DNA Strands using MapReduce and MPI

Design Report Due Date: 31 Oct 2011, by 11:59pm

Final Project Due Date: 14 Nov 2011, by 11:59pm

• Project description can be found in Project 3 Handout.
• Download the Data Set Generator. This is a data generator (written in Python) that generates clusters of 2D data points. It allows you to specify the number of points, the number of clusters, the output file, and the maximum coordinate value for points.

Useful References:

• A K-Means interactive demo
• A tutorial on Message Passing Interface (MPI)
• The list of MPI routines
• The Yahoo! Hadoop tutorial
• Hadoop 0.20 documentation