SCHEDULE: NOV 15-20, 2015

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

A Coding Based Optimization for Hadoop

SESSION: Regular & ACM Student Research Competition Poster Reception

EVENT TYPE: Posters, Receptions, ACM Student Research Competition

EVENT TAG(S): HPC Beginner Friendly, Regular Poster

TIME: 5:15PM - 7:00PM

SESSION CHAIR(S): Michela Becchi, Manish Parashar, Dorian C. Arnold

AUTHOR(S):Zakia Asad, Mohammad Asad Rehman Chaudhry, David Malone

ROOM:Level 4 - Lobby

ABSTRACT:

The rise of cloud and distributed data-intensive ("Big Data") applications puts pressure on data center networks due to the movement of massive volumes of data. Reducing volume of communication is pivotal for embracing greener data exchange by efficiently utilizing network resources. This work proposes the use of coding techniques working in tandem with software-defined network control as a means of dynamically-controlled reduction in volume of communication. We introduce motivating real-world use-cases, and present a novel spate coding algorithm for the data center networks. Moreover, we bridge the gap between theory and practice by performing a proof-of-concept implementation of the proposed system in a real world data center. We use Hadoop as our target framework. The experimental results show advantage of proposed system compared to “vanilla Hadoop implementation”, “in-network combiner”, and “Combine-N-Code” in terms of volume of communication, goodput, and number of bits that can be transmitted per Joule of energy.

Chair/Author Details:

Michela Becchi, Manish Parashar, Dorian C. Arnold (Chair) - University of Missouri|Rutgers University|University of New Mexico|

Zakia Asad - University of Toronto

Mohammad Asad Rehman Chaudhry - soptimizer

David Malone - The Hamilton Institute

  Click here to download .ics calendar file

  Click here to download .vcs calendar file

  Click here to add event to your Google Calendar