SCHEDULE: NOV 15-20, 2015

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Elastic Job Bundling: An Adaptive Resource Request Strategy for Large-Scale Parallel Applications

SESSION: Cloud Resource Management

EVENT TYPE: Papers

EVENT TAG(S): Clouds and Distributed Computing

TIME: 11:00AM - 11:30AM

SESSION CHAIR(S): Brent Welch

AUTHOR(S):Feng Liu, Jon B. Weissman

ROOM:19AB

ABSTRACT:

In today’s batch queue HPC cluster systems, the user submits a job requesting a fixed number of processors. The system will not start the job until all of the requested resources become available simultaneously. When cluster workload is high, large sized jobs will experience long waiting time due to this policy. In this paper, we propose a new approach that dynamically decomposes a large job into smaller ones to reduce waiting time, and lets the application expand across multiple subjobs while continuously achieving progress. This approach has three benefits: (i) application turnaround time is reduced, (ii) system fragmentation is diminished, and (iii) fairness is promoted. Our approach does not depend on job queue time prediction but exploits available backfill opportunities. Simulation results have shown that our approach can reduce application mean turnaround time by up to 48%.

Chair/Author Details:

Brent Welch (Chair) - Google|

Feng Liu - University of Minnesota Twin Cities

Jon B. Weissman - University of Minnesota Twin Cities

  Click here to download .ics calendar file

  Click here to download .vcs calendar file

  Click here to add event to your Google Calendar

Paper provided by the ACM Digital Library

Paper also available from IEEE Computer Society