SCHEDULE: NOV 15-20, 2015

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Scientific Benchmarking of Parallel Computing Systems

SESSION: State of the Practice: Measuring Systems

EVENT TYPE: Papers

EVENT TAG(S): Performance, State of Practice, Facilities

TIME: 1:30PM - 2:00PM

SESSION CHAIR(S): Neil Chue Hong

AUTHOR(S):Torsten Hoefler, Roberto Belli

ROOM:18AB

ABSTRACT:

Measuring and reporting performance of parallel computers constitutes
the basis for scientific advancement of high-performance computing
(HPC). Most scientific reports show performance improvements of new
techniques and are thus obliged to ensure reproducibility or at least
interpretability. Our investigation of a stratified sample of 120 papers
across three top conferences in the field shows that the state of the
practice is not sufficient. For example, it is often unclear if reported
improvements are in the noise or observed by chance. In addition to
distilling best practices from existing work, we propose statistically
sound analysis and reporting techniques and simple guidelines for
experimental design in parallel computing. We aim to improve the
standards of reporting research results and initiate a discussion in the
HPC field. A wide adoption of this minimal set of rules will lead to
better reproducibility and interpretability of performance results and
improve the scientific culture around HPC.

Chair/Author Details:

Neil Chue Hong (Chair) - University of Edinburgh|

Torsten Hoefler - ETH Zurich

Roberto Belli - ETH Zurich

  Click here to download .ics calendar file

  Click here to download .vcs calendar file

  Click here to add event to your Google Calendar

Paper provided by the ACM Digital Library

Paper also available from IEEE Computer Society