RMACC HPC Symposium 2016 has ended
Back To Schedule
Thursday, August 11 • 3:00pm - 4:30pm
Reading and Writing Large Files in Parallel

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

As scientists and engineers focus on larger computational problems, the time spent accessing disk continues to grow. In this course, we will explore the fundamentals of using parallelization to optimize file input/output. A basic knowledge of parallel programming paradigms will be useful but is not required. 


This tutorial will include hands-on exercises. As such, participants should bring a multi-core laptop, or have access to a remote parallel compute environment (e.g., Janus), in order to get as much out of the tutorial as possible. Some software packages may be necessary as well; we will send out information on such packages in advance.


Topics to be covered include:

  • Serial vs. parallel computing
  • Parallel file systems
  • Middleware (e.g. MPI-IO)
  • High-level IO libraries (HDF5, PnetCDF)
  • Writing code to utilize parallel I/O
  • Best practices (e.g., striping)

Thursday August 11, 2016 3:00pm - 4:30pm PDT
Cherokee Ballroom