Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Dickson, James; Wright, Steven A.; Maheswaran, Satheesh; Herdman, J. A.; Miller, Mark C.; Jarvis, Stephen A. (2016)
Languages: English
Types: Unknown
Subjects: QA76
Large scale simulation performance is dependent on a number of components, however the task of investigation and optimization has long favored computational and communication elements above I/O. Manually extracting the pattern of I/O behavior from a parent application is a useful way of working to address performance issues on a per-application basis, but developing workflows with some degree of automation and flexibility provides a more powerful approach to tackling current and future I/O challenges. In this paper we describe a workload replication workflow that extracts the I/O pattern of an application and recreates its behavior with a flexible proxy application. We demonstrate how simple lightweight characterization can be translated to provide an effective representation of a physics application, and show how a proxy replication can be used as a tool for investigating I/O library paradigms.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • [1] M. A. Heroux, D. W. Doerfler, P. S. Crozier, J. M. Willenbring, H. C. Edwards, A. Williams, M. Rajan, E. R. Keiter, H. K. Thornquist, and R. W. Numrich, “Improving Performance via Mini-applications,” Sandia National Laboratories, Tech. Rep. SAND2009-5574, vol. 3, 2009.
    • [2] S. Lang, P. Carns, R. Latham, R. Ross, K. Harms, and W. Allcock, “I/O Performance Challenges at Leadership Scale,” in Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis. ACM, 2009, p. 40.
    • [3] S. Snyder, P. Carns, R. Latham, M. Mubarak, R. Ross, C. Carothers, B. Behzad, H. V. T. Luu, S. Byna et al., “Techniques for Modeling Large-scale HPC I/O Workloads,” in Proceedings of the 6th International Workshop on Performance Modeling, Benchmarking, and Simulation of High Performance Computing Systems. ACM, 2015, p. 5.
    • [4] H. Luu, B. Behzad, R. Aydt, and M. Winslett, “A Multi-level Approach for Understanding I/O Activity in HPC Applications,” in 2013 IEEE International Conference on Cluster Computing (CLUSTER). IEEE, 2013, pp. 1-5.
    • [5] S. A. Wright, S. D. Hammond, S. J. Pennycook, R. F. Bird, J. Herdman, I. Miller, A. Vadgama, A. Bhalerao, and S. A. Jarvis, “Parallel File System Analysis Through Application I/O Tracing,” The Computer Journal, p. bxs044, 2012.
    • [6] K. Vijayakumar, F. Mueller, X. Ma, and P. C. Roth, “Scalable I/O Tracing and Analysis,” in Proceedings of the 4th Annual Workshop on Petascale Data Storage. ACM, 2009, pp. 26-31.
    • [7] B. Behzad, H.-V. Dang, F. Hariri, W. Zhang, and M. Snir, “Automatic Generation of I/O Kernels for HPC Applications,” in Proceedings of the 9th Parallel Data Storage Workshop. IEEE Press, 2014, pp. 31-36.
    • [8] N. Liu, C. Carothers, J. Cope, P. Carns, R. Ross, A. Crume, and C. Maltzahn, “Modeling a Leadership-scale Storage System,” in International Conference on Parallel Processing and Applied Mathematics. Springer, 2011, pp. 10-19.
    • [9] N. Liu, J. Cope, P. Carns, C. Carothers, R. Ross, G. Grider, A. Crume, and C. Maltzahn, “On the Role of Burst Buffers in Leadership-class Storage Systems,” in 012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST). IEEE, 2012, pp. 1-11.
    • [10] P. Carns, R. Latham, R. Ross, K. Iskra, S. Lang, and K. Riley, “24/7 Characterization of Petascale I/O Workloads,” in 2009 IEEE International Conference on Cluster Computing and Workshops. IEEE, 2009, pp. 1-10.
    • [11] H. Luu, M. Winslett, W. Gropp, R. Ross, P. Carns, K. Harms, M. Prabhat, S. Byna, and Y. Yao, “A Multiplatform Study of I/O Behavior on Petascale Supercomputers,” in Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing. ACM, 2015, pp. 33-44.
    • [12] J. Borrill, L. Oliker, J. Shalf, and H. Shan, “Investigation of Leading HPC I/O Performance using a Scientific-application Derived Benchmark,” in Proceedings of the 2007 ACM/IEEE conference on Supercomputing. ACM, 2007, p. 10.
    • [13] H. Shan, K. Antypas, and J. Shalf, “Characterizing and Predicting the I/O Performance of HPC Applications using a Parameterized Synthetic Benchmark,” in Proceedings of the 2008 ACM/IEEE conference on Supercomputing. IEEE Press, 2008, p. 42.
    • [14] J. Logan, S. Klasky, H. Abbasi, Q. Liu, G. Ostrouchov, M. Parashar, N. Podhorszki, Y. Tian, and M. Wolf, “Understanding I/O Performance Using I/O Skeletal Applications,” in European Conference on Parallel Processing. Springer, 2012, pp. 77-88.
    • [15] J. Logan, S. Klasky, J. Lofstead, H. Abbasi, S. Ethier, R. Grout, S.-H. Ku, Q. Liu, X. Ma, M. Parashar et al., “Skel: Generative Software for Producing Skeletal I/O Applications,” in e-Science Workshops (eScienceW), 2011 IEEE Seventh International Conference on. IEEE, 2011, pp. 191- 198.
    • [16] Y. Jin, X. Ma, M. Liu, Q. Liu, J. Logan, N. Podhorszki, J. Y. Choi, and S. Klasky, “Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark Generation,” ACM SIGMETRICS Performance Evaluation Review, vol. 43, no. 1, pp. 309-320, 2015.
    • [17] M. Miller, “Design & Implementation of MACSio,” Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States), Tech. Rep., 2015.
    • [18] M. Folk, G. Heber, Q. Koziol, E. Pourmal, and D. Robinson, “An Overview of the HDF5 Technology Suite and its Applications,” in Proceedings of the EDBT/ICDT 2011 Workshop on Array Databases. ACM, 2011, pp. 36-47.
    • [19] UK Miniapp Consurtium, “Bookleaf Unstructured Lagrangian Hydro Mini-app,” https://github.com/UK-MAC, Last Accessed 2016-08-16.
    • [20] W. F. Noh, “Errors for Calculations of Strong Shocks Using an Artificial Viscosity and an Artificial Heat Flux,” Journal of Computational Physics, vol. 72, no. 1, pp. 78-120, 1987.
  • No related research data.
  • No similar publications.
  • BioEntity Site Name

Share - Bookmark

Cite this article