Parallel I/O projects (1987-2006)

This project is no longer active; this page is no longer updated.

• Summary
• Archive
• People
• Papers

Related projects: [Armada], [CHARISMA], [Galley], [RAPID-Transit], [STARFISH]

Related keywords: [pario], [software], [survey]

Summary

Large parallel computing systems, especially those used for scientific computation, consume and produce huge amounts of data. To provide the necessary semantics for parallel processes accessing a file, and to provide the necessary throughput for an application working with terabytes of data, requires a multiprocessor file system.

Most of our research is described under one of the related projects: Armada, CHARISMA, Galley, RAPID-Transit, and STARFISH.

We created an on-line bibliography of parallel I/O papers. This annotated bibliography helped many new researchers learn about and begin research in the area of parallel I/O.

We also created a detailed simulation model of the HP 97560 disk drive; see the [technical report] and the [software].

Archive

We created the 'Parallel I/O Archive', gathering material related to parallel I/O, including the above-mentioned bibliography of parallel I/O papers. That archive has not been updated in over a decade, but is reproduced here for reference.

People

The following people are co-author on one or more of the papers listed below (see the related projects for others involved in my parallel-I/O research): Charles Catlett, Alok Choudhary, C. Connelly, Thomas H. Cormen, C. Ellis, M. Holliday, Ravi Jain, V. Khera, David Kotz, R. LaRowe, Ron Oldfield, S. Owen, Sriram Radhakrishnan, Daniel A. Reed, Marc Snir, Song Bac Toh, and Darren Erik Vengroff.

Papers (tagged 'pario')

The papers here are those that did not clearly fit with one of the named projects listed above. This list is also available in BibTeX.

Papers are listed in reverse-chronological order. Follow updates with RSS.

2004:

• Darren Erik Vengroff and David Kotz. A Holesome File System. Technical Report number TR2004-497, Dartmouth Computer Science, May 2004. Originally written in July 1995; released May 2004. [Details]

2001:

• Ron Oldfield and David Kotz. Scientific Applications using Parallel I/O. High Performance Mass Storage and Parallel I/O: Technologies and Applications, chapter 45, pages 655–666. Edited by Hai Jin, Toni Cortes, and Rajkumar Buyya. Wiley-IEEE Press, September 2001. ISBN13: 978-0-471-20809-9. [Details]

2000:

• David Kotz. Bibliography about Parallel I/O. BibTeX bibliography, 2000. Original version published 1994. [Details]

1999:

• David Kotz and Ravi Jain. I/O in Parallel and Distributed Systems. Encyclopedia of Computer Science and Technology, pages 141–154. Edited by Allen Kent and James G. Williams. Volume 40, Marcel Dekker, Inc., 1999. ISBN13: 9780824722937. Supplement 25. [Details]

1996:

• David Kotz. Introduction to Multiprocessor I/O Architecture. Input/Output in Parallel and Distributed Computer Systems, chapter 4, pages 97–123. Edited by Ravi Jain, John Werth, and James C. Browne. Volume 362 in The Kluwer International Series in Engineering and Computer Science, Kluwer Academic Publishers, 1996. ISBN13: 978-1-4613-1401-1. [Details]
• Alok Choudhary and David Kotz. Large-Scale File Systems with the Flexibility of Databases. ACM Computing Surveys, volume 28A, number 4. ACM, December 1996. doi:10.1145/242224.242488. Position paper for the Working Group on Storage I/O for Large-Scale Computing, ACM Workshop on Strategic Directions in Computing Research. Available on-line only. [Details]
• David Kotz. Applications of Parallel I/O. Technical Report number PCS-TR96-297, Dartmouth Computer Science, October 1996. Release 1. [Details]
• Joel T. Thomas. The Panda Array I/O Library on the Galley Parallel File System. Technical Report number PCS-TR96-288, Dartmouth Computer Science, Hanover, NH, June 1996. Available as Dartmouth Computer Science Technical Report PCS-TR96-288. Senior Honors Thesis. Advisor: David Kotz. [Details]
• David Kotz. Parallel File Systems. A multimedia lecture included in the CD-ROM “Introductory Lectures on Data-Parallel Computing”, published by AK Peters, Ltd., March 1996. [Details]

1995:

• Daniel A. Reed, Charles Catlett, Alok Choudhary, David Kotz, and Marc Snir. Parallel I/O: Getting Ready for Prime Time. IEEE Parallel and Distributed Technology, volume 3, number 2, pages 64–71. IEEE, Summer 1995. doi:10.1109/MPDT.1995.9283668. Edited transcript of panel discussion at the 1994 International Conference on Parallel Processing. [Details]

1994:

• David Kotz. HP 97560 disk simulation module. Used in STARFISH and several other research projects, 1994. [Details]
• David Kotz, Song Bac Toh, and Sriram Radhakrishnan. A Detailed Simulation Model of the HP 97560 Disk Drive. Technical Report number PCS-TR94-220, Dartmouth Computer Science, July 1994. [Details]

1993:

• Thomas H. Cormen and David Kotz. Integrating Theory and Practice in Parallel File Systems. Proceedings of the Dartmouth Institute for Advanced Graduate Studies (DAGS), pages 64–74. Dartmouth Institute for Advanced Graduate Studies (DAGS), Dartmouth College, Hanover, NH, June 1993. Revised as Dartmouth PCS-TR93-188 on 9/20/94. [Details]
• David Kotz. Throughput of Existing Multiprocessor File Systems. Technical Report number PCS-TR93-190, Dept. of Math and Computer Science, Dartmouth College, May 1993. [Details]
• Thomas H. Cormen and David Kotz. Integrating Theory and Practice in Parallel File Systems. Technical Report number PCS-TR93-188, Dept. of Math and Computer Science, Dartmouth College, March 1993. Revised 9/20/94. [Details]
• David Kotz. Multiprocessor File System Interfaces. Proceedings of the International Conference on Parallel and Distributed Information Systems (PDIS), pages 194–201. IEEE, January 1993. doi:10.1109/PDIS.1993.253093. [Details]

1992:

• David Kotz. Multiprocessor File System Interfaces. Proceedings of the USENIX File Systems Workshop (WOFS), pages 149–150. USENIX Association, May 1992. [Details]
• David Kotz. Multiprocessor File System Interfaces. Technical Report number PCS-TR92-179, Dept. of Math and Computer Science, Dartmouth College, March 1992. [Details]

1991:

• C. Ellis, M. Holliday, R. LaRowe, D. Kotz, V. Khera, S. Owen, and C. Connelly. NUMAtic Project and the DUnX OS. IEEE Technical Committee on Operating Systems and Application Environments (Newsletter), volume 5, number 4, pages 12–14. IEEE, Winter 1991. [Details]

[Kotz research]