What's New in Parallel I/O

This page dates from 2002 and is no longer updated. It is here for archival reference.

Last modified: Wed Oct 30 21:04:50 2002

2002

MercutIO, a portable MPI-IO (Mississippi State, October 2002)

2001

Armada, an I/O framework for a computational Grid (Dartmouth)
The Global Grid Forum, a new (2000) forum for developing computational Grid technology. One sub-group has a focus on data access.
Forthcoming book High Performance Mass Storage and Parallel I/O, IEEE/Wiley Press, 2001.
A new conference, replacing IOPADS, USENIX Conference on Filesystem and Storage Technologies (FAST), January 28-30 in Monterey, CA

2000

Dave got too busy and stopped maintaining this list. It's not that nothing new happened in 2000...

1999

May 6, 1999: Dictionary on Parallel Input/Output, by Heinz Stockinger, February 1998. 223 pages.
- (compressed Postscript)
- (PDF)
March 15, 1999: IOPADS '99 announced its program a while back

1998

September 14, 1998: IOPADS '99 (papers due October 16)
September 14, 1998: GFS: The Global File System
May 14, 1998: Gemini Storage Systems Laboratory (UCSD)
April 14, 1998: HPC on Clusters of Parallel and Distributed Computing Practices (PDCP) Journal, due by September 15, 1998.
March 24, 1998: a test suite for MPI-IO (compressed tar file), from the MPI-IO project at LLNL
March 2, 1998: release of The DiskSim Simulation Environment by Greg Ganger, Bruce Worthington, and Yale Patt.
Announcement of DIMACS Workshop on External Memory Algorithms and Visualization, May 20-22, 1998
Announcement of DIMACS 1997-1998 Special Year on Massive Data Sets

1997

November 30, 1997: List of papers for IJSA special issue on I/O in Parallel Applications
November 6, 1997: added link to John May
November 6, 1997: LLNL Scalable I/O Facility link replaced with a link to their Parallel I/O Project
October 13, 1997: ROMIO 1.0.0 available (a portable MPI-IO implementation)
July 27, 1997: we became An InterNIC Academic Guide Featured Site
July 27, 1997 (actually, July 21): The MPI-2 standard, which includes an interface for parallel I/O, has been officially released.
July 27, 1997 (actually, May 28): Program for IOPADS announced
March 20, 1997: I'm going to stop listing most new papers here. Subscribe to parallel-io-bib if you want automatic notification about new papers.
March 11, 1997: A new version of The NAS application I/O Benchmark (BTIO version 0.2)
February 22, 1997: Parallel I/O bibliography mailing list created
February 21, 1997: Parallel I/O bibliography updated!
February 4, 1997: PPFS release 1.0
February 3, 1997: RAIDframe simulation software released
January 17, 1997: Parallel Out-of-core Methods for N-body Simulation, by John Salmon and Michael Warren

1996

December 18, 1996: Parallel I/O on the SP2 Helps to Make Big Science Possible, an SC96 poster presentation by Jerry Gerner
December 12, 1996: Techniques and Optimizations for Developing Irregular Out-of-Core Applications on Distributed-Memory Systems, a tech report from P. Brezany and A. Choudhary
November 26, 1996: The International Journal of Supercomputer Applications and High Performance Computing, Special Issue on I/O in Parallel Applications. Deadline May 10, 1997.
November 15, 1996: New project: VIPIOS, At University of Vienna
November 7, 1996: Galley: A New Parallel File System for Parallel Applications, a Ph.D thesis from Nils A. Nieuwejaar, Dartmouth College.
October 23, 1996: This parallel I/O archive moved to a new home.
October 16, 1996: Applications of Parallel I/O, by David Kotz. Pointers to lots of papers that describe applications that use parallel I/O.
October 14, 1996: Disk-directed I/O for MIMD Multiprocessors, a major revision of the paper by David Kotz.
October 14, 1996: Tuning STARFISH, by David Kotz. A report about an update to the STARFISH parallel file system simulator
October 11, 1996: Using MPI-IO for Fast Parallel I/O: A User's Perspective, NAS News Online, September-October 1996. Vol. 2, No. 20
October 1, 1996: IOPADS '97 CFP now available
September 16, 1996: Ph.D Thesis of Apratim Purakayastha, Duke University, Characterizing and Optimizing Parallel File Systems.
September 5, 1996: Agenda now available for Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, September 17-19, 1996.
September 4, 1996: Input/Output in Parallel and Distributed Computer Systems, a new compilation from Kluwer Academic Publishers. Includes most papers from IOPADS~'94 and '95, plus some other introductory papers.
September 3, 1996: SIO project's proposal for a parallel file-system API, version 1.0
August 27, 1996: INFORMATICA Special Issue on Parallel and Distributed Database Systems
August 26, 1996: Panda pages moved and updated
August 14, 1996: Early MPI-IO Implementation Demonstrates Portability and Performance, NAS News online, July-August 1996, Vol 2. No. 18
August 14, 1996: I/O Performance of Multidimensional Arrays Tests Well on IBM SP2 With Panda, NAS News online, July-August 1996, Vol 2. No. 18
August 14, 1996: An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces, Rajeev Thakur, William Gropp, Ewing Lusk. To appear in Frontiers '96.
August 12, 1996: Performing Out-of-Core {FFTs} on Parallel Disk Systems, a new Dartmouth technical report from Thomas H. Cormen and David M. Nicol.
August 12, 1996: Early Experiences in Evaluating the Parallel Disk Model with the ViC* Implementation, a new Dartmouth technical report from Thomas H. Cormen and Melissa Hirschl.
August 1, 1996: Remote and Rapid Processing of Terabyte Data Sets: "The goal of this project is to develop and place into the hands of the on-site working explorationist, from the independent to the major oil company, important new capabilities for seismic imaging of complex underground structures. Sandia National Laboratories and its partners propose to greatly reduce the time and cost required to perform 3-D, finite difference, prestack depth migrations and to enable remote iterative processing and interpretation of terabyte data sets."
July 30, 1996: High Performance Implementation of Server Directed I/O, Mahesh Subramaniam M.S. Thesis, Department of Computer Science, University of Illinois at Urbana-Champaign, June, 1996.
July 27, 1996: User's guide to Intel Paragon PFS
July 9, 1996: Sam Fineberg's MPI-IO implementation of the NAS Application I/O (BTIO) benchmark codes
June 28, 1996: Parallel File System (PFS) for the Intel Paragon: users' documentation
May, 1996: Using MPI-IO to Access Multidimensional Distributed Arrays, Sam Fineberg, NAS News On-line
May 20, 1996: mpi-io@mcs.anl.gov --- A mailing list discussing details of a new standard I/O interface as part of the MPI-2 standard message-passing interface. This is distinct from the older mpi-io@nas.nasa.gov mailing list, which still exists.
May 15, 1996: CFP: Special Issue of Parallel Computing journal on Parallel Data Servers and Applications. Abstracts due July 10, 1996.
May 9, 1996: Parallel and Distributed Information Systems '96, December 18-20, 1996. Papers due May 15.
April 24, 1996: A book containing papers from IOPADS '94 and IOPADS '95, plus several survey/tutorial papers, will be available in June 1996.
April 18, 1996: Rajesh Bordawekar's Ph.D thesis, Techniques for Compiling I/O Intensive Parallel Programs
April 18, 1996: PMPIO, a portable implementation of MPI-IO developed at NASA Ames
April 18, 1996: MPI-IO for PIOFS, an implementation of MPI-IO developed at IBM
April 18, 1996: "MPI-IO: A Parallel File I/O Interface for MPI, Version 0.5" released
April 11, 1996: Convex Exemplar SPP1600 System
March 27, 1996: new paper Flexibility and Performance of Parallel File Systems, by David Kotz and Nils Nieuwejaar.
March 6, 1996: new web pages for ParFiSys project (Universidad Politecnic Madrid)
February 23, 1996: CFP: Parallel Computing Special Issue on Parallel I/O. Papers due May 17, 1996.
February 14, 1996: New web pages for Vesta and its product version PIOFS, (IBM)
February 13, 1996: CFP: Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, Sept. 17-19, College Park, Maryland. Abstracts due February 19, 1996.
February 10, 1996: Program for IOPADS'96 announced; abstracts and BibTeX available.
February 10, 1996: ChemIO: parallel I/O for computational chemistry (DOE Argonne and Pacific Northwest Labs)
January 29, 1996: configuration of the SP-2 at the Cornell Theory Center
January 24, 1996: new home page for Sandra Johnson Baylor, IBM T.J. Watson Research Center
January 24, 1996: new home page for Peter Corbett, IBM T.J. Watson Research Center
January 24, 1996: new home page for Marc Snir, IBM T.J. Watson Research Center
January 24, 1996: new home page for Jean-Pierre Prost, IBM T.J. Watson Research Center
January 17, 1996: new paper Multikey Index Support for Tuple Sets on Parallel Mass Storage Systems from the University of Vienna
January 5, 1996: the Galley Parallel File System
January 5, 1996: More about CHARISMA workload characterization project.

1995

December 15, 1995: new I/O architecture, the Cray T3E GigaRing
December 15, 1995: new event. CFP: Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, Sept. 17-19, College Park, Maryland. For info contact ben.kobler@gsfc.nasa.gov. Abstracts due February 19, 1996.
December 14, 1995: new event: Workshop on Parallel and Distributed Database Systems at EuroPar '96
November 30, 1995: new paper Automatic Optimization of Communication in Out-of-core Stencil Codes, by Bordawekar et al at Syracuse.
November 27, 1995: new web page for John Wilkes, Hewlett-Packard Labs
November 20, 1995: PIO mailing list moved to pio@ccsf.caltech.edu (formerly pio@nersc.gov).
November 9, 1995: New paper by Bordawekar et al, "Compilation and Communication Strategies for Out-of-core programs on Distributed Memory Machines", a technical report expanding on their ICS'95 paper
October 24, 1995: Call for papers for the Third International Conference of the ACPC with special emphasis on Parallel Databases and Parallel I/O, September 22-25, 1996, in Klagenfurt, Austria
October 20, 1995: Scalable I/O Facility (LLNL) web page substantially updated
October 18, 1995: Input/Output on the IBM SP2 -- An Overview
October 18, 1995: Application I/O and Related Issues on the SP2
October 13, 1995: Network-Attached Peripheral (NAP) project of the Scalable I/O Facility (LLNL)
September 15, 1995: paper about the HiDIOS filesystem
September 15, 1995: HiDIOS Parallel File System for AP-1000, part of the CAP Research program (Australian National University and Fujitsu)
September 13, 1995: Interfaces for Disk-Directed I/O, a new TR from Dartmouth
August 23, 1995: "I/O Characterization of a Portable Astrophysics Application on the IBM SP and Intel Paragon", a new TR from Argonne
August 16, 1995: Seventh edition of parallel I/O bibliography released
August 15, 1995: "File-Access Characteristics of Parallel Scientific Workloads", a new TR from Dartmouth
July 26, 1995: IOPADS '96 Workshop on I/O in Parallel and Distributed Systems, at FCRC '96 in Philadelphia May 27
July 25, 1995: Large, Out-of-Core Calculation Runs on the IBM SP2 from NAS News, July - August 1995 -- Volume 2, Number 11
June 12, 1995: Tutorial on Parallel-I/O Issues for High-Performance Distributed Computing at HPDC '95
June 12, 1995: A Multiple Discrete Pass Algorithm on a DEC Alpha 2100, a Senior Thesis by Dartmouth's Scott Cushman '95.
June 9, 1995: Workshop on Modeling and Specification of I/O (MSIO), held in conjunction with the Symposium on Parallel and Distributed Processing, San Antonio, Texas - October 25-28, 1995
June 2, 1995: On-line IOPADS'95
June 1, 1995: New paper, "Anatomy of a Parallel Out-of-Core Dense Linear Solver", byKen Klimkowski and Robert van de Geijn. To appear at ICPP'95.
May 17, 1995: New TR on Informed Prefetching and Caching, from CMU
May 4, 1995: PIOFS manual (IBM)
May 2, 1995: New technical report on The Tower of Pizzas from the University of Maryland Institute for Advanced Computer Studies (UMIACS)
May 1, 1995: PIOUS 1.2.2 released
April 2, 1995: Summary of Dartmouth research in parallel I/O
Mar 23, 1995: new person Robert Bedichek (MIT)
Mar 17, 1995: "Expanding the Potential for Disk-Directed I/O" (Dartmouth)
Mar 17, 1995: Communication Strategies for Out-of-core Programs on Distributed Memory Machines (Syracuse)
Mar 16, 1995: PIOUS (Emory University)
Mar 8, 1995: Language, Compiler and Parallel Database Support for I/O Intensive Applications, a new paper from Brezany et al
Mar 5, 1995: People in parallel I/O
Feb 28, 1995: Communication-Efficient and Memory-Bounded External Redistribution, a TR by Lee, Ranka, and Shankar
Feb 24, 1995: Scalable Concurrency Control for Parallel File Systems, a new TR from Steve Moyer
Feb 7, 1995: PASSION runtime library now available
Feb 3, 1995: New version of parallel-I/O bibliography (Dartmouth)
Jan 31, 1995: New version of MPI-I/O interface draft (NASA Ames, IBM)
Jan 20, 1995: Panel session on Parallel I/O at ICPP, August 1994
Jan 18, 1995: STARFISH: Simulation Tool for Advanced Research in File Systems (Dartmouth) (disk-directed I/O)
Jan 16, 1995: TPIE, A Transparent Parallel I/O Environment (Duke)
Jan 16, 1995: I/O, Data Systems, and File Systems working group of the Workshop and Conference on Grand Challenge Applications and Software Technology May 4-7, 1993
Jan 14, 1995: Updated paper from Kotz: Disk-directed I/O for MIMD Multiprocessors
Jan 14, 1995: Workshop on Scalable Input/Output for High-Performance Computers at Frontiers '95, February 5, 1995. There are also a panel discussion on Scalable I/O, and several papers on parallel I/O issues, in the conference itself.
Jan 13, 1995: New paper on two-phase I/O from Syracuse
Jan 13, 1995: Parallel data-transfer standard proposal
Jan 10, 1995: FAQ for comp.arch.storage
Jan 2, 1995: SHORE - A High-Performance, Scalable, Persistent Object Repository (U Wisc)

1994

Dec 20, 1994: RAPID-Transit project, including all source code!
Dec 19, 1994: Dartmouth's new FLEET lab
Dec 13, 1994: Orran Krieger's PhD dissertation on Hurricane File System
Dec 6, 1994: PIOUS for PVM (Emory University)
Dec 4, 1994: New Cormen tech report: ViC*: A Preprocessor for Virtual-Memory C*
Dec 2, 1994: MPI-I/O interface standard (NASA Ames, IBM)
Nov 27, 1994: Portable Parallel File Systems (PPFS) (UIUC)
Nov 18, 1994: Scotch High Performance Storage Testbed
Nov 18, 1994: Kotz OSDI paper: Disk-directed I/O for MIMD Multiprocessors
Nov 10, 1994: Link to Parallel Data Laboratory (CMU)
Nov 8, 1994: Revision of Kotz tech report: Disk-directed I/O for MIMD Multiprocessors
Oct 24, 1994: CHARISMA tech report on CM-5 workload characterization
Oct 19, 1994: IOPADS workshop CFP
Oct 19, 1994: New anecdote
Oct 17, 1994: New tech report: Asymptotically Tight Bounds for Performing BMMC Permutations on Parallel Disk Systems
Oct 1994: main page reorganized
Oct 1994: Panda Project link
Oct 1994: Hector/NUMAchine project link
Oct 1994: Papers by Alok Choudhary
Oct 1994: PASSION project link
Sep 19, 1994: Tech report: A Multiprocessor Extension to the Conventional File System Interface
Sep 1994: High-Performance Storage System link
Sep 1994: National Storage Laboratory link
Sep 1994: Scalable I/O Facility link
Sep 1994: Jovian project link
Sep 1, 1994: New anecdote
Aug 9, 1994: Anecdotes
Aug 8, 1994: Revision of Kotz/Nieuwejaar tech report
Jul 22, 1994: Bibliography, 5th edition
July 1994: Parallel I/O WWW pages created!