An Analysis of File Migration in a Unix Supercomputing Environment

Ethan L. Miller and Randy H. Katz

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-92-712
November 1992

http://www2.eecs.berkeley.edu/Pubs/TechRpts/1992/CSD-92-712.pdf

The supercomputer center at the National Center for Atmospheric Research (NCAR) migrates large numbers of files to and from its mass storage system (MSS) because there is insufficient space to store them on the Cray supercomputer's local disks. This paper presents an analysis of file migration data collected over two years. The analysis shows that requests to the MSS are periodic, with one day and one week periods. Read requests to the MSS account for the majority of the periodicity; as write requests are relatively constant over the course of a week. Additionally, reads show a far greater fluctuation than writes over a day and week since reads are driven by human users while writes are machine-driven.


BibTeX citation:

@techreport{Miller:CSD-92-712,
    Author = {Miller, Ethan L. and Katz, Randy H.},
    Title = {An Analysis of File Migration in a Unix Supercomputing Environment},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {1992},
    Month = {Nov},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/1992/6263.html},
    Number = {UCB/CSD-92-712},
    Abstract = {The supercomputer center at the National Center for Atmospheric Research (NCAR) migrates large numbers of files to and from its mass storage system (MSS) because there is insufficient space to store them on the Cray supercomputer's local disks. This paper presents an analysis of file migration data collected over two years. The analysis shows that requests to the MSS are periodic, with one day and one week periods. Read requests to the MSS account for the majority of the periodicity; as write requests are relatively constant over the course of a week. Additionally, reads show a far greater fluctuation than writes over a day and week since reads are driven by human users while writes are machine-driven.}
}

EndNote citation:

%0 Report
%A Miller, Ethan L.
%A Katz, Randy H.
%T An Analysis of File Migration in a Unix Supercomputing Environment
%I EECS Department, University of California, Berkeley
%D 1992
%@ UCB/CSD-92-712
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/1992/6263.html
%F Miller:CSD-92-712