Using Queue Time Predictions for Processor Allocation

Allen B. Downey

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-97-929
January 1997

http://www2.eecs.berkeley.edu/Pubs/TechRpts/1997/CSD-97-929.pdf

When a malleable job is submitted to a space-sharing parallel computer, it must choose often whether to begin execution on a small, available cluster, or wait in queue for more processors to become available. To make this decision, it must predict how long it will have to wait for the larger cluster. We propose statistical techniques for predicting these queue times, and develop an allocation strategy that uses these predictions. We present a workload model based on the environment we have observed at the San Diego Supercomputer Center, and use this model to drive simulations of various allocation strategies. We conclude that prediction-based allocation not only improves the average turnaround time for the jobs; it also improves the utilization of the system as a whole.


BibTeX citation:

@techreport{Downey:CSD-97-929,
    Author = {Downey, Allen B.},
    Title = {Using Queue Time Predictions for Processor Allocation},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {1997},
    Month = {Jan},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/1997/5414.html},
    Number = {UCB/CSD-97-929},
    Abstract = {When a malleable job is submitted to a space-sharing parallel computer, it must choose often whether to begin execution on a small, available cluster, or wait in queue for more processors to become available. To make this decision, it must predict how long it will have to wait for the larger cluster. We propose statistical techniques for predicting these queue times, and develop an allocation strategy that uses these predictions. We present a workload model based on the environment we have observed at the San Diego Supercomputer Center, and use this model to drive simulations of various allocation strategies. We conclude that prediction-based allocation not only improves the average turnaround time for the jobs; it also improves the utilization of the system as a whole.}
}

EndNote citation:

%0 Report
%A Downey, Allen B.
%T Using Queue Time Predictions for Processor Allocation
%I EECS Department, University of California, Berkeley
%D 1997
%@ UCB/CSD-97-929
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/1997/5414.html
%F Downey:CSD-97-929