The Sloan digital sky survey data transfer infrastructure

Benjamin A. Weaver, Michael R. Blanton, Jon Brinkmann, Joel R. Brownstein, Fritz Stauffer

    Research output: Contribution to journalArticle

    Abstract

    The Sloan Digital Sky Survey (SDSS) has been active for approximately 15 years as of this writing. SDSS continues to produce large amounts of data, effectively daily. SDSS needs an effective system for data transfer and management that can operate essentially free of human intervention. In 2008, with the commencement of the third phase of SDSS, SDSS-III, new needs and opportunities motivated a fresh look at the data transfer infrastructure. We have constructed and are releasing a Python package, transfer, that contains all the automation needed for daily data transfer operations. This package has been tested and used successfully for several years. Significant portions of this code will continue to be used as SDSS transitions to its fourth phase, SDSS-IV.

    Original languageEnglish (US)
    Pages (from-to)397-405
    Number of pages9
    JournalPublications of the Astronomical Society of the Pacific
    Volume127
    Issue number950
    DOIs
    StatePublished - 2015

    ASJC Scopus subject areas

    • Astronomy and Astrophysics
    • Space and Planetary Science

    Fingerprint Dive into the research topics of 'The Sloan digital sky survey data transfer infrastructure'. Together they form a unique fingerprint.

    Cite this