The Sloan digital sky survey data transfer infrastructure

Benjamin A. Weaver; Michael R. Blanton; Jon Brinkmann; Joel R. Brownstein; Fritz Stauffer

doi:10.1086/680999

The Sloan digital sky survey data transfer infrastructure

Benjamin A. Weaver, Michael R. Blanton, Jon Brinkmann, Joel R. Brownstein, Fritz Stauffer

Research output: Contribution to journal › Article › peer-review

Abstract

The Sloan Digital Sky Survey (SDSS) has been active for approximately 15 years as of this writing. SDSS continues to produce large amounts of data, effectively daily. SDSS needs an effective system for data transfer and management that can operate essentially free of human intervention. In 2008, with the commencement of the third phase of SDSS, SDSS-III, new needs and opportunities motivated a fresh look at the data transfer infrastructure. We have constructed and are releasing a Python package, transfer, that contains all the automation needed for daily data transfer operations. This package has been tested and used successfully for several years. Significant portions of this code will continue to be used as SDSS transitions to its fourth phase, SDSS-IV.

Original language	English (US)
Pages (from-to)	397-405
Number of pages	9
Journal	Publications of the Astronomical Society of the Pacific
Volume	127
Issue number	950
DOIs	https://doi.org/10.1086/680999
State	Published - 2015

ASJC Scopus subject areas

Astronomy and Astrophysics
Space and Planetary Science

Access to Document

10.1086/680999

Cite this

@article{94dcc2d6ceff4521ba00629458ef5a00,

title = "The Sloan digital sky survey data transfer infrastructure",

abstract = "The Sloan Digital Sky Survey (SDSS) has been active for approximately 15 years as of this writing. SDSS continues to produce large amounts of data, effectively daily. SDSS needs an effective system for data transfer and management that can operate essentially free of human intervention. In 2008, with the commencement of the third phase of SDSS, SDSS-III, new needs and opportunities motivated a fresh look at the data transfer infrastructure. We have constructed and are releasing a Python package, transfer, that contains all the automation needed for daily data transfer operations. This package has been tested and used successfully for several years. Significant portions of this code will continue to be used as SDSS transitions to its fourth phase, SDSS-IV.",

author = "Weaver, {Benjamin A.} and Blanton, {Michael R.} and Jon Brinkmann and Brownstein, {Joel R.} and Fritz Stauffer",

year = "2015",

doi = "10.1086/680999",

language = "English (US)",

volume = "127",

pages = "397--405",

journal = "Publications of the Astronomical Society of the Pacific",

issn = "0004-6280",

publisher = "University of Chicago",

number = "950",

}

TY - JOUR

T1 - The Sloan digital sky survey data transfer infrastructure

AU - Weaver, Benjamin A.

AU - Blanton, Michael R.

AU - Brinkmann, Jon

AU - Brownstein, Joel R.

AU - Stauffer, Fritz

PY - 2015

Y1 - 2015

N2 - The Sloan Digital Sky Survey (SDSS) has been active for approximately 15 years as of this writing. SDSS continues to produce large amounts of data, effectively daily. SDSS needs an effective system for data transfer and management that can operate essentially free of human intervention. In 2008, with the commencement of the third phase of SDSS, SDSS-III, new needs and opportunities motivated a fresh look at the data transfer infrastructure. We have constructed and are releasing a Python package, transfer, that contains all the automation needed for daily data transfer operations. This package has been tested and used successfully for several years. Significant portions of this code will continue to be used as SDSS transitions to its fourth phase, SDSS-IV.

AB - The Sloan Digital Sky Survey (SDSS) has been active for approximately 15 years as of this writing. SDSS continues to produce large amounts of data, effectively daily. SDSS needs an effective system for data transfer and management that can operate essentially free of human intervention. In 2008, with the commencement of the third phase of SDSS, SDSS-III, new needs and opportunities motivated a fresh look at the data transfer infrastructure. We have constructed and are releasing a Python package, transfer, that contains all the automation needed for daily data transfer operations. This package has been tested and used successfully for several years. Significant portions of this code will continue to be used as SDSS transitions to its fourth phase, SDSS-IV.

UR - http://www.scopus.com/inward/record.url?scp=84926392144&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84926392144&partnerID=8YFLogxK

U2 - 10.1086/680999

DO - 10.1086/680999

M3 - Article

AN - SCOPUS:84926392144

SN - 0004-6280

VL - 127

SP - 397

EP - 405

JO - Publications of the Astronomical Society of the Pacific

JF - Publications of the Astronomical Society of the Pacific

IS - 950

ER -

The Sloan digital sky survey data transfer infrastructure

Abstract

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this