wiki:PublicPages/CosmoRepo

Version 9 (modified by Benjamin Alan Weaver, 10 years ago) (diff)

--

NERSC Cosmo Public Data Repository

The NERSC Cosmo Data Repository co-locates cosmological survey data to facilitate the analysis of multiple datasets. Those data sets in the "www" directory are visible through web interfaces. The other locations are development and staging areas, visible for all users with a NERSC account.

HTTP interface to those files under www

Staging area vs. final data

/project/projectdirs/cosmo/staging/ is intended for temporary staging work and preparation of data releases, and is writable by any member of the cosmo group.

After these data are ready, they can be moved into a final cosmo/data/{survey}/{release}/ directory. That area is restricted to the cosmo project user to ensure some level of consistency for the data written there. This process should be viewed like SDSS data releases: the data are processed and organized elsewhere, and then when finalized (and only then) they are moved into the final data release directories, controlled by the cosmo user. Once written and released, these data are frozen -- never updated nor removed.

Currently Ben, Dustin, and Stephen have access to the cosmo user account via:

ssh carvergrid.nersc.gov
export GLOBUS_LOCATION=/usr/common/osg/gsissh/globus
source /usr/common/osg/gsissh/globus/etc/globus-user-env.sh
myproxy-logon -s nerscca.nersc.gov
# Enter NERSC NIM password
gsissh cosmo@localhost
# Now you are the cosmo user

2MASS data

DECam Data

FITS file with coordinates of all DECam images through 16 June 2014

SDSS Data

$BOSS_PHOTOOBJ=/project/projectdirs/cosmo/data/sdss/pre13/eboss/photoObj.v5b/
SDSS photometric catalogs
$PHOTO_SWEEP=/project/projectdirs/cosmo/data/sdss/pre13/eboss/sweeps/eboss.v5b/
SDSS trimmed photometric catalogs (datasweep files) used for SDSS-IV/eBOSS target selection
$PHOTO_RESOLVE=/project/projectdirs/cosmo/data/sdss/pre13/eboss/resolve/2013-07-29
SDSS photometric resolve information defining SDSS footprints, sky areas, and primary identifications of catalog objects

WISE data

$WISE_IMAGE_DIR=/global/project/projectdirs/cosmo/data/merge/merge_p1bm_frm
WISE Level 1b pixel-level images
/global/project/projectdirs/cosmo/data/unwise
Dustin Lang's unWISE image stacks at full WISE resolution Paper "unWISE: unblurred coadds of the WISE imaging"


Pages linking to PublicPages/CosmoRepo:

Attachments (1)

Download all attachments as: .zip