Changes between Version 18 and Version 19 of PublicPages/CosmoRepo


Ignore:
Timestamp:
Jan 21, 2020 5:31:18 PM (5 years ago)
Author:
Benjamin Alan Weaver
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PublicPages/CosmoRepo

    v18 v19  
    2323First, data is copied from elsewhere to the staging area in preparation for processing.  Processed data is written to the work area.  After the processed data are finalized, they can be moved into a final `cosmo/data/{survey}/{release}/` directory. That area is restricted to the cosmo project user to ensure some level of consistency for the data written there.  This process should be viewed like SDSS data releases: the data are processed and organized elsewhere, and then when finalized (and only then) they are moved into the final data release directories, controlled by the cosmo user.  Once written and released, these data are frozen -- never updated nor removed.
    2424
    25 Here is the specific directory layout, rooted at `/global/project/projectdirs/cosmo`:
     25Here is the specific directory layout, rooted at `/global/cfs/cdirs/cosmo`:
    2626
    2727 data/ ::  This directory is intended for final, static data releases. 
     
    7171The results of these queries are downloaded in VO Table format, then concatenated and converted into a FITS table.  The resulting catalogs are available in directories of the form:
    7272{{{
    73 /global/project/projectdirs/cosmo/staging/decam-public/DECam_00XXXXXX-YYYY-MM-DD/
     73/global/cfs/cdirs/cosmo/staging/decam-public/DECam_00XXXXXX-YYYY-MM-DD/
    7474}}}
    7575where {{{YYYY-MM-DD}}} refers to the value of the release date in the query above.
     
    7979=== SDSS Data ===
    8080
    81  $BOSS_PHOTOOBJ=/project/projectdirs/cosmo/data/sdss/pre13/eboss/photoObj.v5b/ ::
     81 $BOSS_PHOTOOBJ=/global/cfs/cdirs/cosmo/data/sdss/pre13/eboss/photoObj.v5b/ ::
    8282  SDSS photometric catalogs
    83  $PHOTO_SWEEP=/project/projectdirs/cosmo/data/sdss/pre13/eboss/sweeps/eboss.v5b/ ::
     83 $PHOTO_SWEEP=/global/cfs/cdirs/cosmo/data/sdss/pre13/eboss/sweeps/eboss.v5b/ ::
    8484   SDSS trimmed photometric catalogs (datasweep files) used for SDSS-IV/eBOSS target selection
    85  $PHOTO_RESOLVE=/project/projectdirs/cosmo/data/sdss/pre13/eboss/resolve/2013-07-29 ::
     85 $PHOTO_RESOLVE=/global/cfs/cdirs/cosmo/data/sdss/pre13/eboss/resolve/2013-07-29 ::
    8686  SDSS photometric resolve information defining SDSS footprints, sky areas, and primary identifications of catalog objects
    8787
    8888=== WISE data ===
    8989
    90  $WISE_IMAGE_DIR=/global/project/projectdirs/cosmo/data/merge/merge_p1bm_frm ::
     90 $WISE_IMAGE_DIR=/global/cfs/cdirs/cosmo/data/merge/merge_p1bm_frm ::
    9191  WISE Level 1b pixel-level images
    92  /global/project/projectdirs/cosmo/data/unwise ::
     92 /global/cfs/cdirs/cosmo/data/unwise ::
    9393  Dustin Lang's unWISE image stacks at full WISE resolution
    9494  [http://arxiv.org/abs/1405.0308 Paper "unWISE: unblurred coadds of the WISE imaging"]