Changes between Version 17 and Version 18 of PublicPages/CosmoRepo

Timestamp:

Dec 14, 2017 10:17:59 AM (6 years ago)

Author:

Benjamin Alan Weaver

Comment:

--

PublicPages/CosmoRepo

@@ -23 +23 @@
 First, data is copied from elsewhere to the staging area in preparation for processing.  Processed data is written to the work area.  After the processed data are finalized, they can be moved into a final `cosmo/data/{survey}/{release}/` directory. That area is restricted to the cosmo project user to ensure some level of consistency for the data written there.  This process should be viewed like SDSS data releases: the data are processed and organized elsewhere, and then when finalized (and only then) they are moved into the final data release directories, controlled by the cosmo user.  Once written and released, these data are frozen -- never updated nor removed.
 
-Here is the specific directory layout:
+Here is the specific directory layout, rooted at `/global/project/projectdirs/cosmo`:
 
- /project/projectdirs/cosmo/staging/ :: This is the staging area.  Each survey has a directory under staging/.
- /project/projectdirs/cosmo/work/ :: This is the work area.  Each survey has a directory under work/.
- /project/projectdirs/cosmo/data/ ::  This directory is intended for final, static data releases.  
- /project/projectdirs/cosmo/www/ ::  This directory provides HTTP access to the repository.
- /project/projectdirs/cosmo/software/ ::  This is for software needed by the cosmo group.
- /project/projectdirs/cosmo/db/ :: Schema files and backups for NERSC-hosted databases.
+ data/ ::  This directory is intended for final, static data releases.  
+ etc/ :: Files needed to support http operations, etc.
+ metadata/ :: Data related to monitoring file size, permissions, etc. of data in this directory tree.
+ software/ ::  This is for software needed by the cosmo group.
+ staging/ :: This is the staging area.  Each survey has a directory under staging/.
+ webapp/ :: Web applications, like the [http://legacysurvey.org/viewer DECaLS image viewer] have files here.
+ work/ :: This is the work area.  Each survey has a directory under work/.
+ www/ ::  This directory provides HTTP access to the repository.
 
 == Cosmo User Account ==