|
File Systems |
|
File Systems and Environment Variables
The Network File Service (NFS) server contains user's home directories, project directories, and software directories. The first two can be used by users to store frequently used items such as source code, binaries, and scripts. Both home and project directories are accessible from all interactive NICS resources. However, it is important to remember that compute nodes do not have access to these directories. Unlike home and project directories, the scratch space on NICS resources utilizes Lustre, a massively parallel distributed file system. This space is intended for production work and not long term storage. On Kraken, Lustre is the only file system available to the compute nodes
Environment variables have been set up for the XSEDE to help make scripts work no matter which cluster they are run on. They provide a common user environment. You may choose to use these variables instead of hardcoding paths.
|
Description |
Name |
Value on Kraken |
| Home Directory | $TG_CLUSTER_HOME | /nics/*/home/$USER |
| Default Parallel File System | $TG_CLUSTER_PFS | /lustre/scratch/$USER |
| Scratch Directory | $TG_CLUSTER_SCRATCH | /lustre/scratch/$USER |
Home Directories
Each user is provided a home directory to store frequently used items such as source code, binaries, and scripts. See Home Directories for more information about their use and policies.
Project Directories
A principal investigator (PI) may request a project directory to store shared files and data. For more information, please refer to Project Directories.
Scratch Directories
Scratch space for staging temporary data and performing I/O with the compute nodes is available on the Lustre file system. This is the only file system available to the compute nodes. For information about the purge policy, and other specifics, please see Scratch Directories.
I/O and Lustre Tips
Lustre is a shared resource by all users on the system. Optimizing your IO performance will not only lessen the load on Lustre, it will save you compute time as well. Please consider reading the I/O and Lustre Tips page which we believe will help you make the best use of the parallel Lustre filesystem and improve your application's I/O performance.
High Performance Storage System (HPSS)
The High Performance Storage System (HPSS) is an archival storage system jointly operated by NICS and NCCS. Data transfer between this system and the rest of NICS is provided by HSI utility. Please see HPSS section for more details.
