Changes between Initial Version and Version 1 of BIOS_StorageInTheCloud


Ignore:
Timestamp:
Sep 19, 2016 4:12:17 PM (8 years ago)
Author:
jamverlouw
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • BIOS_StorageInTheCloud

    v1 v1  
     1= Storage in the cloud =
     2
     3We have limited space in the cloud available for analysis and storage.
     4
     5== Home folders ==
     6
     7The /home/ folder on each VM has very limited disk space and should not hold any data or output.
     8
     9We have a 2GB soft disk quota limit and 3GB hard disk quota limit per user.
     10
     11The root system is only backed up irregularly, do not rely on this and please backup your own files from your home folder. More on backup of the virdir can be read at the bottom of this page.
     12
     13== !VirDir ==
     14
     15We have 1.5 Tb of shared space available. This disk is mounted as the /virdir/ folder and can be accessed from every VMs. There are no restrictions on who can read the data.
     16
     17''' Scratch '''
     18
     19`/virdir/scratch/`
     20
     21Please make a folder with your username in /virdir/scratch/ for your data and analysis. For your convenience some data available on the SRM is downloaded to this folder already.
     22
     23''' WWW export '''
     24
     25`/virdir/Scratch/wwwexport/`
     26
     27This directory is exposed over HTTP to the internet at the root of the [wiki:FgVirtualMachine virtual machine]. This means the contents of this directory can be accessed over the internet by prefixing their filenames with `http://bios-vm.bbmrirp3-lumc.vm.surfsara.nl/`.
     28
     29The primary purpose of this is for storing [wiki:FgDataInfrastructure#UCSCGenomeBrowsertracks custom tracks for the UCSC Genome Browser].
     30
     31Please note that no privacy sensitive data should be stored here, as it will be world-readable.
     32
     33''' Backup '''
     34
     35`/virdir/Backup/`
     36
     37Data in the backup folder will be backed up nightly. Read below.
     38
     39{{{
     40#!html
     41<h2 style="text-align: left; color:red;">
     42Storage policy
     43</h2>
     44<font color=red>
     45Please read and understand the next text from Sara.nl before using this space.
     46}}}
     47
     48 ''Images on the HPC Cloud system are not backed up. The HPC Cloud is a form of Infrastructure as a Service (IaaS), which means that the user must perform administrative tasks on her virtual machines or cluster. This includes the responsibility of taking care of backups. !VirDir can be used to help with backups. !VirDirs allow users to save their data outside their image and provide the option of a backup by SURFsara (by using the backup directory). Backups are made incrementally on a nightly basis. We can restore files and/or directories when you accidentally remove them (provided they already existed during the last successful backup). The retention period for recovering deleted files is 30 days. Every day, the content of your /Backup directory will be backed up by SARA. The /Scratch directory will never be backed up. You are the best person to judge what data should or should not be backed up and we ask you to use your best judgement.''