Data Storage at the University of Auckland
From BeSTGRID
- 40 terabytes (33 TB Raided) IBM Fibre Channel Serial ATA (Network Attached Storage)
- Delivered end - Nov 2006
- Shared scientific data dumps from Public Sources (GenBank, NCBI, Biomirror, Climate Physics)
- Secured-shared internal research data from large experiments
- ftp site mirroring large public ftp sites (for sourceforge, AARNET-ftp etc) for provision to KAREN members (only) (for research related tools etc)
- Internal UoA medium term storage for near-line data from research activities (available as desktop filesystem as well as through portals)
[edit] Usage
- The storage is now available for housing Research Data
- Research Projects using the BeSTGRID Data GRID
- It is currently available as smb (SAMBA) network storage internally to the University of Auckland. Hence, it can be made available to any Mac, Linux or Windows PC Desktop
- We can also provide access via NFS to select servers in the University
- Other services (such as rsync) are also available
- If you are using the storage as smb, all usage (i.e. through rsync) should adhere to the SAMBA usage restrictions
- Soon, it will be part of the national BeSTGRID Data GRID (i.e. globus GRID ftp, SRB etc)
[edit] SAMBA Usage Restrictions
One of the clients for Samba is the Windows family, therefore Samba has to support these requirements:
- In the Windows API, the maximum length for a path is MAX_PATH, which is defined as 260 characters http://msdn2.microsoft.com/en-us/library/aa365247.aspx
- Files should not have illegal characters (? - question mark) in their names http://www.portfoliofaq.com/pfaq/FAQ00352.htm
[edit] Usage of the DataStorage on 12/05/2008
| Project | Allocated (GB) | Used (%) |
|---|---|---|
| Whole Genome Association Studies | 500 | 45% |
| Whole Genome Association Studies (mirror) | 500 | 50% |
| Austronesian_Basic_Vocabulary_and_Bantu_Language_Databases | 500 | 2% |
| Quantum Optics | 100 | 7% |
| NEES @ Auckland | 2000 | 8% |
| New Zealand Biomirror | 5000 | 46% |
| The Polyhedrin Project, School of Biological Sciences | 500 | 46% |
| New Zealand Social Sciences Research Service | 500 | 1% |
| Paul Bonnington's home | 100 | 22% |
| NDSG | 1000 | 1% |
| Auckland BioEngineering | 3000 | 11% |
| Stephen Poon's home | 200 | 75% |
| Genomics | 200 | 50% |
| Human Immunology | 1000 | 50% |
| Ecology and Animal Behaviour | 1000 | 10% |
| SBSBS | 2000 | 5% |
| Peter Komisarczuk FTP | 40 | 1% |
| Auditory Scene Analysis | 40 | 18% |
| Passive DNS | 1000 | 1% |
| eResearch repository | 500 | 2% |
| BeSTGRID Backup Storage | 100 | 62% |
| Systems Management Storage | 1000 | 15% |
| Total | 23280 | 20.4% |
