Author Archives: Stephen Dart

SONAS degraded Vault service notice for Saturday, April 29.

On Saturday, April 29, the Monash operating centre will be installing an expansion cabinet with 1000 slots for media on the Automated Tape Library (ATL). We have established the expansion can be executed under a degraded service rather than requiring a service-wide outage. Some technical detail is provided here to demarcate affected parts of the service. This upgrade enables an additional 4PB of tape media capacity, where new media cartridges will be added later as part of normal operations without additional interruption to services.

Recalls from Tape Vault Suspended on Saturday, April 29, 10am to 4pm.

The ability to recall data from tape will be temporarily suspended from 10am to 4pm, Saturday April 29, to accommodate this installation. Data can continue to be written as normal, and will be queued for backup/HSM within the normal business procedures that day. Any data already on the Vault disk cache will also be readily available for read and rewrite. Only data that has not been accessed in the last week and has been migrated to tape will be temporarily unavailable.

The effect of the suspension will be to stall user file read opens for files not in the cache until full service is resumed. Users expecting to have work in progress over the weekend can request the recall of the required Vault data prior to the upgrade, to maintain their workflow.

Data Custodians with Collection allocations that use Vault at the Monash operating centre have been contacted via email to their registered contact email addresses.

VicNode Market and Vault Storage at Monash Emergency Maintenance Tonight (May 19th)

The VicNode Market and Vault service hosted at Monash University is reporting that it has reached its maximum safe disk usage. The Vendor and eSolutions staff have taken actions to alleviate the condition. Unfortunately, their best efforts have not been as effective as expected. The situation now requires the storage system known as SONAS to interrupt service to customers several times over the next week.

There will be a series of outages each night, starting from 6pm tonight, 19th May.
If you are able to shutdown your operations prior to this time, please do so.
System recovery is expected before 6am each day, but this is not guaranteed.
We will dispatch updates as we receive them from eSolutions.

This will halt access to all NFS shares mounted of the SONAS host known as
rds.erc.monash.edu.au for most of tonight. We have been warned that if the
system crashes, there is potential for activity in progress to lose data.

This news has been emailed directly to known users of the service.

Node ID Collection Name
2013R2.1 Store.Synchrotron
2013R3.3 History of Adoption-Stories of Australian Adoption
2013R3.5 The Proteome Browser
2013R4.1 Clueweb12
2013R4.5 LTRAC
2013R4.7 The Nold Laboratory – Translational Immunology in Neonatal – Diseases and Beyond
2014R10.1 Monash Biomedical Imaging Data Collection
2014R10.2 Monash Biomedical Proteomics Facility
2014R10.9 Synchrotron Imaging and Medical Beamline Data
2014R11.01 Squirrel
2014R11.03 Structural Cryo-Electron Microscopy Data Store
2014R11.04 FlowCore Data Store
2014R11.05 Medical Chemistry Research Data Archive
2014R11.06 Data Collection for the Epigenetics and Chromatin (EpiC) Research Laboratory, Monash University
2014R11.08 CIIID Biological Data
2014R11.09 Monash 3D Group Data
2014R11.10 Next Generation Sequencing @MicroMon
2014R11.11 Bryson-Richardson Lab Data Collection
2014R11.12 AuScope Underworld Archive
2014R11.13 Bioinformatics Training Platform Data
2014R11.14 Monash Macromolecular Crystallisation Facility Data Store
2014R11.15 CRC Sleep Database
2014R11.16 MHTP Medical Genomics Facility Genomics Data Collection for Collaboration
2014R11.17 Monash University Research Repository
2014R11.18 FLAIR Experimental Data Sets
2014R12.1 Biomedical Applications of Phase Contrast X-ray Imaging
2014R12.2 Persistence and adaptation genomics collection
2014R12.4 Eliminate Dengue Technology Transfer and Innovation Platform Digital Assets
2014R12.5 Monash Functional Anatomy & Biomechanics 3D scan data
2014R12.7 Owncloud – Monash
2014R13.2 4D computed tomography and lung function imaging in small animals
2014R14.2 Monash School of Chemistry – X-Ray Diffraction Images
2014R14.3 3D Geological and Geophysical Model and Toolkit Library
2014R14.4 Stock Price Impact Models
2014R5.2 OzFlux Data Portal
2014R6.1 Monash Microimaging Data Store
2014R6.3 PROSPER protease substrates and cleavage site data
2014R7.1 Australian Equities Database
2014R8.1 Wide-field images of low redshift galaxies
2014R8.2 FLAIR and Bio-Engineering, Dept of Mech & Aerospace Eng, Monash University
2014R8.3 Global IP activity probes, 2003 to 2013
2014R8.4 TARDIS Legacy Crystallography Archive
2014R9.05 Centre for Electronic Media Art and Animation Data
2014R9.06 Interferome-Interferons Regulated Genes Catalog
2014R9.08 Monash Histology Platform Aperio Data Storage
2014R9.09 Visual History Archive
2015BAP1 Monash Bioinformatics Platform
2015BAP10 CIBF
2015BAP2 Boyce Lab Microbiology
2015BAP3 Curtis Lab Medicine
2015BAP4 Reprogramming and Epigenetics
2015BAP5 BPA Metadata
2015BAP6 BPA National Genomics Data Storage Facility
2015BAP7 Kay Hodkins
2015MON002 Store.Monash Data Store
2015R15.1 RNA Systems Biology Lab
2015R15.2 Genome-wide mapping of cardiac regulatory elements
2015R15.3 Systems Pharmacology
2015R15.4 Institute of Railway Technology
2015R15.5 XMFIG Data Store
2015R17.1 Victoria Fire Weather Climatology Dataset
2015R19.2 Bee Insect Project

VicNode apologizes for the short notice of this series of unexpected outages.

Aspera Shares Outage Scheduled for weekend of April 2~3

VicNode has been advised that an outage is required to upgrade the Aspera Shares Data Transfer Node at Monash. This does not affect the VicNode storage systems. Market and Vault shares will continue to operate, but access via Aspera Shares will not be available. Computational allocations are not affected by this outage and will continue to be accessible via NeCTAR. No data is at risk and operations are proceeding normally.

The Monash Server team have proposed a date and time outside normal business hours to minimize any potential disruption to VicNode users workflow, but have also asked if there were plans scheduled for the same time. If this time and date will affect your planned operations, please contact us via support@vicnode.org.au

Date: April 2 thru 3, (Saturday/Sunday)
Time: 8:00 ADST Saturday ~ 19:00 AEST Sunday
Duration: ~2 Days

Services Affected:
. Aspera Shares – Shares on https://shares.vicnode.org.au/

Collections temporarily inaccessible via Aspera Shares:
2013R1.2 Circus Oz Archive
2013R4.7 Nold Laboratory
2014R8.1 Sky Survey
2014R8.3 Global IP Survey
2014R10.9 IMBL (Australian Synchrotron)
2014R11.11 Bryson-Richardson Lab
2014R12.1 Phase Contrast X-Ray
2014R13.2 4D computed tomography and lung function imaging
2015R17.1 Victoria Fire Weather Climatology
2015R19.2 Bee Insect Project
2015MON001 Earth Observation Data
RITP-200 Advanced Molecular Imaging

We apologize in advance for this disruption and hope that the timing is not too inconvenient.

Stephen Dart | VicNode Research Data Infrastructure Specialist

Monash Outage Scheduled for January 21, Market and Vault Shares Unavailable

VicNode has been advised that an outage is required at the Monash Operating Centre to upgrade network access to the storage system. Access only to Market and Vault shares located at Monash will be disrupted. Computational allocations are not affected by this outage. No data is at risk and operations are proceeding normally.

The Monash Network team have proposed a date and time outside normal business hours to minimize any potential disruption to VicNode users workflow, but have also asked if there were plans scheduled for the same time. If this time and date will affect your planned operations, please contact us via support@vicnode.org.au

Date: January 21, 2016 (Thursday)
Time: 18:00~19:00 AEDT (6pm~7pm)
Duration: ~1 hour

Services Affected:
. Monash Market – Shares on SONAS
. Monash Vault – Shares cached on SONAS, stored on TSM/HSM

Collections Affected:
2013R1.2 Circus Oz Living Archive Collection
2013R2.1 Store.Synchrotron
2013R4.1 Clueweb12
2013R4.5 LTRAC
2013R4.7 The Nold Laboratory
2014R6.1 Monash Microimaging Data Store
2014R8.1 Wide-field images of low redshift galaxies
2014R8.2 FLAIR and Bio-Engineering, Dept of Mech & Aerospace Eng, Monash University
2014R8.3 Global IP activity probes, 2003 to 2013
2014R9.02 Store.Synchrotron
2014R9.05 Centre for Electronic Media Art and Animation Data
2014R9.06 Interferome-Interferons Regulated Genes Catalog
2014R9.08 Monash Histology Platform Aperio Data Storage
2014R9.09 Visual History Archive
2014R10.1 Monash Biomedical Imaging Data Collection
2014R10.2 Monash Biomedical Proteomics Facility
2014R10.9 Synchrotron Imaging and Medical Beamline Data
2014R11.01 Squirrel
2014R11.03 Structural Cryo-Electron Microscopy Data Store
2014R11.05 Medical Chemistry Research Data Archive
2014R11.10 Next Generation Sequencing @MicroMon
2014R11.11 Bryson-Richardson Lab Data Collection
2014R11.12 AuScope Underworld Archive
2014R11.16 MHTP Medical Genomics Facility Genomics Data Collection for Collaboration
2014R11.18 FLAIR Experimental Data Sets
2014R12.1 Biomedical Applications of Phase Contrast X-ray Imaging
2014R12.2 Persistence and adaptation genomics collection
2014R12.4 Eliminate Dengue Technology Transfer and Innovation Platform Digital Assets
2014R12.5 Monash Functional Anatomy & Biomechanics 3D scan data
2014R14.4 Stock Price Impact Models
2015R15.1 RNA Systems Biology Lab
2015R15.2 Genome-wide mapping of cardiac regulatory elements
2015R15.4 Institute of Railway Technology
2015R15.5 XMFIG Data Store
2015R17.1 Victoria Fire Weather Climatology Dataset
2015R19.2 Bee Insect Project
2015BAP1 Monash Bioinformatics Platform
2015BAP2 Boyce Lab Microbiology
2015BAP3 Curtis Lab Medicine
2015BAP4 Reprogramming and Epigenetics
2015BAP5 BPA Metadata
2015BAP7 Kay Hodkins
2015BAP10 Centre of Excellence for Integrative Brain Function

Any collection making use of SONAS shares via NFS mounts to any host server such as NeCTAR VMs should arrange to dismount prior to and remount the shares after the scheduled downtime. Your VM may require a reboot .

Collection Owners and their technical contacts should have already received this notification by direct email. If you know/hear of someone affected by this outage but has not receive a notification email, please alert us to update the their contact details.

Access to Monash Computational allocations (NeCTAR) will not be affected.

We apologize in advance for this disruption and hope that the timing is not too inconvenient.

Stephen Dart | VicNode Research Data Infrastructure Specialist

Network Switch Failure at University of Melbourne – 10th Nov 2015

We have had reports this morning (10-Nov-2015) of some VicNode users having access problems.

As of 11:30am there was known to be a network switch failure within the Queensbury St datacentre that may affect NeCTAR dashboard logins and connections to VicNode storage.

University of Melbourne DevOps team has been involved in resolving the situation and wanted to pass on that other network switches are currently “learning” routes around the failure and the Datacentre Networks team are working on replacing the failed switch.

If the situation requires longer term work-a-rounds, we will communicate on this topic again.

Our apologies for this interruption to service.

SteveD for the VicNode Team.

Monash Outage Scheduled for August 31, Market and Vault Shares Unavailable

VicNode has been advised that an outage is required at the Monash Operating Centre to fix a fault in the data storage system. Access only to Market and Vault shares will be disrupted. Computational allocations are not affected by this outage. No data is at risk and operations are proceeding normally as the issue has been effectively bypassed by the rest of the system.

The Vendor and Monash have proposed a date and time outside normal business hours to minimize any potential disruption to VicNode users workflow, but have also asked if there were plans schedule for the same time. If this time and date will affect your planned operations, please contact us via support@vicnode.org.au

Date: August 31, 2015 (Monday)
Time: 17:00~23:00 (5pm~11pm)
Duration: 4~6 hours max

Services Affected:
. Monash Market – Shares on SONAS
. Monash Vault – Shares cached on SONAS, stored on TSM/HSM

Collections Affected:
2013R1.2 Circus Oz Living Archive Collection
2013R2.1 Store.Synchrotron
2013R4.1 Clueweb12
2013R4.5 LTRAC
2013R4.7 The Nold Laboratory – Translational Immunology in Neonatal – Diseases and Beyond
2014R10.1 Monash Biomedical Imaging Data Collection
2014R10.2 Monash Biomedical Proteomics Facility
2014R10.9 Synchrotron Imaging and Medical Beamline Data
2014R11.01 Squirrel
2014R11.03 Structural Cryo-Electron Microscopy Data Store
2014R11.05 Medical Chemistry Research Data Archive
2014R11.10 Next Generation Sequencing @MicroMon
2014R11.11 Bryson-Richardson Lab Data Collection
2014R11.12 AuScope Underworld Archive
2014R11.16 MHTP Medical Genomics Facility Genomics Data Collection for Collaboration
2014R11.18 FLAIR Experimental Data Sets
2014R12.1 Biomedical Applications of Phase Contrast X-ray Imaging
2014R12.4 Eliminate Dengue Technology Transfer and Innovation Platform Digital Assets
2014R12.5 Monash Functional Anatomy & Biomechanics 3D scan data
2014R14.4 Stock Price Impact Models
2014R6.1 Monash Microimaging Data Store
2014R8.1 Wide-field images of low redshift galaxies
2014R8.2 FLAIR and Bio-Engineering, Dept of Mech & Aerospace Eng, Monash University
2014R8.3 Global IP activity probes, 2003 to 2013
2014R9.03 Smaug
2014R9.08 Monash Histology Platform Aperio Data Storage
2014R9.09 Visual History Archive
2015BAP1 Monash Bioinformatics Platform
2015BAP3 Curtis Lab Medicine
2015BAP4 Reprogramming and Epigenetics
2015R15.1 RNA Systems Biology Lab
2015R15.4 Institute of Railway Technology
2015R17.1 Victoria Fire Weather Climatology Dataset
2014R8.3 Global IP activity probes, 2003 to 2013
2014R9.02 Store.Synchrotron
2014R9.05 Centre for Electronic Media Art and Animation Data
2014R9.06 Interferome-Interferons Regulated Genes Catalog
2014R9.08 Monash Histology Platform Aperio Data Storage
2015BAP1 Monash Bioinformatics Platform
2015BAP2 Boyce Lab Microbiology
2015BAP3 Curtis Lab Medicine
2015BAP4 Reprogramming and Epigenetics
2015BAP5 BPA Metadata
2015BAP7 Kay Hodkins

Any collection making use of these shares via NFS mounts to any host server such as NeCTAR VMs should arrange to dismount prior to and remount the shares after the scheduled downtime. A reboot may be required.

Collection Owners and their technical contacts will be emailed directly with the same advice.

Access to Monash Computational allocations (NeCTAR) will not be affected.

We apologize in advance for this disruption and hope that the timing is not too inconvenient.

Stephen Dart | VicNode Research Data Infrastructure Specialist

Going faster and further with University of Melbourne collections

Getting data to some distant user or research collaborator can be a very frustrating experience. If too large for email attachments (<10MB), using some intermediate cloud storage (<10GB) might work to a point, but when your data gets very large (100GB+), communications can become a bottleneck.

In those cases either too distant or too large, VicNode can help.

Data collections hosted on VicNodes Market service at the University of Melbourne can now access the Aspera Shares service. This is the first Aspera service available from VicNode. When a collection is connected to the Aspera Shares service, a logged in user can transfer data at maximum speed between their desktop and VicNode storage.

Over 225TB of data has already been ingested and shared by this method. Examples are bushfire data from California and astronomy data from Murchison Wide Field Array. The collection owner is always under the control of who can read or write data.

With a little extra work, data can be transported directly between research systems and bypass the desktop.

If you think your collection might benefit from Aspera Shares, contact the Infrastructure Specialist (Stephen Dart) via the support@vicnode.org.au email address for more details.

VicNode supporting the implementation of Figshare research data repositories in Victoria

The University of Melbourne has launched a new Research Data Repository using Figshare along with VicNode storage infrastructure. The Figshare repository software enables researchers to store, publish, cite and share research data and results. This approach is different from a usual VicNode collection in that it is a collection of collections accessible through a single website.

The new Figshare repository enables University of Melbourne researchers with digital research data to upload, publish and cite their collections without requiring a separate VicNode storage application.

VicNode has been pleased to provide the underlying storage using RDSI infrastructure at its University of Melbourne operating centre. A similar service at the Monash operating centre will become available later in 2015 to cater for researchers based there.

Click here to find out more about Figshare through VicNode.
Click here to access the Univerity of Melbourne Figshare Research Data Repository.

Mediaflux Training for end users held at University of Melbourne

Mediaflux Training Class at Vicnode

Mediaflux Training Class at Vicnode

Last week, the University of Melbourne hosted the second day of a two day training course for end users of the Mediaflux data management application (previously known as LiveArc). The course material was tailored at the request of VicNode, to emphasize the ingest and curation of  digital assets by collection custodians and the following local first line support by VicNode staff. Having both users and support staff in the same training forum has helped form the overall VicNode Mediaflux service.

The course was delivered on both days by Brian O’Conner of Arcitecta.

The first day, held the week before, consisted of hands-on exercises using the Arcitecta Desktop web front end to Mediaflux called Hydrogen. Being Java based, it allows use from many client desktops and platforms. The second day was mainly about the command line tool called aterm.

Follow this link for a description of the Mediaflux access method.

The VicNode Mediaflux server has had a new certificate installed and training videos have been uploaded. Please contact support@vicnode.org.au for access.