Bio-IT World Europe 2010 – Science Centric Storage
Presentation slides from the 2010 Bio-IT World Europe talk on “Science-centric Storage”
Presentation slides from the 2010 Bio-IT World Europe talk on “Science-centric Storage”
Prior to joining Bioteam, I worked with a computational biology group at the University of Minnesota. A friend from that time is now teaching a course in Bioinformatics in the Computer Science department at St. Thomas University. He offered the opportunity to deliver a guest lecture on “whatever I wanted to talk about.”
Experimenting with shared filesystems on the Amazon cc1.4xlarge EC2 “compute cluster” instance types.
Backstory For background and summary writeups of all the various blog posts we have dealing with the new Amazon EC2 “compute cluster” cc1.4xlarge instance types please refer to this summary page: http://www.bioteam.net/2010/07/19/exploring-the-new-aws-compute-cluster-ec2-instances/? Related post We talked about the performance of the boot and ephemeral storage in this post: http://www.bioteam.net/2010/07/19/local-storage-performance-of-aws-cluster-compute-instances/? This post In this post I’ve finally collected [...]
Lots more data collected over the weekend as we were finally able to run bonnie++ against the local boot disk as well as single and striped versions of the ephermeral storage volumes that come along with every cc1.4xlarge instance type. Key Results: Performance of the root/boot disk is way slower than any other type of [...]
Note Screwing around with the boot volume is part of our regular “explore around the edges” work before we get serious with how we are going to configure and orchestrate the new systems. The boot volume in this scenario does not have PV driver support and thus will perform slower than the actual ephemeral storage. [...]
Post Update History: July 13th – Original post July 14th – More results from cc1.4xlarge single-disk & initial results from c1.xlarge instance type, uploaded new version of the raw data spreadsheet to Google Docs. Updated all graphs. July 19th – Lots more data (including ephemeral storage) added to the raw data spreadsheet on Google Docs [...]
Amazon made a very important announcement today, releasing new EC2 server types that significantly enhance the Amazon AWS environment for people interested in cluster computing and high performance computing (HPC) on the cloud.
Later than I’d like but as promised to attendees of the ISBM 2010 meeting in Boston, here are my presentation slides from the Amazon Cloud Computing Workshop. Link: http://www.bioteam.net/wp-content/uploads/2010/07/2010-ISMB-Cloud-Workshop_v1.pdf
With all of Bioteam’s talk about cloud computing, I was a bit surprised to find myself building an honest-to-goodness non-cloud, non-virtual compute cluster a couple of weeks ago. There were wires, blinking lights, whirring fans, circuit breakers, and all sorts of messy real-world details to contend with. The servers were heavy and unwieldy, and I [...]