Grid Engine LifeSci SIG formed

18 Feb 2008 Grid Engine LifeSci SIG formed

{ Cross-posted from … }

The above image shows a pair of Illumina Genome Analyzer systems installed in a laboratory setting. The Illumina systems are one example of what people are calling “Next Generation” systems for doing DNA and whole-Genome analysis. Everyone is working hard to produce the fabled “$1000 Genome” and there is a fantastic scientific and technology race currently ongoing to see which system, which platform and which vendor will succeed. There is even a $10 Million Dollar X-Prize for the first team to do 100 human genomes in the space of ten days. Exciting times!

What does this have to do with Grid Engine? Well, each one of these instruments is individually capable of producing terabyte-level volumes of data in just a few instrument runs. The compute power required to analyze the data coming off of these lab instruments greatly exceeds the capacity of the workstation class machines that drive the instrument. In fact, the 2 instruments you see in the image above are supported by a cluster in the basement with more than 40 terabytes of raw online storage attached.

In the case of the above Illumina/Solexa machines, Grid Engine is actually a key part of the analysis pipeline. In order to operate the instruments shown above, a working SGE installation is required. My employer has been doing quite a lot of consulting and systems integration work these days helping users and labs integrate these devices into local infrastructures and workflows. Along the way we’ve met a number of people who have expressed an interest in a small mailing list or community for swapping tips and best practices.

I also believe (but can’t speak in public on the topic …) that the Illumina/Solexa devices are just the first wet-lab oriented SGE-using instruments to enter the market. There will likely be more.

Thus was born a small google group forum:

The goal of the group is to build a tightly focused community that can share knowledge and tips on how to integrate these SGE-using devices into new or existing settings. Many vendors also assume that their customers will exclusively buy their technology platform and will use their analysis systems on dedicated hardware — this is not what we see out in the real world where we are already trying to support multi-vendor sequencing environments and shared cluster/storage resources for the back end analysis pipelines.

We’ve made the group name generic rather than making it Illumina/Solexa specific in order to accommodate future products and technologies. If interested, visit and sign up.

Related Posts
Filter by
Post Page
Employee Posts Tech Notes Training Presentations Events Screencasts
Sort by

Grid Engine for Users

2011-03-10 16:08:58


Grid Engine & Amazon EC2

I delivered the following presentation at the 2009 Sun HPC Workshop where
2009-09-09 09:10:43


SGE Video Tips: Portable Grid Engine

A short video showing how to use IP Aliasing to reliably run Grid Engine on laptop devices that may frequently
2007-12-15 19:12:58


No Comments

Post A Comment