BioMicroCenter:Computing: Difference between revisions

From OpenWetWare
Jump to navigationJump to search
No edit summary
No edit summary
(48 intermediate revisions by 4 users not shown)
Line 1: Line 1:
{{BioMicroCenter}}
{{BioMicroCenter}}


[[Image:BMC10101.png|right]]
[[Image:BMC10101.png|right]]
The BioMicro Center’s computing mission is to support a core set of bioinformatics applications and also to provide advanced computational, data storage, data security and data backup services.
The BioMicro Center supports a broad set of computational services for CORE members including hardware, software and informatic support.  
 
 
 
==Data Storage==
The BioMicro Center currently provides minimal data storage any lab associated with our [[BioMicroCenter:CoreDeps|core departments]] (100GB) free of charge on BioNet. Information about this storage can be found [[BioMicroCenter:NetworkInformation|HERE]]. We are currently investigating options for providing larger amounts of data storage for an annual free (See the [[BioMicroCenter:NewsDec08|December Newsletter]]).  


==Computational Services==
== [[BioMicroCenter:Servers|SERVERS]] ==
At this time, the BioMicro Center is no longer able to provide servers on which to preform data analysis. This is an area we are looking to reintroduce in the future, depending on funding. Information about our previous services is linked below:
The BioMicro Center has developed and manages a computational infrastructure to support our genomics experimentation and [[BioMicroCenter:BioInformaticsStaff|bioinformatics analysis]]. In response to requests from our users, we have expanded these servers to create a new collaborative computational environment at MIT. These public servers are designed to offer CORE labs access to inexpensive analysis and storage systems that piggy-back on the existing infrastructure. These services are built on a full cost recovery model where the total cost of the servers and services is expected to be recovered over three years. Charges for the equipment are billed on an annual basis.
* No longer available: [[BioMicroCenter:Computing/Clusters|Computing/Clusters]]


==BioInformatics Services==
[[Image:BMC_servers.png|center|600px]]
Bioinformatics consulting is available with [[BioMicroCenter:People|Stuart Levine]] by appointment only. Bioinformatic projets are undertaken by the BioMicro Center on a collaborative basis and resources in this are are highly limited. Expanding the Bioinformatics resources is one of our top priorities.


{| border=1 align="center"
!width=300px| [http://rous.mit.edu/index.php/Rous.mit.edu_accounts rous.mit.edu]
!width=300px| [[BioMicroCenter:BMCPub|bmc-pubN.mit.edu]]
!width=300px| [http://rous.mit.edu/index.php/BCC_Computing_Resources rowley.mit.edu]
|- align="center"
|Linux Cluster
|High Density Storage <BR> Available to CORE labs
|Isilon Cluster <BR> Available to KI labs only
|-
|
*SGE queueing system
*Free account has limited queue
*Requires purchase of storage
|colspan="2"|
*[http://ist.mit.edu/backup/tsm TSM backup of all data].
* Available on Mac/PC/UNIX
* Available any place at MIT or VPN
* Data available for analysis on ROUS
* Can create public spaces (web access)
|-
|
*24 Nodes
*184 cores
*688 GB RAM
|
*200+TB
*99% uptime (est)
*9TB Volumes
*RAID6 architecture
|
*500+TB
*99.9% uptime (est)
*No volume limit
*KI users only
|}


Additional bioinformatics support is available through
== [[BioMicroCenter:Software|SOFTWARE]] ==
* [http://luria.mit.edu/CCR_BCC/| The Bioinformatics and Computing Core Facility] at the [http://web.mit.edu/ki/index.html| Koch Institute]
The BioMicro Center collaborates with the [http://luria.mit.edu/CCR_BCC/ Koch Institute Bioinformatics Computing Core] and the [http://libguides.mit.edu/bioinfo MIT Libraries] to support a number of software packages that are available for members of the MIT community. Please check out the Software page for more informaiton
* [http://jura.wi.mit.edu/bio/| Bioinformatics and Research Computing] at the [http://www.whitehead.mit.edu/| Whitehead Institute]


==Desktop Software==
== [[BioMicroCenter:BioInformaticsStaff|BIOINFORMATICS SERVICES]] ==
* '''Spotfire Decision Site with Array Explorer for PC'''  This highly intuitive database mining software can be used for expression profiling with microarrays and also for a wide range of data analysis .In addition to the basic Spotfire package, we have licensed the array explorer module.
[[Image:BMC_informatics_team.png|thumb|right|400xp|Informatics Team]]
* '''Affymetrix Microarray Suite''' A software package (GeneChip Operating Software, GCOS) that performs fundamental data analysis for Affymetrix Gene Chips and calculates the fold change (log average ratio), as well as performing to chip comparisons. The program also includes data mining tools including clustering and self organizing maps.
A critical aspect of providing our users with genomic data is providing our users with the bioinformatics support to interpret their data readily and to assist them in analyzing data for publications and grants. To accomplish this, the BioMicro Center has a team of informatics scientists on staff able to assist labs with experience in a broad number of methodologies. Bioinformatics consultations are available by appointment for MIT scientists affiliated with MIT CEHS or the departments of Biology and Biological Engineering. Bioinformatic projects are undertaken by the BioMicro Center on a ''collaborative'' basis. [[BioMicroCenter:Pricing|Prices for Bioinformatics support are available.]]
* '''Agilent Feature Extractor''' This software package performs all high throughput analysis of Agilent microarrays up to 244,000 probes per slide. The software automatically locates and places microarray grids, rejects outlier pixels, accurately determines feature intensities and ratios, performs array normalization and calculates statistical confidences.
* '''Agilent 2100 Expert''' This software package is used to control the Agilent 2100 Bioanalyzer and to perform analysis of the output, including microfluidic and electrophoretic assays for RNA, DNA and proteins, as well as two-color flow cytometry.  


==Server-Based Software==
If you are looking for informatics support, the easiest way to begin is with an email to biomicro@mit.edu with a brief description of your experiment. One of the members of our informatics staff will reach out to you to schedule a one on one meeting. This meeting is free for CORE lab members. Once an experimental plan is approved we will begin work on your project, checking in with you at regular intervals to be sure the project is on track. The project can be paused at any time by the researcher.
The BioMicro Center staff supports four license servers for desktop use. Please contact [[BioMicroCenter:People|Stephen Goldman]] for more information about using these software packages.
* '''MATLAB''' A mathematical programming language used for mathematical modeling, as well as analyzing and visualizing data.
* '''MacVector''' a comprehensive Macintosh application that provides sequence editing, primer design, internet database searching, protein analysis, sequence confirmation, multiple sequence alignment, phylogenetic reconstruction, coding region analysis, and a wide variety of other functions.
* '''Lasergene v8.0''' A software package that provides sequence assembly including next-generation sequence analysis; simplified primer design, and expanded SNP reporting and management.
* '''COMSOL Multiphysics''' This software package creates a simulation environment that facilitates all steps in the modeling process.
* '''Genome Analyzer Pipeline (Illumina)''' This software package is a highly customizable workflow engine designed to work with the Illumina Genome analyzer. Softeare in this package is used to convert image data generated by the Genome Analyzer to quality scored base calls as well as rapid alignment of sequences to reference genomes. This software was developed as a result of extensive collaborations with many of the world’s leading sequencing centers.


==Computing Facilities==
More information about bioinformatics support through the BioMicro Center is available [[BioMicroCenter:BioInformaticsStaff|HERE''']].
The BioMicro Center Inforrmation Technology group consists of a full time System Administrator, with subcontracted capabilities in operating and server administration and network implementation. Solutions are tailored to the individual as well as labs needs. System training and documentation is provided and created as needed.
* '''Security and Network Administration''' The BioMicro Center facility supports a private subnet for improved security and performance. The BioMicro Center employs a Cisco 2641 firewall separating it from the general MIT network. A Cisco 4006 Chassis based switch provides gigabit interfaces from satellite lab switches as well out NET APP fliers and fiber connection to the NE 47 machines room and Beowulf cluster. A local consulting firm assists with security, monitoring and system hardening procedures. These include installing intrusion detection system as well as centrally monitored system “syslog” server which delivers system status every 24 hours by email. The BioMicro Center leverages MIT’s Win Athena network environment which provided tested security patches and well as security based “group policy settings”. All Linux based servers are connected to MIT’s RHEL Satellite update service.
* '''Data Integrity''' Data generated by the BioMicro Center is stored initially on one of two Net App 880 fiber channel based filers, and are snapped mirrored on a remote tier NETAPP filer over a private network. These three file servers are RAID 10 based and are additionally backed up utilizing MIT’s enterprise level TSM service and are archived in Building W91 on the MIT campus. MIT’s TSM service is also utilized to provide backups for the remaining file servers administered by the BioMicro Center.

Revision as of 07:08, 29 May 2013

HOME -- SEQUENCING -- LIBRARY PREP -- HIGH-THROUGHPUT -- COMPUTING -- OTHER TECHNOLOGY

The BioMicro Center supports a broad set of computational services for CORE members including hardware, software and informatic support.

SERVERS

The BioMicro Center has developed and manages a computational infrastructure to support our genomics experimentation and bioinformatics analysis. In response to requests from our users, we have expanded these servers to create a new collaborative computational environment at MIT. These public servers are designed to offer CORE labs access to inexpensive analysis and storage systems that piggy-back on the existing infrastructure. These services are built on a full cost recovery model where the total cost of the servers and services is expected to be recovered over three years. Charges for the equipment are billed on an annual basis.

rous.mit.edu bmc-pubN.mit.edu rowley.mit.edu
Linux Cluster High Density Storage
Available to CORE labs
Isilon Cluster
Available to KI labs only
  • SGE queueing system
  • Free account has limited queue
  • Requires purchase of storage
  • TSM backup of all data.
  • Available on Mac/PC/UNIX
  • Available any place at MIT or VPN
  • Data available for analysis on ROUS
  • Can create public spaces (web access)
  • 24 Nodes
  • 184 cores
  • 688 GB RAM
  • 200+TB
  • 99% uptime (est)
  • 9TB Volumes
  • RAID6 architecture
  • 500+TB
  • 99.9% uptime (est)
  • No volume limit
  • KI users only

SOFTWARE

The BioMicro Center collaborates with the Koch Institute Bioinformatics Computing Core and the MIT Libraries to support a number of software packages that are available for members of the MIT community. Please check out the Software page for more informaiton

BIOINFORMATICS SERVICES

Informatics Team

A critical aspect of providing our users with genomic data is providing our users with the bioinformatics support to interpret their data readily and to assist them in analyzing data for publications and grants. To accomplish this, the BioMicro Center has a team of informatics scientists on staff able to assist labs with experience in a broad number of methodologies. Bioinformatics consultations are available by appointment for MIT scientists affiliated with MIT CEHS or the departments of Biology and Biological Engineering. Bioinformatic projects are undertaken by the BioMicro Center on a collaborative basis. Prices for Bioinformatics support are available.

If you are looking for informatics support, the easiest way to begin is with an email to biomicro@mit.edu with a brief description of your experiment. One of the members of our informatics staff will reach out to you to schedule a one on one meeting. This meeting is free for CORE lab members. Once an experimental plan is approved we will begin work on your project, checking in with you at regular intervals to be sure the project is on track. The project can be paused at any time by the researcher.

More information about bioinformatics support through the BioMicro Center is available HERE.