Difference between revisions of "Proportal ToDoList"
|Line 9:||Line 9:|
| Add/update 13 Cyanophage genome strains into production server ||
| Add/update 13 Cyanophage genome strains into production server || || Add your comment
|Line 21:||Line 21:|
| Pipeline for cluster analysis ||
| Pipeline for cluster analysis || || Add your comment
|Line 27:||Line 27:|
| Annotation pipeline || On
| Annotation pipeline || On .|| Add your comment
Revision as of 11:43, 6 April 2012
- 1 To-do List
- 2 Cluster Analysis
- 3 Annotation Pipeline
- 4 Data Download
- 5 Data Upload
- 6 Broken Links
- 7 Non-coding RNAs
|1||Orphan records in DB||To be confirmed: whether remove them or fix the wrong links.||Add your comment|
|2||Add/update 13 Cyanophage genome strains into production server||Complete||Add your comment|
|3||Modify the search page||Complete: systematically modified for accurate results.||Add your comment|
|4||Datasets download||Complete: wait for new datasets released or published.||Add your comment|
|5||Datasets upload||Open for suggestion: mechanisms for incorporating the community efforts.||Add your comment|
|6||Pipeline for cluster analysis||Complete||Add your comment|
|7||Dynamic presentation of cluster network||On going.||Add your comment|
|8||Annotation pipeline||On going.||Add your comment|
The current COG clustering pipeline is in review. New COG clusters are being generated on the internal development website and will be updated soon on the public Proportal website.
January 30, 2012
SSSM7 is a phage, the rest are Prochlorococcus. Should this be an orphan phage gene in the SSSM7 genome?
>PMED4_13831|3728 >P9303_01001|3728 >A9601_14421|3728 >SS120_13441|3728 >SSSM7_186|3728
To verify this problem, use the query,
SELECT * FROM `ocean-dev`.`data_protein` A left join data_scaffold B on A.scaffold_id=B.id left join data_project C on C.id = B.project_id where cluster_id=3728;
To find all hmmscan cases, use
SELECT * FROM `ocean-dev`.`data_protein` A left join data_scaffold B on A.scaffold_id=B.id left join data_project C on C.id = B.project_id where cluster_evi like '%hmmscan' order by cluster_id;
January 24, 2012
Add P-SSP3 genome into Proportal and run cluster pipeline again. Include the following genomes in the output,
76 P-GSP1 54 P-HP1 75 P-RSP2 55 P-RSP5 71 P-SSP10 72 P_SSP6_G2088 24 P_SSP7 57 P-SSP9_G2089 49 SYN5_gp01 [NC_009531] 56 P-SSP2
58 P-SSP5 (old P-SSP3) should be removed from Proportal?
martlny, Chisholm, 2006, parallel genome comparison
Rodrigue et al, 2010, RNA-seq pipeline
annotating using rast (rapid annotation Aziz et al 2008, bmc genomics
10 weiniger hill drive,
IMG-act annotation collaboration toolkit two main types: gene and pathway/Structure
wiki-based housed at doe-jgi
localization orf structure enzymatic duplication and degradation horizontal gene transfer RNA info
dufrense et al, 2003, pathway graph
pathway tools version 15
filled pathway tools
using blast to identify missing enzyme.
pfam/domain analysis for motif
another annotation pipeline.
B2G4PIPE - Blast2GO without graphical interface. The Blast2GO Pipeline Version (B2G4Pipe) runs Blast2GO without graphical interface.
For more information, refer to http://www.blast2go.com/b2glaunch/resources
September 30, 2011
Kat: Since Matt already offered his pipeline and it sounded like it has been continuously maintained and developed, it does sound like a good option. However, pay attention to how they train the gene calling program and what program(s) are used. The old method (described in the T4 paper) was dependent on a gene calling program, GeneMark. I think Matt's pipeline's improvement was mostly on the start sites... But it's perhaps not that critical to get the start sites right depending on the focus of your project.
The general idea of a pipeline is simple if you'd rather build one yourself: 1. Evaluate the gene calling programs and figure out the best way to train the programs for phage genomes. 2. Combine the results into a final set. 3. Filter false positives. For Prochlorococcus genomes, I filter the short orphan gene models (< 50aa without any homologs in sequenced genomes).
For step 1, this has to be a continuous effort and it's most time-consuming since new programs and better algorithms are continuing to be developed and so any annotation pipeline requires constant maintenance and re-evaluation.
September 21, 2011
Simon: I met Matt Henn last Friday and we talked about the phage annotation pipeline. We can send them our sequences for annotation but both of us would prefer to have the pipeline independent. The problem is (or are) that there are in-house dependencies linked to the annotation pipeline. So to make it public, we would need to remove/move these. Matt estimate that it could be between 3-4 months of work for one person.
September 9, 2011
katya: Would you guys be available next week to discuss setting up a pipeline for reannotating some of our newer phages, e.g. the strange new siphos, which were pitifully annotated by the Broad pipeline? (I'd also like to revisit a couple of the myos that were annotated by Matt's group once we have a pipeline we're happy with in place.)
September 30, 2011
We should add the iron microarray data since it is published. The Supp Info of the paper does not include the entire microarray dataset, only the differentially expressed genes in MED4/MIT9313.
Here's the data as log2 fold change. The 70 (and 72) hour time points come after an iron rescue to the experiment (-Fe) treatment.
September 23, 2011
The data posted for the different papers should look much more professional, or take it down. The names of the files are hokey, and not transparent, for one thing... (that would be easy to fix).
More importantly, the spread sheets for the temp and light data have those messy graphs on them. We should delete the graphs. And there is no annotation on the spread sheets so they would not be useful to anyone, and they don't have units. And they have too many significant figures. Just not ready for the public eye. Just too "raw" to have out there for the whole world to see.
The data we have under the different publications: http://proportal.mit.edu/download/ We probably should take some of it down for now until we can figure out how to clean it up. We should discuss in the next lab meeting.
A number of new strains should be uploaded into the DB. Refer to the Strain Discussion for more detail.
September 30, 2011
For instance: from our UI, we can query a specific Pro/Syn/phage read, and see which genome it is recruited to and what gene(s) it overlaps with: http://proportal.mit.edu/gosread/JCVI_READ_1105499780090/
But, strangely the fasta report isn't reported correctly.
February 3, 2012
150 ncRNAs for prokaryotic genomes asRNAs: Antisense RNAs, RNA degradation, translation inhibition, mRNA stabilization
Is the TATA-box of asRNAs conserved? not conserved!
Transcription of ORFs is conserved. Transcription of asRNAs is not conserved.Why?
Which ncRNAs are functional? Current sequence analysis is good for gene comparison but does not account for differences in regulation (transcriptome,ncRNAs.).
The fact is: the transcription of ORFs is much more conserved than that of asRNAs; the majority of ORFs have conserved TSS?! lack of conservation is mostly due to differences in promoter sequence
Comparing transcriptomes is important