PGP and Tranche: Difference between revisions

From OpenWetWare
Jump to navigationJump to search
No edit summary
 
(28 intermediate revisions by 3 users not shown)
Line 9: Line 9:


==Tranche==
==Tranche==
In order to increase the utility of project data and make more of it available to the public, the [http://personalgenomes.org Personal Genome Project] (PGP) has launched [[PersonalGenomes@Home]].  This effort uses [http://tranche.proteomecommons.org/about/ Tranche] for persistent storage.  The Tranche Project is a free and open source file sharing tool that enables collections of computers to easily share and cite scientific data sets. Designed and built with scientists and researchers in mind, Tranche essentially solves the data sharing problem in a secure and scalable fashion.  
In order to increase the utility of project data and make more of it available to the public, the [http://personalgenomes.org Personal Genome Project] (PGP) has launched [[PersonalGenomes@Home]].  This effort uses [https://proteomecommons.org/tranche/ ProteomeCommons.org's Tranche Network] for persistent storage.  The Tranche Project is a free and open source file sharing tool that enables collections of computers to easily share and cite scientific data sets. Designed and built with scientists and researchers in mind, Tranche essentially solves the data sharing problem in a secure and scalable fashion.  


====Tranche User Account====
====Tranche User Account====
To apply for a user account fill out the form at [http://www.proteomecommons.org/autocert/signup.jsp Tranche User Account Application]. Pending account applications are reviewed weekly on Mondays.  
To apply for a user account fill out the form for a [https://proteomecommons.org/signup.jsp ProteomeCommons User Account]. Pending applications are reviewed each business day.


==== System Requirements====
==== System Requirements====
Java Runtime Environment 5.0 or later; See [http://tranche.proteomecommons.org/users/system-requirements.html System Requirements]
Java Runtime Environment 5.0 or later; See [https://proteomecommons.org/tranche/users/system-requirements.html System Requirements]


====Tranche User Guide and Instructions for Up- and Downloads====
====Tranche User Guide and Instructions for Up- and Downloads====
A detailed user guide can be found [http://tranche.proteomecommons.org/users/ Tranche User Guide here].   
A detailed user guide can be found [https://proteomecommons.org/tranche/users/ Tranche User Guide here].   


There are three ways to add or get data from the network:
There are three ways to add or get data from the network:
<ol>
<ol>
   <li><strong>GUI</strong>: Go to the [http://tranche.proteomecommons.org Tranche homepage] and click "Launch Tranche". (Requires Java 5+ with Web Start)</li>
   <li><strong>GUI</strong>: Go to the [https://proteomecommons.org/tranche Tranche homepage] and click "Launch Tranche". (Requires Java 5+ with Web Start)</li>
   <li><strong>Command-line tools</strong>: See below</li>
   <li><strong>Command-line tools</strong>: See below</li>
   <li><strong>Java API</strong>: For custom tools development</li>
   <li><strong>Java API</strong>: For custom tools development</li>
Line 29: Line 29:
The most popular of the three is the GUI, as it is easy to use. The command-line tools are useful for automating tasks or working in headless environments, and the API is useful when integrating Tranche in a software project or for creating a custom tool
The most popular of the three is the GUI, as it is easy to use. The command-line tools are useful for automating tasks or working in headless environments, and the API is useful when integrating Tranche in a software project or for creating a custom tool


Tranche up- and downloads can be run over the command line using the [http://tranche.proteomecommons.org/files/CommandLineAddFileTool.zip upload tool] and the [http://tranche.proteomecommons.org/files/CommandLineGetFileTool.zip download tool].  
Tranche up- and downloads can be run over the command line using the [https://proteomecommons.org/tranche/files/CommandLineAddFileTool.zip upload tool] and the [https://proteomecommons.org/tranche/files/CommandLineGetFileTool.zip download tool].  


  wget http://tranche.proteomecommons.org/files/CommandLineAddFileTool.zip   
  wget --no-check-certificate https://proteomecommons.org/tranche/files/CommandLineAddFileTool.zip   
  wget http://tranche.proteomecommons.org/files/CommandLineGetFileTool.zip   
  wget --no-check-certificate https://proteomecommons.org/tranche/files/CommandLineGetFileTool.zip   


In order to use these tools you also need a certificate, which you can get instantly at [http://www.proteomecommons.org/autocert/ Tranche Autocert]. It comes in the form of USER.zip.encrypted. <br />
In order to use these tools you also need a login, which you can get at [https://proteomecommons.org/signup.jsp ProteomeCommons.org]. <br />


Download each tool, unzip the file, go into unzipped directory, type <tt>java -jar NAME.jar --help</tt> to obtain usage information. (If java is not in your system path, add it to your path or type the full path <tt>/path/to/java -jar NAME.jar --help</tt>. <br />
Download each tool, unzip the file, go into unzipped directory, type <tt>java -jar NAME.jar --help</tt> to obtain usage information. (If java is not in your system path, add it to your path or type the full path <tt>/path/to/java -jar NAME.jar --help</tt>. <br />
Line 43: Line 43:
For usage information: <tt>java -jar Tranche-Uploader.jar --help</tt>  <br />
For usage information: <tt>java -jar Tranche-Uploader.jar --help</tt>  <br />
Upload a file: <br />
Upload a file: <br />
<tt> java -Xmx521m -jar Tranche-Uploader.jar -u USER.zip.encrypted -p PASSWORD -c true -t "MY TITLE" -d "MY DESCRIPTION" /home/DataForUpload </tt><br />
<tt> java -Xmx521m -jar Tranche-Uploader.jar -u USER.zip.encrypted -p PASSWORD -c true -t "MY TITLE" -d "MY DESCRIPTION" /home/DataForUpload </tt><br/>


There is the option to download/upload encrypted data:<br/>
There is the option to download/upload encrypted data:<br/>
Line 49: Line 49:
<tt> java -jar Tranche-Uploader.jar -u FILE.zip.encrypted -p supersecret /home/DataForDownpload </tt><br />
<tt> java -jar Tranche-Uploader.jar -u FILE.zip.encrypted -p supersecret /home/DataForDownpload </tt><br />


Example scripts are provided: [http://tranche.proteomecommons.org/users/scripts/download-hashes-from-file.sh.txt download script] and [http://tranche.proteomecommons.org/users/scripts/upload-directories-and-store-hashes.sh.txt upload script]. <br />
Example scripts are provided: [https://proteomecommons.org/tranche/users/scripts/download-hashes-from-file.sh.txt download script] and [https://proteomecommons.org/tranche/users/scripts/upload-directories-and-store-hashes.sh.txt upload script]. <br />


To get notified about changes and upgrades one can join the [http://groups.google.com/group/proteomecommonsorg-tranche-command-line-tools/ automated tool] group for command-line tools and API. </br>
To get notified about changes and upgrades one can join the [http://groups.google.com/group/proteomecommonsorg-tranche-command-line-tools/ automated tool] group for command-line tools and API.


==Download PGP Data from Tranche==


====Transferring Data onto Tranche====
The public PGP data are now available on [https://proteomecommons.org/tranche/ Tranche].<br/><br />
You have two options when downloading using the command-line tool:


For initial data transfer, could ship (two?) USB drives to [http://genome.med.harvard.edu/ BPF]:
1. To download using the project hash and the path information: <br/>
    [[User:Andrew Gagne|Attn: Andrew Gagne]]
  java -Xmx512m -jar Tranche-Downloader.jar -r 'PATH' PROJECT_HASH
    Biopolymers Facility
    77 Ave. Louis Pasteur
    Room 0088
    Boston, MA 02115


We have:
Where PROJECT_HASH is:
* PGP2 - FC37_2 - http://genomerator.freelogy.org/~awz/pgp2-FC_00037_L002/  Note: Other data sets could appear on the hard-disk(s) with this directory structure.  On arrival, data could be loaded into Tranche as 100 data "bundles" per data-set (i.e per Illumina lane). 
  xz8EIKO6y5dF9yJeH7+71PGu+f/PKjC9TWyg70gcJMDVH/SaUDxgbHrc8O1zBGxDK+cHlSzS5XYc+mk5H8TyVXh9BTYAAAAAAmRoJA==


We need:  
2. To download using the hash for the individual run (<em>recommended</em>):<br />
* PGP1 - FC37_3
  java -Xmx512m -jar Tranche-Downloader.jar RUN_HASH
* PGP3 - FC35_3
* PGP5 - FC44_2
* PGP7 - FC44_4
* PGP8 - FC37_1,FC51_2,FC51_6
* PGP9 - FC43_3,FC51_3,FC51_7
* PGP10 - FC41_3


Also, could use:
Where RUN_HASH can be found in the table below. This second method is recommended because it will likely be faster, as option #2 will not need to load the entire project's information.
* CONTROL - FC35, FC37, FC41, FC43, FC44, FC51.  


For all the above there is a top level directory (eg. pgp2-FC_00037_L002) and exactly 36 directories below that. Within each of those directories there are 4x100 files. For this release, it would be ideal if the data was organized in tranche as 18x100 "randomly addressable" data sets that a volunteer computer could ask for as desired.  Each addressable "bundle" of data would then be 4x36 files.
The following are available on [https://proteomecommons.org/tranche/ Tranche]. Each of these paths contain directories Cn.1 n=1..36, which each contain the raw images s_lane_tile_[acgt].tif.gz, where the lane is specified in the path by L00lane (e.g. L001), and tile=1..100.  <br/>


====Example: Upload project, download a portion using command-line tools====


* Get directory to test.
<table border="1" style="font-size: .9em;">
<tr>
  <th>Path</th>
  <th>Hash</th>
</tr>


besmit@besmit-kubuntu:~/PGP-Test$ wget -r -l 1 http://genomerator.freelogy.org/~awz/pgp2-FC_00037_L002/C36.1/
<!-- 1 -->
<tr>
  <td>PGP/PGP_1/PGP_1_FC00037/PGP_1_FC_00037_L003/</td>
  <td>Uid6OqEDTBVN2TJ77YkMxT2ni9ZkNORsZxJkBD3xs4sQiM7/ltL429u91riEC/SimhUPZrn3FJ9/vN1zUnF4ThxqqfUAAAAAACGNgg==</td>
</tr>


* Moved downloaded directory contents to C36.1/. Upload this directory to Tranche. Requires login to upload. See -h or --help for information about parameters. The very last argument is the directory to upload.


besmit@besmit-kubuntu:~/Desktop/TrancheLabs/Upload$ java -Xmx512m -jar Tranche-Uploader.jar -U bryan -P ********** -d "This is my description. Passphrase required for download." -t "This is my title: C35.1 encrypted" -e pgptest4 -c true C36.1/
<!-- 3 -->
<tr>
  <td>PGP/PGP_2/PGP_2_FC00037/PGP_2_FC_00037_L002/</td>
  <td>sGH85bSuWIstQ12wsH1S3g4bWbupI0NG3B2VBuZmjvDfW54LzEwHYa8d1qdfq8HvDR97Bwp00T+bJvRlnI1vCysgsEwAAAAAACGNgg==</td>
</tr>


* This is the stderr for the project. Intended for debugging, etc.
<!-- 2 -->
Using batch chunk upload?: yes
<tr>
Started total of 10 file encoding threads.
  <td>PGP/PGP_3/PGP_3_FC00035/PGP_3_FC_00035_L003/</td>
  <td>A+T1fSJ49iUep9eYn7Tggvtohej6AOXZG9Tdiby8P0D293kKFv4AfrlAHf5dmEflWgs3IrIgmK18nrWxRWVrmuX1lO4AAAAAACGNgg==</td>
</tr>


* This is the stdout for the project - the hash used to identify the project. This should be saved.
<!-- 4 -->
uiRL5wtqG5FyzE9PnJG47dbxuU3PqpX3aE2Gq9SNJa5vRvlgn14hwUEBW8UZyXIeQWLP9B49sb6/W8dBOz1+QfRC5UkAAAAAAAEnnA==
<tr>
  <td>PGP/PGP_5/PGP_5_FC00044/PGP_5_FC_00044_L002/</td>
  <td>KVP7qsEI5ej7vH+MZGbhbhy+CCe5s7z7EUgEAXpnmtQKQS7BHUXlnGAJvKx0Z5U+S3hNRMyD0SaA0WHCzr/h/+FALvkAAAAAACGNgg==</td>
</tr>


* Download files tifs with filenames referring to G or C nucleotides
<!-- 5 -->
besmit@besmit-kubuntu:~/Desktop/TrancheLabs/Download$ java -Xmx512m -jar Tranche-Downloader.jar -e pgptest4 -r _[gc].tif.gz$ uiRL5wtqG5FyzE9PnJG47dbxuU3PqpX3aE2Gq9SNJa5vRvlgn14hwUEBW8UZyXIeQWLP9B49sb6/W8dBOz1+QfRC5UkAAAAAAAEnnA==
<tr>
  <td>PGP/PGP_7/PGP_7_FC00044/PGP_7_FC_00044_L004/</td>
  <td>wJCEGtX4InEVeMAUes8WjgVar+CtjTxi79ptB+TRxJOILXbRjHBdrIvVyQ1XOucn3Wt6scVJG5L8S9l5851eWD+3BF8AAAAAACGNgg==</td>
</tr>


* The only output is the path to download directory, shown when download complete
<!-- 6 -->
/home/besmit/Desktop/TrancheLabs/Download/tranche-downloads/C36.1
<tr>
  <td>PGP/PGP_8/PGP_8_FC00037/PGP_8_FC_00037_L001/</td>
  <td>/hCd4NlLnXbAmZDFgh6RdMfWk13Wp+IUEXt0sTVvd6ecm4VSLYWzj8yGQB44b5hl0QdxZA+PHfJBuS+VNv+3cMOxnhMAAAAAACGNgg==</td>
</tr>


<!-- 7 -->
<tr>
  <td>PGP/PGP_8/PGP_8_FC00051/PGP_8_FC_00051_L002/</td>
  <td>bzEgXZaqsGsYxyPRWGTdVbuwpONcu2QMqpSS85PeiOrQhSEKccmAHKHrT7nU5vsLUVyXqjLGzCUS2AnFVUvkXY8xf70AAAAAACGOrA==</td>
</tr>


<!-- 8 -->
<tr>
  <td>PGP/PGP_8/PGP_8_FC00051/PGP_8_FC_00051_L006/</td>
  <td>BYSZDtW8LiCaIg8qgRZsdeJQK+X7n556/CD84ro77wj3rp9MLQib4H/oiPSYjfnTih3CZwTDtJeJ41toR0GVWzDvJW8AAAAAACGOGA==</td>
</tr>


<!-- 9 -->
<tr>
  <td>PGP/PGP_9/PGP_9_FC00043/PGP_9_FC_00043_L003/</td>
  <td>vI7IzPUUfTDv2PzCm/6Ks7yiLiFJEc+IikrDZXQNmSwivAvDb0fMyKARuBYazYi5SCN/C8aAIXGqsuvKkTQYkfdvzWgAAAAAACGNgg==</td>
</tr>


====Upload/Donwload Test from Boinc====
<!-- 10 -->
<tr>
  <td>PGP/PGP_9/PGP_9_FC00051/PGP_9_FC_00051_L003/</td>
  <td>rIfl/1sK7hJWfFi5CYnhqNwZDSfZdRDUSOoTov6bD8+ovDJgA6MgaM0Lo3svZHM4DwkG4xDCG0k+dUbk5W3gI3X/iksAAAAAACGNgg==</td>
</tr>


These tests were conducted with build 3432. <br />
<!-- 11 -->
A test_tree/ directory was created o boinc, with 36 subdirectories C1.1 - C36.1, each containing the four ACGT tif images for four tiles 1 - 4. The raw tif images were gzipped, resulting in a total size of test_tree/ of 2.503GB. <br />
<tr>
  <td>PGP/PGP_9/PGP_9_FC00051/PGP_9_FC_00051_L007/</td>
  <td>Qk+/y0bHvqdaBukutHqul6XPLQnbxGAxS5gwIPvzfgGeX79CNUe6nLa1K0ncdSn0Bu81n/NitPwMUvPMocaROhKHL3MAAAAAACGNgg==</td>
</tr>


=====Upload=====
<!-- 12 -->
All attempts by AL to upload test_tree/ from boinc have so far been unsuccessful.<br />
<tr>
Bryan Smith uploaded the data from [http:boinc-dev.freelogy.org/~aloehr] in 68 minutes. <br />
  <td>PGP/PGP_10/PGP_10_FC00041/PGP_10_FC_00041_L003/</td>
It appears that the upload tool is not appropriate in its speed for the data volume of the initial ~1TB that PGP will need to transport.
  <td>3ZvbBigaeOnOMrJmT/vcBMo95pgNz86RXrB8UJypMStaaannHRQSnnkj3H9ojZ1VFiYO8V3ZFGdPDcOkPgzTigr4WE0AAAAAACI2RQ==</td>
</tr>


=====Download=====
<!-- 13 -->
The entire test_tree/ directory was downloaded from boing within 17 minutes. The download, however, was faulty and 38 images were missing. This results was reproduced twice. <br />
<tr>
INFO: I/O exception (java.net.ConnectException) caught when processing request: Connection refused<br />
  <td>PGP/CONTROL/CONTROL_FC00035/CONTROL_FC_00035_L001/</td>
Jan 18, 2009 2:15:37 PM org.apache.commons.httpclient.HttpMethodDirector executeWithRetry<br />
  <td>g1BoTW5DmYTlAsG7U1hi85sXfM7+xtaIDQlEXO2ThqCwZRpgrnKp1MHRFsI2Xrv6xOEcDUcP7Z4pdUWb6ByGBk/cJ58AAAAAACLfCA==</td>
INFO: Retrying request<br />
</tr>
Tranche downloader error: A total of 38 errors occurred while downloading project:<br />
Also, the subdirectories C1.1 - C36.1 contained these files:  <br />  
C1.1/index.html<br />
C1.1/index.html?C=D;O=A<br />  
C1.1/index.html?C=D;O=D<br />  
C1.1/index.html?C=M;O=A<br />
C1.1/index.html?C=M;O=D<br />
C1.1/index.html?C=N;O=A<br />  
C1.1/index.html?C=N;O=D<br />  
C1.1/index.html?C=S;O=A<br />  
C1.1/index.html?C=S;O=D<br />  


The attempt to download the data for one tile, i.e. four ACGT tif images per directory, remained unsuccessful when using the command. While the directory structure was downloaded, no images were copied, but the html files listed above. the following commands were used: <br />
<!-- 14 -->
time java -Xmx512m -jar Tranche-Downloader.jar -r _1* HASH <br />  
<tr>
time java -Xmx512m -jar Tranche-Downloader.jar  -r _1_[acgt].tif$ <br />
  <td>PGP/CONTROL/CONTROL_FC00037/CONTROL_FC_00037_L008/</td>
The error messages were: <br />
  <td>1XxXtiy1EhKpWLD+1TEdPP6aXk9+WkAocknP7ZeL35I4EKgwqMeTvjDjttWNerzPjYzhgvA8yAc9CEDzEg4bYUswq+MAAAAAACLfCA==</td>
java.io.IOException: The RemoteTrancheServer is in an inoperable state. Status: download thread is finished<br />
</tr>
at org.tranche.remote.RemoteTrancheServer.checkUploadAndDownloadThreads(RemoteTrancheServer.java:2035)<br />
at org.tranche.remote.RemoteTrancheServer.addCallback(RemoteTrancheServer.java:294)<br />  
at org.tranche.remote.RemoteTrancheServer.hasDataInternal(RemoteTrancheServer.java:1037)<br />  
at org.tranche.remote.RemoteTrancheServer.hasData(RemoteTrancheServer.java:433)<br />  
at org.tranche.get.GetFileTool$DataDownloadingThread.run(GetFileTool.java:4691)<br />  


<!-- 15 -->
<tr>
  <td>PGP/CONTROL/CONTROL_FC00041/CONTROL_FC_00041_L001/</td>
  <td>jxPfUwussDZ7oaZALVawVzvMM/PVIOCSFhLtYwC/S21jDBFnPuA2bdTDQLEjG6SyvH5DDFk6uPEfd79liQ9wslsjyqsAAAAAACLfpg==</td>
</tr>
<!-- 16 -->
<tr>
  <td>PGP/CONTROL/CONTROL_FC00043/CONTROL_FC_00043_L001/</td>
  <td>fA06Jlb13pvjiE3+LDYEhto3qjNFHdPKi9NPp5ncLaJyKbawEm15WDR2Q2J1N9vEYGCZZTCpvloRQcegjKODG6ySXOMAAAAAACLfCA==</td>
</tr>
<!-- 17 -->
<tr>
  <td>PGP/CONTROL/CONTROL_FC00044/CONTROL_FC_00044_L001/</td>
  <td>DP45LxBWNFtcLVsgT8bac6rjAt9xWL6/O6T403L5xzZRh5sbj+R6l7NsEmKE2v8pYPbPDSEgVDEqyRtu84DaezJ40u0AAAAAACLfCA==</td>
</tr>
<!-- 18 -->
<tr>
  <td>PGP/CONTROL/CONTROL_FC00051/CONTROL_FC_00051_L001/</td>
  <td>4VwUCQCWwZj0/eGdN69UoNRVaRuTHaf1kp+YmG1QfkCMY/iMfIybj5RYXcq24fgn2hobrBIzmYuN/d3iy5XZldpu57UAAAAAACLfCA==</td>
</tr>
</table>
<!--
1. PGP/PGP_1/PGP_1_FC00037/PGP_1_FC_00037_L003/
2. PGP/PGP_3/PGP_3_FC00035/PGP_3_FC_00035_L003/
3. PGP/PGP_3/PGP_3_FC00037/PGP_3_FC_00037_L002/
4. PGP/PGP_5/PGP_5_FC00044/PGP_5_FC_00044_L002/
5. PGP/PGP_7/PGP_7_FC00044/PGP_7_FC_00044_L004/
6. PGP/PGP_8/PGP_8_FC00037/PGP_8_FC_00037_L001/
7. PGP/PGP_8/PGP_8_FC00051/PGP_8_FC_00051_L002/
8. PGP/PGP_8/PGP_8_FC00051/PGP_8_FC_00051_L006/
9. PGP/PGP_9/PGP_9_FC00043/PGP_9_FC_00043_L003/
10. PGP/PGP_9/PGP_9_FC00051/PGP_9_FC_00051_L003/
11. PGP/PGP_9/PGP_9_FC00051/PGP_9_FC_00051_L007/
12. PGP/PGP_10/PGP_10_FC00041/PGP_10_FC_00041_L003/
13. PGP/CONTROL/CONTROL_FC00035/CONTROL_FC_00035_L001/
14. PGP/CONTROL/CONTROL_FC00037/CONTROL_FC_00037_L008/
15. PGP/CONTROL/CONTROL_FC00041/CONTROL_FC_00041_L001/
16. PGP/CONTROL/CONTROL_FC00043/CONTROL_FC_00043_L001/
17. PGP/CONTROL/CONTROL_FC00044/CONTROL_FC_00044_L001/
18. PGP/CONTROL/CONTROL_FC00051/CONTROL_FC_00051_L001/
-->


[[Category:PGP]]
[[Category:PGP]]

Latest revision as of 11:09, 21 May 2009

About        Projects        Publications        PersonalGenomes@Home        Public Data        FAQ        Updates (12/23)


People

Tranche

In order to increase the utility of project data and make more of it available to the public, the Personal Genome Project (PGP) has launched PersonalGenomes@Home. This effort uses ProteomeCommons.org's Tranche Network for persistent storage. The Tranche Project is a free and open source file sharing tool that enables collections of computers to easily share and cite scientific data sets. Designed and built with scientists and researchers in mind, Tranche essentially solves the data sharing problem in a secure and scalable fashion.

Tranche User Account

To apply for a user account fill out the form for a ProteomeCommons User Account. Pending applications are reviewed each business day.

System Requirements

Java Runtime Environment 5.0 or later; See System Requirements

Tranche User Guide and Instructions for Up- and Downloads

A detailed user guide can be found Tranche User Guide here.

There are three ways to add or get data from the network:

  1. GUI: Go to the Tranche homepage and click "Launch Tranche". (Requires Java 5+ with Web Start)
  2. Command-line tools: See below
  3. Java API: For custom tools development

The most popular of the three is the GUI, as it is easy to use. The command-line tools are useful for automating tasks or working in headless environments, and the API is useful when integrating Tranche in a software project or for creating a custom tool

Tranche up- and downloads can be run over the command line using the upload tool and the download tool. 

wget --no-check-certificate https://proteomecommons.org/tranche/files/CommandLineAddFileTool.zip  
wget --no-check-certificate https://proteomecommons.org/tranche/files/CommandLineGetFileTool.zip

In order to use these tools you also need a login, which you can get at ProteomeCommons.org.

Download each tool, unzip the file, go into unzipped directory, type java -jar NAME.jar --help to obtain usage information. (If java is not in your system path, add it to your path or type the full path /path/to/java -jar NAME.jar --help.

For usage information java -jar Tranche-Downloader.jar --help
Download a project with a certain hash: java -jar Tranche-Downloader.jar HASH

For usage information: java -jar Tranche-Uploader.jar --help
Upload a file:
java -Xmx521m -jar Tranche-Uploader.jar -u USER.zip.encrypted -p PASSWORD -c true -t "MY TITLE" -d "MY DESCRIPTION" /home/DataForUpload

There is the option to download/upload encrypted data:
java -jar Tranche-Downloader.jar -e supersecret HASH
java -jar Tranche-Uploader.jar -u FILE.zip.encrypted -p supersecret /home/DataForDownpload

Example scripts are provided: download script and upload script.

To get notified about changes and upgrades one can join the automated tool group for command-line tools and API.

Download PGP Data from Tranche

The public PGP data are now available on Tranche.

You have two options when downloading using the command-line tool:

1. To download using the project hash and the path information: 

  java -Xmx512m -jar Tranche-Downloader.jar -r 'PATH' PROJECT_HASH

Where PROJECT_HASH is: 

  xz8EIKO6y5dF9yJeH7+71PGu+f/PKjC9TWyg70gcJMDVH/SaUDxgbHrc8O1zBGxDK+cHlSzS5XYc+mk5H8TyVXh9BTYAAAAAAmRoJA==

2. To download using the hash for the individual run (recommended):

  java -Xmx512m -jar Tranche-Downloader.jar RUN_HASH

Where RUN_HASH can be found in the table below. This second method is recommended because it will likely be faster, as option #2 will not need to load the entire project's information.

The following are available on Tranche. Each of these paths contain directories Cn.1 n=1..36, which each contain the raw images s_lane_tile_[acgt].tif.gz, where the lane is specified in the path by L00lane (e.g. L001), and tile=1..100.


Path Hash
PGP/PGP_1/PGP_1_FC00037/PGP_1_FC_00037_L003/ Uid6OqEDTBVN2TJ77YkMxT2ni9ZkNORsZxJkBD3xs4sQiM7/ltL429u91riEC/SimhUPZrn3FJ9/vN1zUnF4ThxqqfUAAAAAACGNgg==
PGP/PGP_2/PGP_2_FC00037/PGP_2_FC_00037_L002/ sGH85bSuWIstQ12wsH1S3g4bWbupI0NG3B2VBuZmjvDfW54LzEwHYa8d1qdfq8HvDR97Bwp00T+bJvRlnI1vCysgsEwAAAAAACGNgg==
PGP/PGP_3/PGP_3_FC00035/PGP_3_FC_00035_L003/ A+T1fSJ49iUep9eYn7Tggvtohej6AOXZG9Tdiby8P0D293kKFv4AfrlAHf5dmEflWgs3IrIgmK18nrWxRWVrmuX1lO4AAAAAACGNgg==
PGP/PGP_5/PGP_5_FC00044/PGP_5_FC_00044_L002/ KVP7qsEI5ej7vH+MZGbhbhy+CCe5s7z7EUgEAXpnmtQKQS7BHUXlnGAJvKx0Z5U+S3hNRMyD0SaA0WHCzr/h/+FALvkAAAAAACGNgg==
PGP/PGP_7/PGP_7_FC00044/PGP_7_FC_00044_L004/ wJCEGtX4InEVeMAUes8WjgVar+CtjTxi79ptB+TRxJOILXbRjHBdrIvVyQ1XOucn3Wt6scVJG5L8S9l5851eWD+3BF8AAAAAACGNgg==
PGP/PGP_8/PGP_8_FC00037/PGP_8_FC_00037_L001/ /hCd4NlLnXbAmZDFgh6RdMfWk13Wp+IUEXt0sTVvd6ecm4VSLYWzj8yGQB44b5hl0QdxZA+PHfJBuS+VNv+3cMOxnhMAAAAAACGNgg==
PGP/PGP_8/PGP_8_FC00051/PGP_8_FC_00051_L002/ bzEgXZaqsGsYxyPRWGTdVbuwpONcu2QMqpSS85PeiOrQhSEKccmAHKHrT7nU5vsLUVyXqjLGzCUS2AnFVUvkXY8xf70AAAAAACGOrA==
PGP/PGP_8/PGP_8_FC00051/PGP_8_FC_00051_L006/ BYSZDtW8LiCaIg8qgRZsdeJQK+X7n556/CD84ro77wj3rp9MLQib4H/oiPSYjfnTih3CZwTDtJeJ41toR0GVWzDvJW8AAAAAACGOGA==
PGP/PGP_9/PGP_9_FC00043/PGP_9_FC_00043_L003/ vI7IzPUUfTDv2PzCm/6Ks7yiLiFJEc+IikrDZXQNmSwivAvDb0fMyKARuBYazYi5SCN/C8aAIXGqsuvKkTQYkfdvzWgAAAAAACGNgg==
PGP/PGP_9/PGP_9_FC00051/PGP_9_FC_00051_L003/ rIfl/1sK7hJWfFi5CYnhqNwZDSfZdRDUSOoTov6bD8+ovDJgA6MgaM0Lo3svZHM4DwkG4xDCG0k+dUbk5W3gI3X/iksAAAAAACGNgg==
PGP/PGP_9/PGP_9_FC00051/PGP_9_FC_00051_L007/ Qk+/y0bHvqdaBukutHqul6XPLQnbxGAxS5gwIPvzfgGeX79CNUe6nLa1K0ncdSn0Bu81n/NitPwMUvPMocaROhKHL3MAAAAAACGNgg==
PGP/PGP_10/PGP_10_FC00041/PGP_10_FC_00041_L003/ 3ZvbBigaeOnOMrJmT/vcBMo95pgNz86RXrB8UJypMStaaannHRQSnnkj3H9ojZ1VFiYO8V3ZFGdPDcOkPgzTigr4WE0AAAAAACI2RQ==
PGP/CONTROL/CONTROL_FC00035/CONTROL_FC_00035_L001/ g1BoTW5DmYTlAsG7U1hi85sXfM7+xtaIDQlEXO2ThqCwZRpgrnKp1MHRFsI2Xrv6xOEcDUcP7Z4pdUWb6ByGBk/cJ58AAAAAACLfCA==
PGP/CONTROL/CONTROL_FC00037/CONTROL_FC_00037_L008/ 1XxXtiy1EhKpWLD+1TEdPP6aXk9+WkAocknP7ZeL35I4EKgwqMeTvjDjttWNerzPjYzhgvA8yAc9CEDzEg4bYUswq+MAAAAAACLfCA==
PGP/CONTROL/CONTROL_FC00041/CONTROL_FC_00041_L001/ jxPfUwussDZ7oaZALVawVzvMM/PVIOCSFhLtYwC/S21jDBFnPuA2bdTDQLEjG6SyvH5DDFk6uPEfd79liQ9wslsjyqsAAAAAACLfpg==
PGP/CONTROL/CONTROL_FC00043/CONTROL_FC_00043_L001/ fA06Jlb13pvjiE3+LDYEhto3qjNFHdPKi9NPp5ncLaJyKbawEm15WDR2Q2J1N9vEYGCZZTCpvloRQcegjKODG6ySXOMAAAAAACLfCA==
PGP/CONTROL/CONTROL_FC00044/CONTROL_FC_00044_L001/ DP45LxBWNFtcLVsgT8bac6rjAt9xWL6/O6T403L5xzZRh5sbj+R6l7NsEmKE2v8pYPbPDSEgVDEqyRtu84DaezJ40u0AAAAAACLfCA==
PGP/CONTROL/CONTROL_FC00051/CONTROL_FC_00051_L001/ 4VwUCQCWwZj0/eGdN69UoNRVaRuTHaf1kp+YmG1QfkCMY/iMfIybj5RYXcq24fgn2hobrBIzmYuN/d3iy5XZldpu57UAAAAAACLfCA==
Retrieved from "https://openwetware.org/mediawiki/index.php?title=PGP_and_Tranche&oldid=309700"