Beauchamp:CreateAFNIBRIKfromMR: Difference between revisions

From OpenWetWare
Jump to navigationJump to search
No edit summary
(61 intermediate revisions by 4 users not shown)
Line 1: Line 1:
== Getting Data From the UT Philips Scanner ==
{{Beauchamp Navigation Bar}}
MR data can be sent directly from the Philips scanner to the RAID.  
 
The data will end up in
{| cellspacing="2px" cellpadding="0" border="0" style="padding: 0px; width: 750px; color: #000000; background-color: #ffffff;"
  /Volumes/data2/raw
|-valign="top"
in a directory name that is made by Vips, the scanner technologist.
|width=400px style="padding: 5px; background-color: #ffffff; border: 2px solid #CC6600;" |
Depending on how it is exported from the scanner, the data will be one of three formats:
 
Previous step is
[[Beauchamp:HowToScan|How to Collect MRI Data and Use the Scanner]]
Next step is
[[Beauchamp:CreateAFNIBRIK|Turning the raw data into AFNI BRIKs]]
 
== Overview ==
 
We copy all data (from any scanner) to an analysis directory on the Beauchamp Lab server. This is usually in the format
/Volumes/data/UT/XX
Where "XX" is a unique two-letter code that corresponds to the experiment.
 
== Getting Data From the UT Philips Scanner if you are at UT ==
 
The MRI data can be transferred from the scanner in a number of ways; the only fail-safe method is to take a removable USB drive to the scanner room and copy the data directly to it. Alternately, the data can be placed somewhere "in the cloud" by the scanner tech and then moved to the correct place on the server.
One place is the UT NAS. Connect to the NAS by hitting Apple-K and then
 
Login with your UT ID and password. Navigate to the correct directory and copy to the experiment directory.
On the scanner, it may be necessary to use the IP address in windows format (Windows Explorer or My Computer, Tools, Map Network Drive):
 
Another place the data could be placed is in a folder on our server. You must find it and move it to the correct location (experiment directory, "raw" subdirectory).
The folder will be named by Vips (ask him for the name if you cannot find it) and is located on the server internal hard disk, as opposed to the RAID connected to the server.
<b>GUI Version</b>. Make sure that both the "data" drive (RAID) AND "beauchamplab" (server internal hard disk) are mounted on your Mac. Apple-K to XXXXXXX and select both if they are not.
Open one finder window and navigate to ms-nbafmri/beauchamplab and find the folder with your data in it. Move or copy it to the correct experiment directory.
<b>Command line version</b>.
 
Navigate to the correct directory. Then, copy to the correct location on the server as follows. Replace the sample directory name with the desired one; this is the name given by Vips. Be sure you have created the experiment directory, including the raw subdirectory, already.
cp -r ZAP_081612/* /Volumes/Pegasus/data/UT/ZAP/raw/
 
<b>More Notes</b>
 
Depending on how the data is exported from the scanner, the data will be one of three formats:


NiFTI Format
NiFTI Format
Line 19: Line 50:
Each file contains one image, so that one run has thousands of images in it.
Each file contains one image, so that one run has thousands of images in it.


== Getting Data from other Scanners ==
Method 1:
Vips doesn't like this because it is too slow.
Using a package called ExpanDrive
  https://secure.expandrive.com/
Vips can connect directly to a Mac server with scp (ssh must be enabled on the server).
He will copy it to the "BeauchampServer" dirve mounted on the Philips console. This is a link to the ms-nbafmri server located at 139.52.4.123
(For Tim's data, it is copied to data on ike).
The next step is to copy it from the ms-nbafmri server to the correct experiment directory. Here are the steps to do that:
 
For ms-nbafmri ii is copied to the admin home directory (on the server hard disk) and needs to be copied to the correct location (on the Promise RAID).
 
Use the Amazon/Gmail lab password. Find where the data is located.
  cd DATA
  ls
Then, copy to the correct location on the server as follows. (Replace the sample directory name with the desired one; this is the name given by Vips).
cp -r ZAP_081612 /Volumes/Pegasus/data/UT/
 
Method 2:
Faster for Vips, but involves an extra step for us.
Data can be copied to the NAS and then transferred from there to the server. On Windows, mount the NAS with
 
On Macs, Apple-K and then
 
For either case, log in with your UT user ID and password.
 
OLDER:
MR data can be sent directly from the Philips scanner to an external hard drive attached to bidwell. (For some reason, the scanner PC cannot connect to Ike or the RAID).
The data will end up on bidwell on in
  /Volumes/Users/mri/data
(which is a link to the "My Passport" external hard disk).
Vips will usually put it in a subdirectory on bidwell e.g.
 
 
The data should be copied to /data1 for analysis using this command:


Data from other scanners will often be stored in DICOM or other formats. DICOM is the standard file format for storing medical data. Typically each scan is saved in a unique folder and each file represents a single slice. OsiriX is a free DICOM viewer for Macs and can be downloaded from the following URL:


http://homepage.mac.com/rossetantoine/osirix/
If you are not sure what directory to use, you can open a window to bidwell with the following command


OsiriX can often extract images from DICOM or other formats and write them out to a directory in standard DICOM format.
  cd ~mri/data/DR_BEAUCHAMP_2010
Then, to3d is used to convert the extracted DICOM files to AFNI BRIK/HEAD files.
  ls
  exit


== Getting Data From the UT Philips Scanner if you are at Rice or somewhere else outside UT ==


=== Using to3d from the command line ===
Vips will copy the data to the Beauchamp Lab server bidwell on (129.106.236.180) in
  /Volumes/Users/mri/data
(which is a link to the "My Passport" external hard disk).
Vips will usually put it in a subdirectory on bidwell e.g.
  ~mri/data/DR_BEAUCHAMP_2010/ZAE_042710


If scanner data is obtained in NiFTI format, then no conversion is necessary (see above). For all other types of scanner data, the program to3d is used to convert the raw data to AFNI BRIK/HEAD files.
To log in to this machine from Rice, you must VPN onto the UT network, follow the instructions on
The preferred way to run to3d is from the command line, so that all parameters are recorded and the process can be automated.
  http://its.uth.tmc.edu/vpn_home.htm
To see the to3d options  check the help file:
Next, ssh to bidwell
  to3d –help | more


To process an anatomical dataset, to3d is quite simple because there is only one timepoint.  
And navigate to the directory where the data is found.
  set session = /Volumes/data1/UT/CD/afni
  to3d -session $session -prefix CDanat  IM_*


This creates an AFNI BRIK/HEAD named CD anat from the anatomical DICOM images in the current directory and places them in the "session" directory.
Finally, use the scp command to copy the desired data to the machine outside UT. This will only work if the target machine has an appropriate IP address (in a public domain). This can be tested by ping-ing the target machine.
AFNI reads information about the images from the DICOM header so that the voxel size and image origin is automatically correct in the BRIK/HEAD file.


To process a functional dataset, to3d if more complicated because we must tell it how many timepoints there were (this information is NOT in the DICOM header). Here is the to3d command to create a BRIK/HEAD from a functional run of DICOM images.
Don't forget the trailing colon, it is critical.
   to3d -session {$session} -skip_outliers -epan -prefix CDr1 -time:tz 110 33 2750 alt+z  IM_*  00000001/IM_*  00000002/IM_*  
How long does this take for a typical experiment (this one is 7 fMRI runs and 2 T1s, about 1 GB), start at
   Fri Jun  3 11:38:03 CDT 2011
finish at
  Fri Jun 3 11:44:47 CDT 2011
About 6 minutes total for 1 GB, not too bad.


Alternately, we can run to3d on the PAR/REC file.
== Getting Data from the BCM Siemens Scanners ==
To save the data after you scan, follow these steps:
#Click on the experiment to export; can see all experiments in the Patient Browser (accessed with button in bottom right of numeric keypad that has folders on it)
#Click Transfer, Export Offline
#Select  from the drop down menu (first item)
#Manually type in \Beauchamp to access our lab folder
# to try: Manually type in \Beauchamp\newdata
# this should copy into a folder called newdata, then rename with the current date and make a new newdata folder
To transfer the data to our server:
# VPN into BCM, type


# navigate to the correct directory and copy to a "raw" directory on your desktop
# disconnect from VPN, reconnect to Beauchamp Lab server, copy raw directory to correct experiment directory


===Using to3d from the GUI interface ===
To save to a flash drive: Export to Off-Line, Select flash drive, export


If all of the necessary arguments to create a BRIK/HEAD file are given from the command line, then to3d will create the BRIK/HEAD file and finish.
To save to TABS (the Mac next to the console on 3T-5) where it can then be put on DropBox or elsewhere: Send to tabsSCP
If some arguments are missing, then to3d will display a GUI.
  cd /Users/tabs/tabs/dicom
For instance, simply go to the directory containing the raw DICOM files and type
The DCM files will be placed in a directory named with the date and time, e.g.
to3d *
from the correct folder. Below is a picture of the GUI interface with the most commonly edited options highlighted. Note that the bottom right of the window includes buttons to view the images, save the dataset, and quit. Normally to3d reads the variable information from the DICOM headers and nothing needs to be changed. Only the filename prefix needs to be set.


[[Image:To3d.jpg| 600px]]




=== Averaging Anatomical Scans Using AFNI ===
Here is the old way:
After you scan, the technologist will send you an e-mail with the link to the data.
If necessary, make a new directory
  mkdir /Volumes/data1/UT/JL
  cd /Volumes/data1/UT/JL
  mkdir raw
  cd raw
And then click on the link and download the data to this directory (called "raw" for ease of reference). The data is stored as an .iso file. Double click on the .iso file to open a window that lists the component data files (with .ima suffix). Click and drag these into the raw directory.


To register all the anatomicals to the space of the anatomical closest in time to the functional data (generally anatr1), this is with just two anatomical's:
== Getting Data from other Scanners  ==


  3dAllineate -base ${subj}anatr1+orig -source ${subj}anatr2+orig -prefix ${subj}anatr2_2RegTo1 -verb -warp shift_rotate -cost mi -automask -1Dfile ${subj}anatr2toanatr1
Data from other scanners will often be stored in DICOM or other formats. DICOM is the standard file format for storing medical data. Typically each scan is saved in a unique folder and each file represents a single slice. OsiriX is a free DICOM viewer for Macs and can be downloaded from the following URL:


Average anatomicals into one dataset:
http://homepage.mac.com/rossetantoine/osirix/


  3dmerge -gnzmean -nscale -prefix ${subj}anatavg ${subj}anatr1+orig ${subj}anatr2_2RegTo1+orig
OsiriX can often extract images from DICOM or other formats and write them out to a directory in standard DICOM format.
Then, to3d is used to convert the extracted DICOM files to AFNI BRIK/HEAD files.

Revision as of 11:13, 2 October 2014

Brain picture
Beauchamp Lab



Previous step is How to Collect MRI Data and Use the Scanner Next step is Turning the raw data into AFNI BRIKs

Overview

We copy all data (from any scanner) to an analysis directory on the Beauchamp Lab server. This is usually in the format /Volumes/data/UT/XX Where "XX" is a unique two-letter code that corresponds to the experiment.

Getting Data From the UT Philips Scanner if you are at UT

The MRI data can be transferred from the scanner in a number of ways; the only fail-safe method is to take a removable USB drive to the scanner room and copy the data directly to it. Alternately, the data can be placed somewhere "in the cloud" by the scanner tech and then moved to the correct place on the server. One place is the UT NAS. Connect to the NAS by hitting Apple-K and then

Login with your UT ID and password. Navigate to the correct directory and copy to the experiment directory. On the scanner, it may be necessary to use the IP address in windows format (Windows Explorer or My Computer, Tools, Map Network Drive):

Another place the data could be placed is in a folder on our server. You must find it and move it to the correct location (experiment directory, "raw" subdirectory). The folder will be named by Vips (ask him for the name if you cannot find it) and is located on the server internal hard disk, as opposed to the RAID connected to the server. GUI Version. Make sure that both the "data" drive (RAID) AND "beauchamplab" (server internal hard disk) are mounted on your Mac. Apple-K to XXXXXXX and select both if they are not. Open one finder window and navigate to ms-nbafmri/beauchamplab and find the folder with your data in it. Move or copy it to the correct experiment directory. Command line version.

Navigate to the correct directory. Then, copy to the correct location on the server as follows. Replace the sample directory name with the desired one; this is the name given by Vips. Be sure you have created the experiment directory, including the raw subdirectory, already.

cp -r ZAP_081612/* /Volumes/Pegasus/data/UT/ZAP/raw/

More Notes

Depending on how the data is exported from the scanner, the data will be one of three formats:

NiFTI Format

 tms_10_10_1.nii

This is the preferred format because it can be read by AFNI directly.

PAR/REC Format

 tms_10_10_1.PAR
 tms_10_10_1.REC

This is the native Philips format. The PAR file contains the data PARameters. The REC file contains the raw REConstructed data for the entire run.

DICOM format

 IM_2048

Each file contains one image, so that one run has thousands of images in it.

Method 1: Vips doesn't like this because it is too slow. Using a package called ExpanDrive

 https://secure.expandrive.com/

Vips can connect directly to a Mac server with scp (ssh must be enabled on the server). He will copy it to the "BeauchampServer" dirve mounted on the Philips console. This is a link to the ms-nbafmri server located at 139.52.4.123 (For Tim's data, it is copied to data on ike). The next step is to copy it from the ms-nbafmri server to the correct experiment directory. Here are the steps to do that:

For ms-nbafmri ii is copied to the admin home directory (on the server hard disk) and needs to be copied to the correct location (on the Promise RAID).

Use the Amazon/Gmail lab password. Find where the data is located.

 cd DATA
 ls

Then, copy to the correct location on the server as follows. (Replace the sample directory name with the desired one; this is the name given by Vips).

cp -r ZAP_081612 /Volumes/Pegasus/data/UT/

Method 2: Faster for Vips, but involves an extra step for us. Data can be copied to the NAS and then transferred from there to the server. On Windows, mount the NAS with

On Macs, Apple-K and then

For either case, log in with your UT user ID and password.

OLDER: MR data can be sent directly from the Philips scanner to an external hard drive attached to bidwell. (For some reason, the scanner PC cannot connect to Ike or the RAID). The data will end up on bidwell on in

 /Volumes/Users/mri/data

(which is a link to the "My Passport" external hard disk). Vips will usually put it in a subdirectory on bidwell e.g.


The data should be copied to /data1 for analysis using this command:


If you are not sure what directory to use, you can open a window to bidwell with the following command

 cd ~mri/data/DR_BEAUCHAMP_2010
 ls
 exit

Getting Data From the UT Philips Scanner if you are at Rice or somewhere else outside UT

Vips will copy the data to the Beauchamp Lab server bidwell on (129.106.236.180) in

 /Volumes/Users/mri/data

(which is a link to the "My Passport" external hard disk). Vips will usually put it in a subdirectory on bidwell e.g.

 ~mri/data/DR_BEAUCHAMP_2010/ZAE_042710

To log in to this machine from Rice, you must VPN onto the UT network, follow the instructions on

 http://its.uth.tmc.edu/vpn_home.htm

Next, ssh to bidwell

And navigate to the directory where the data is found.

Finally, use the scp command to copy the desired data to the machine outside UT. This will only work if the target machine has an appropriate IP address (in a public domain). This can be tested by ping-ing the target machine.

Don't forget the trailing colon, it is critical. How long does this take for a typical experiment (this one is 7 fMRI runs and 2 T1s, about 1 GB), start at

 Fri Jun  3 11:38:03 CDT 2011

finish at

 Fri Jun  3 11:44:47 CDT 2011

About 6 minutes total for 1 GB, not too bad.

Getting Data from the BCM Siemens Scanners

To save the data after you scan, follow these steps:

  1. Click on the experiment to export; can see all experiments in the Patient Browser (accessed with button in bottom right of numeric keypad that has folders on it)
  2. Click Transfer, Export Offline
  3. Select from the drop down menu (first item)
  4. Manually type in \Beauchamp to access our lab folder
  5. to try: Manually type in \Beauchamp\newdata
  6. this should copy into a folder called newdata, then rename with the current date and make a new newdata folder

To transfer the data to our server:

  1. VPN into BCM, type
  1. navigate to the correct directory and copy to a "raw" directory on your desktop
  2. disconnect from VPN, reconnect to Beauchamp Lab server, copy raw directory to correct experiment directory

To save to a flash drive: Export to Off-Line, Select flash drive, export

To save to TABS (the Mac next to the console on 3T-5) where it can then be put on DropBox or elsewhere: Send to tabsSCP

 cd /Users/tabs/tabs/dicom

The DCM files will be placed in a directory named with the date and time, e.g.


Here is the old way: After you scan, the technologist will send you an e-mail with the link to the data. If necessary, make a new directory

 mkdir /Volumes/data1/UT/JL
 cd /Volumes/data1/UT/JL
 mkdir raw
 cd raw

And then click on the link and download the data to this directory (called "raw" for ease of reference). The data is stored as an .iso file. Double click on the .iso file to open a window that lists the component data files (with .ima suffix). Click and drag these into the raw directory.

Getting Data from other Scanners

Data from other scanners will often be stored in DICOM or other formats. DICOM is the standard file format for storing medical data. Typically each scan is saved in a unique folder and each file represents a single slice. OsiriX is a free DICOM viewer for Macs and can be downloaded from the following URL:

http://homepage.mac.com/rossetantoine/osirix/

OsiriX can often extract images from DICOM or other formats and write them out to a directory in standard DICOM format. Then, to3d is used to convert the extracted DICOM files to AFNI BRIK/HEAD files.