The simplest but least performant way to download data is from the PNCC User Portal.
- Log in to the portal with your EMSL-assigned email address and password. On the home page, click on “Get Data” tile. On the resulting page, scroll to your project number and relevant microscope. Click on the microscope name and you will be taken to a search page that will show the selected project and instrument, and let you refine your search criteria if desired.
- Click on the box next to dataset you want to download and a cart will be made. The cart may take a few minutes to a couple hours to make depending on file size and how many others tried to start a cart. You may leave the page and return to it later; the portal will continue preparing your data. Once the cart is finished a link will appear on the page that you can click on to start the download directly over your web connection.
- If your local connection is intermittent and the download gets halted, you can copy the download link and use WGET or ARIA2 download managers which can resume after disruption and also offer parallelized download options for big files.
- Once you have the files, depending on your computing platform, you can extract the files by the following means...
- Macintosh
Double click on the downloaded file in the Finder.
- Windows
Download 7-Zip and install it on your machine. Right-click on the downloaded file and choose: 7-Zip > Extract Here
- Linux
From a terminal window, type tar -xf your_tar_file.tar - To keep the file sizes small and facilitate the transfer, the movie files and other data may be compressed separately using Zstandard (https://github.com/facebook/zstd). To uncompress, download Zstandard from GitHUB and then use the command “zstd -d file.zst” to recover the original raw file. You can write a quick C-shell script to loop across all files. An example of the script could be
foreach stack_file ( *.zst )
set stack_filename = `ls ${stack_file} | cut -d . -f1`
echo ${stack_filename}
zstd -d ${stack_file}
end
Notes:
- A “Project Team Access” banner across the corner of the Upload pane indicates that the data set has not yet been released to the public. This means it is available only to approved members of the project and authorized EMSL staff. As an authorized member of the project, you should be able to download this data.
- If you do not see any instruments or data sets on the portal pages, make sure you go to PNCC User Portal and log in, then reload the pages. Also, select the appropriate date range for the data you are looking for.