<commit_before># Cart and File Download

## Overview

While browsing through the GDC Data Portal, files can be downloaded either individually or bundled through a cart mechanism similar to online stores.


## GDC Cart

[![Cart](images/gdc-data-portal-cart.png)](images/gdc-data-portal-cart.png "Click to see the full image.")

### Cart Summary

The cart page shows a summary of all files currently in the cart:

* Number of files
* Number of cases associated with the files
* Total file size

The Cart page also displays two charts: 

* File count by project 
* File count by authorization level to those files: this number takes into account the user authorization to download a file upon his authentication to the GDC Data Portal.

### Cart table

The Cart table shows the list of all the files that were added to the Cart.

The user can click on the links to get more information on each file, it will link to:

* The file entity page
* The case entity page
* The project entity page


## Download Options

From the cart, the fowllowing download options are available to the end user:

* __Manifest__: Manifest used by the GDC Data Transfer Tool to download the files.
* __Cart__: All the files in the Cart downloaded directly through the browser. Users have to be cautious of the amount of data in the cart since this option will not optimize bandwidth neither provide resume capabilities.
* __Clinical__: GDC harmonized clinical data associated with the cases in the cart.
* __Biospecimen__: GDC harmonized biospecimen data associated with the cases in the cart.
* __SRA XML__: Experiment, analysis and run metadata files associated with the files in the cart
* __File Metadata__: Metadata of the files in the cart (file properties, associated entities and workflow information if applicable).

Although an entire cart could be downloaded from Web Browsers, those are not ideally equipped to download very large files, in particular due to the absence of a retry/resume mechanism. To improve user experience we implemented a limit of 5 GB for direct cart download. Over 5 GB we recommend using the GDC Data Transfer Tool.

__Note__: when downloading multiple files from the GDC Data Portal, those files are automatically bundled-up into one single Gzipped (.tar.gz) file.

### GDC Data Transfer Tool

The "Download Manifest" button will download a manifest that can be imported into the GDC Data Transfer Tool.

```manifest
id	filename	md5	size	state
4ea9c657-8f85-44d0-9a77-ad59cced8973	mdanderson.org_ESCA.MDA_RPPA_Core.mage-tab.1.1.0.tar.gz		2516051	live
b8342cd5-330e-440b-b53a-1112341d87db	mdanderson.org_SARC.MDA_RPPA_Core.mage-tab.1.1.0.tar.gz		4523632	live
c57673ac-998a-4a50-a12b-4cac5dc3b72e	mdanderson.org_KIRP.MDA_RPPA_Core.mage-tab.1.2.0.tar.gz		4195746	live
3f22dd8d-59c8-43a4-89cf-3b595f2e5a06	14-3-3_beta-R-V_GBL1112940.tif	56df0e4b4fc092fc3643bd2e316ac05b	6257840	live
7ce05059-9197-4d38-830f-04356f5f851a	14-3-3_beta-R-V_GBL11066140.tif	6abfee483974bc2e61a37b5499ae9a07	6261580	live
8e00d22a-ca6f-4da8-a1c3-f23144cb21b7	14-3-3_beta-R-V_GBL1112940.tif	56df0e4b4fc092fc3643bd2e316ac05b	6257840	live
96487cd7-8fa8-4bee-9863-17004a70b2e9	14-3-3_beta-R-V_GBL1112940.tif	56df0e4b4fc092fc3643bd2e316ac05b	6257840	live
```<commit_msg>Update Cart.md<commit_after># Cart and File Download

## Overview

While browsing through the GDC Data Portal, files can be downloaded either individually or bundled through a cart mechanism similar to online stores.


## GDC Cart

[![Cart](images/gdc-data-portal-cart.png)](images/gdc-data-portal-cart.png "Click to see the full image.")

### Cart Summary

The cart page shows a summary of all files currently in the cart:

* Number of files
* Number of cases associated with the files
* Total file size

The Cart page also displays two charts: 

* File count by project 
* File count by authorization level to those files: this number takes into account the user authorization to download a file upon his authentication to the GDC Data Portal.

### Cart table

The Cart table shows the list of all the files that were added to the Cart.

The user can click on the links to get more information on each file, it will link to:

* The file entity page
* The case entity page
* The project entity page


## Download Options

From the cart, the following download options are available to the end user:

* __Manifest__: Manifest used by the GDC Data Transfer Tool to download the files.
* __Cart__: All the files in the Cart downloaded directly through the browser. Users have to be cautious of the amount of data in the cart since this option will not optimize bandwidth neither provide resume capabilities.
* __Clinical__: GDC harmonized clinical data associated with the cases in the cart.
* __Biospecimen__: GDC harmonized biospecimen data associated with the cases in the cart.
* __SRA XML__: Experiment, analysis and run metadata files associated with the files in the cart
* __File Metadata__: Metadata of the files in the cart (file properties, associated entities and workflow information if applicable).

Although an entire cart could be downloaded from Web Browsers, those are not ideally equipped to download very large files, in particular due to the absence of a retry/resume mechanism. To improve user experience we implemented a limit of 5 GB for direct cart download. Over 5 GB we recommend using the GDC Data Transfer Tool.

__Note__: when downloading multiple files from the GDC Data Portal, those files are automatically bundled-up into one single Gzipped (.tar.gz) file.

### GDC Data Transfer Tool

The "Download Manifest" button will download a manifest that can be imported into the GDC Data Transfer Tool.

```manifest
id	filename	md5	size	state
4ea9c657-8f85-44d0-9a77-ad59cced8973	mdanderson.org_ESCA.MDA_RPPA_Core.mage-tab.1.1.0.tar.gz		2516051	live
b8342cd5-330e-440b-b53a-1112341d87db	mdanderson.org_SARC.MDA_RPPA_Core.mage-tab.1.1.0.tar.gz		4523632	live
c57673ac-998a-4a50-a12b-4cac5dc3b72e	mdanderson.org_KIRP.MDA_RPPA_Core.mage-tab.1.2.0.tar.gz		4195746	live
3f22dd8d-59c8-43a4-89cf-3b595f2e5a06	14-3-3_beta-R-V_GBL1112940.tif	56df0e4b4fc092fc3643bd2e316ac05b	6257840	live
7ce05059-9197-4d38-830f-04356f5f851a	14-3-3_beta-R-V_GBL11066140.tif	6abfee483974bc2e61a37b5499ae9a07	6261580	live
8e00d22a-ca6f-4da8-a1c3-f23144cb21b7	14-3-3_beta-R-V_GBL1112940.tif	56df0e4b4fc092fc3643bd2e316ac05b	6257840	live
96487cd7-8fa8-4bee-9863-17004a70b2e9	14-3-3_beta-R-V_GBL1112940.tif	56df0e4b4fc092fc3643bd2e316ac05b	6257840	live
```
{'fraction_non_alphanumeric': 0.05555555555555555, 'fraction_numerical': 0.0997229916897507, 'mean_word_length': 4.756421612046059, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 26, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2120584', 'n_tokens_mistral': 2491, 'n_tokens_neox': 2142, 'n_words': 823}