<commit_before>.. _manage:

Manage: Managing data
================================

The **Manage** page allows you manage data in the Whole Tale system including:

- Uploading data from your local machine
- Registering data from remote resources
- Sharing data with other users

.. _home-folder:

Home Folder
-----------

The **Home** folder is your personal workspace in the Whole Tale system. You
can perform most common operations including uploading, creating, 
moving, renaming, and deleting files and folders.  

Your **Home** folder is mounted into every running tale instance with full
read-write permissions. This means that you can access and manage files from
both the Whole Tale dashboard and within tale environments. This is in contrast
to the **Data** folder described below, which is limited to read-only access.

Adding Data
^^^^^^^^^^^
Files on your computer can be uploaded to the **Home** folder by using the 
file selector dialog. To open the file selector, 

    1. Click on the **Home** directory
    2. Mouse over the blue addition symbol
    3. Select the **Upload** icon

.. image:: images/manage/home_upload.png
     :align: center
     :scale: 70%
         
.. _data-folder:

Data Folder
-----------

The **Data** folder contains references to data you've registered in the system
for use with tales. This data is meant to be read only, and can only be added
from external sources.

Supported Data Repositories
^^^^^^^^^^^^^^^^^^^^^^^^^^^
The current supported repositories that you can register data from are 
  1. DataONE_:
  A federation of data repositories with a focus on scientific data.
  A list of participating member nodes can be found on the member
  node `information page`_.
  
  2. Globus_:
  A service geared towards researchers and computing managers that allows
  custom APIs, data publication, and file transfer.

Adding Data
^^^^^^^^^^^
Files and folders cannot be uploaded to the **Data** folder directly. To
encourage reproducibility, only data registered from external resources or
associated with a tale will be available in the **Data** folder.

To register data from an external resource, use the data registration dialog,
shown below.

.. image:: images/manage/data_registration_modal.png
     :align: center
     :scale: 70%
     
To access this dialog, navigate to the **Data** folder by clicking the link icon
below the home directory folder.

.. image:: images/manage/data_upload.png
     :align: center
     :scale: 70%
     
The blue addition icon will open the registration dialog where you can find 
and register your data. You'll need to have either the DOI or data package URL
to find the data.

Adding Data From DataONE
""""""""""""""""""""""""
Data packages from DataONE_ can be integrated into Whole Tale by searching for
the DOI of the package or by pasting the URL into the search box in the 
registration modal.

By DOI<commit_msg>Image Adjustments<commit_after>.. _manage:

Manage: Managing data
================================

The **Manage** page allows you manage data in the Whole Tale system including:

- Uploading data from your local machine
- Registering data from remote resources
- Sharing data with other users

.. _home-folder:

Home Folder
-----------

The **Home** folder is your personal workspace in the Whole Tale system. You
can perform most common operations including uploading, creating, 
moving, renaming, and deleting files and folders.  

Your **Home** folder is mounted into every running tale instance with full
read-write permissions. This means that you can access and manage files from
both the Whole Tale dashboard and within tale environments. This is in contrast
to the **Data** folder described below, which is limited to read-only access.

Adding Data
^^^^^^^^^^^
Files on your computer can be uploaded to the **Home** folder by using the 
file selector dialog. To open the file selector, 

    1. Click on the **Home** directory
    2. Mouse over the blue addition symbol
    3. Select the **Upload** icon

.. image:: images/manage/home_upload.png
     :align: center
     :scale: 70%
         
.. _data-folder:

Data Folder
-----------

The **Data** folder contains references to data you've registered in the system
for use with tales. This data is meant to be read only, and can only be added
from external sources.

Supported Data Repositories
^^^^^^^^^^^^^^^^^^^^^^^^^^^
The current supported repositories that you can register data from are 
  1. DataONE_:
  A federation of data repositories with a focus on scientific data.
  A list of participating member nodes can be found on the member
  node `information page`_.
  
  2. Globus_:
  A service geared towards researchers and computing managers that allows
  custom APIs, data publication, and file transfer.

Adding Data
^^^^^^^^^^^
Files and folders cannot be uploaded to the **Data** folder directly. To
encourage reproducibility, only data registered from external resources or
associated with a tale will be available in the **Data** folder.

To register data from an external resource, use the data registration dialog,
shown below.

.. image:: images/manage/data_registration_modal.png
     :align: center
     :scale: 70%
     :height: 250
     
To access this dialog, navigate to the **Data** folder by clicking the link icon
below the home directory folder.

.. image:: images/manage/data_upload.png
     :align: center
     :scale: 60%
     
The blue addition icon will open the registration dialog where you can find 
and register your data. You'll need to have either the DOI or data package URL
to find the data.

Adding Data From DataONE
""""""""""""""""""""""""
Data packages from DataONE_ can be integrated into Whole Tale by searching for
the DOI of the package or by pasting the URL into the search box in the 
registration modal.

By DOI
{'fraction_non_alphanumeric': 0.09303123927222795, 'fraction_numerical': 0.004291108822519739, 'mean_word_length': 3.8117258464079273, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6307760', 'n_tokens_mistral': 1545, 'n_tokens_neox': 1428, 'n_words': 816}