<commit_before>
.. _chapter_resources:

List of Pre-Configured Resources
================================

The following list of resources are supported by the underlying layers of ExTASY. 

.. note:: To configure your applications to run on these machines, you would need to add entries to your kernel definitions and specify the environment to be loaded for execution, executable, arguments, etc.

RESOURCE_ORNL
-------------

TITAN
*****

The Cray XK7 supercomputer located at the Oak Ridge Leadership Computing Facility (OLCF), (https://www.olcf.ornl.gov/titan/)

* **Resource label**      : ``ornl.titan``
* **Raw config**          : :download:`resource_ornl.json <../../src/radical/pilot/configs/resource_ornl.json>`
* **Note**            : Requires the use of an RSA SecurID on every connection.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : batch``
 * ``sandbox       : $MEMBERWORK/`groups | cut -d' ' -f2```
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh, local, go``

RESOURCE_DAS4
-------------

FS2
***

The Distributed ASCI Supercomputer 4 (http://www.cs.vu.nl/das4/).

* **Resource label**      : ``das4.fs2``
* **Raw config**          : :download:`resource_das4.json <../../src/radical/pilot/configs/resource_das4.json>`
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : all.q``
 * ``sandbox       : $HOME``
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh``

RESOURCE_EPSRC
--------------

ARCHER
******

The EPSRC Archer Cray XC30 system (https://www.archer.ac.uk/)

* **Resource label**      : ``epsrc.archer``
* **Raw config**          : :download:`resource_epsrc.json <../../src/radical/pilot/configs/resource_epsrc.json>`
* **Note**            : Always set the ``project`` attribute in the ComputePilotDescription or the pilot will fail.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : standard``
 * ``sandbox       : /work/`id -gn`/`id -gn`/$USER``
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh``

ARCHER_APRUN
************

The EPSRC Archer Cray XC30 system (https://www.archer.ac.uk/)

* **Resource label**      : ``epsrc.archer_aprun``
* **Raw config**          : :download:`resource_epsrc.json <../../src/radical/pilot/configs/resource_epsrc.json>`
* **Note**            : Always set the ``project`` attribute in the ComputePilotDescription or the pilot will fail.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : standard``
 * ``sandbox       : /work/`id -gn`/`id -gn`/$USER``
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh``

RESOURCE_NERSC
--------------

EDISON_CCM
**********

The NERSC Edison Cray XC30 in Cluster Compatibility Mode (https://www.nersc.gov/users/computational-systems/edison/)

* **Resource label**      : ``nersc.edison_ccm``
* **Raw config**          : :download:`resource_nersc.json <../../src/radical/pilot/configs/resource_nersc.json>`
* **Note**            : For CCM you need to use special ccm_ queues.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : ccm_queue``
 * ``sandbox       : $SCRATCH``
 * ``access_schema : ssh``<commit_msg>checkpoint<commit_after>
.. _chapter_resources:

List of Pre-Configured Resources
================================

The following list of resources are supported by the underlying layers of ExTASY. 

.. note:: To configure your applications to run on these machines, you would need to add entries to your kernel definitions and specify the environment to be loaded for execution, executable, arguments, etc.

RESOURCE_ORNL
-------------

TITAN
*****

The Cray XK7 supercomputer located at the Oak Ridge Leadership Computing Facility (OLCF), (https://www.olcf.ornl.gov/titan/)

* **Resource label**      : ``ornl.titan``
* **Raw config**          : :download:`resource_ornl.json <../../src/radical/pilot/configs/resource_ornl.json>`
* **Note**            : Requires the use of an RSA SecurID on every connection.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : batch``
 * ``sandbox       : $MEMBERWORK/`groups | cut -d' ' -f2```
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh, local, go``

RESOURCE_DAS4
-------------

FS2
***

The Distributed ASCI Supercomputer 4 (http://www.cs.vu.nl/das4/).

* **Resource label**      : ``das4.fs2``
* **Raw config**          : :download:`resource_das4.json <../../src/radical/pilot/configs/resource_das4.json>`
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : all.q``
 * ``sandbox       : $HOME``
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh``

RESOURCE_EPSRC
--------------

ARCHER
******

The EPSRC Archer Cray XC30 system (https://www.archer.ac.uk/)

* **Resource label**      : ``epsrc.archer``
* **Raw config**          : :download:`resource_epsrc.json <../../src/radical/pilot/configs/resource_epsrc.json>`
* **Note**            : Always set the ``project`` attribute in the ComputePilotDescription or the pilot will fail.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : standard``
 * ``sandbox       : /work/`id -gn`/`id -gn`/$USER``
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh``

ARCHER_ORTE
***********

The EPSRC Archer Cray XC30 system (https://www.archer.ac.uk/)

* **Resource label**      : ``epsrc.archer_orte``
* **Raw config**          : :download:`resource_epsrc.json <../../src/radical/pilot/configs/resource_epsrc.json>`
* **Note**            : Always set the ``project`` attribute in the ComputePilotDescription or the pilot will fail.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : standard``
 * ``sandbox       : /work/`id -gn`/`id -gn`/$USER``
 * ``access_schema : ssh``

* **Available schemas**   : ``ssh``

RESOURCE_NERSC
--------------

EDISON_CCM
**********

The NERSC Edison Cray XC30 in Cluster Compatibility Mode (https://www.nersc.gov/users/computational-systems/edison/)

* **Resource label**      : ``nersc.edison_ccm``
* **Raw config**          : :download:`resource_nersc.json <../../src/radical/pilot/configs/resource_nersc.json>`
* **Note**            : For CCM you need to use special ccm_ queues.
* **Default values** for ComputePilotDescription attributes:

 * ``queue         : ccm_queue``
 * ``sandbox       : $SCRATCH``
 * ``access_schema : ssh``
{'fraction_non_alphanumeric': 0.1862958359229335, 'fraction_numerical': 0.004972032318210068, 'mean_word_length': 3.1825860948667968, 'pattern_counts': {'":': 0, '<': 13, '<?xml version=': 0, '>': 13, 'https://': 8, 'lorem ipsum': 0, 'www.': 10, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 10, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2723183', 'n_tokens_mistral': 2104, 'n_tokens_neox': 1962, 'n_words': 527}