<commit_before>.. _processes:

Processes in Flyingpigeon
*************************

Flyingpigeon provides processes for climate model data analytis, climate impact studies and extrem values investigatins. 



.. _analogs:

Analog pressure pattern
-----------------------


CASTf90 first downloads fields from NCEP reanalysis (sea level pressure, slp, as default) and then searches for a given simulation period the most similar cases within a given data base period according to a given distance measure. Finally it writes the N most similar days including the calculated distances for them to an output file


.. _extract_coordinates

extract 1D Timeseries from coordinate points
--------------------------------------------

Extract Timeseries for specified coordinates from grided data

.. _extremvalues: 

Extremvalues
-------------

Calculation of retun time Values for 1D time series. 


.. _getEOBS_inCORDEXformat: 

get EOBS Data in CORDEX format
-------------------------------

converts EOBS data files into the CORDEX convetion. (variable names, attributes etc ... )

.. _fetch: 


Download Resources
------------------

Downloads resources (limited to 50GB) to the local file system of the birdhouse compute provider

.. _indices:

Climate indice
--------------

Climate indice are values to describe the state the climate system for a certain parameter. Climate indice as timeseries can be used to describe or estimate the climte change over time. 
The climate indices processes in flyingpigeon are based on the python package 'Link icclim <http://icclim.readthedocs.org/en/latest/>'.
they are subcassed to 

* indice simple: 


+--------+----------------+--------------------------------------------------------------------------------+
| Indice | Input Variable | Definition                                                                     |
+========+================+================================================================================+
| TG     |        tas     | Mean of mean temperatur                                                        |
+--------+----------------+--------------------------------------------------------------------------------+
| TX     |     tasmax     | Mean of max temperatur                                                         |
+--------+----------------+--------------------------------------------------------------------------------+
| TN     |     tasmin     | Mean of daily min temperatur                                                   |
+--------+----------------+--------------------------------------------------------------------------------+
| TXn    |     tasmax     | Min of daily min temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| TXx    |     tasmax     | Max of daily max temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| TNn    |     tasmin     | Min of daily min temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| TNx    |     tasmin     | Max of daily min temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| SU     |     tasmax     | Nr of summer days                                                              |
+--------+----------------+--------------------------------------------------------------------------------+
| CSU    |     tasmax     | Nr of consecutive summer days                                                  |
+--------+----------------+--------------------------------------------------------------------------------+
| FD     |     tasmin     | Nr of frost days                                                               |
+--------+----------------+--------------------------------------------------------------------------------+
| CFD    |     tasmin     | Nr of consecutive frost days                                                   |
+--------+----------------+--------------------------------------------------------------------------------+
| TR     |      tasmin    | Tropical nights -                                                              |
|        |                | number of days where daily minimum temperature >= 20 degrees                   |
+--------+----------------+--------------------------------------------------------------------------------+
| ID     |     tasmax     | Nr of Ice days                                                                 |
+--------+----------------+--------------------------------------------------------------------------------+
| HD17   |        tas     | Heating degree days [sum of 17 degrees - mean temperature]                     |
+--------+----------------+--------------------------------------------------------------------------------+
| GD4    |        tas     | Growing degree days [sum of TG >= 4 degrees]                                   |
+--------+----------------+--------------------------------------------------------------------------------+
| PRCPTOT|         pr     | Precipitation flux mean (mon / year)                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| RR1    |         pr     | Nr of days with precipitation > 1 mm                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| CWD    |         pr     | Consecutive wet days                                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| CDD    |         pr     | Consecutive dry days                                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| SDII   |         pr     | Simple daily intensity index for wet days [mm/wet day]                         |
+--------+----------------+--------------------------------------------------------------------------------+<commit_msg>update indices<commit_after>.. _processes:

Processes in Flyingpigeon
*************************

Flyingpigeon provides processes for climate model data analytis, climate impact studies and extrem values investigatins. 



.. _analogs:

Analog pressure pattern
-----------------------


CASTf90 first downloads fields from NCEP reanalysis (sea level pressure, slp, as default) and then searches for a given simulation period the most similar cases within a given data base period according to a given distance measure. Finally it writes the N most similar days including the calculated distances for them to an output file


.. _extract_coordinates

extract 1D Timeseries from coordinate points
--------------------------------------------

Extract Timeseries for specified coordinates from grided data

.. _extremvalues: 

Extremvalues
-------------

Calculation of retun time Values for 1D time series. 


.. _getEOBS_inCORDEXformat: 

get EOBS Data in CORDEX format
-------------------------------

converts EOBS data files into the CORDEX convetion. (variable names, attributes etc ... )

.. _fetch: 


Download Resources
------------------

Downloads resources (limited to 50GB) to the local file system of the birdhouse compute provider

.. _indices:

Climate indice
--------------

Climate indice are values to describe the state the climate system for a certain parameter. Climate indice as timeseries can be used to describe or estimate the climte change over time. 
The climate indices processes in flyingpigeon are based on the python package 'Link icclim <http://icclim.readthedocs.org/en/latest/>'.
they are subcassed to 

* indice simple: 


+--------+----------------+--------------------------------------------------------------------------------+
| Indice | Input Variable | Definition                                                                     |
+========+================+================================================================================+
| TG     |        tas     | Mean of mean temperatur                                                        |
+--------+----------------+--------------------------------------------------------------------------------+
| TX     |     tasmax     | Mean of max temperatur                                                         |
+--------+----------------+--------------------------------------------------------------------------------+
| TN     |     tasmin     | Mean of daily min temperatur                                                   |
+--------+----------------+--------------------------------------------------------------------------------+
| TXn    |     tasmax     | Min of daily min temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| TXx    |     tasmax     | Max of daily max temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| TNn    |     tasmin     | Min of daily min temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| TNx    |     tasmin     | Max of daily min temperatur                                                    |
+--------+----------------+--------------------------------------------------------------------------------+
| SU     |     tasmax     | Nr of summer days  [tasmax > = 25°C]                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| CSU    |     tasmax     | Nr of consecutive summer days                                                  |
+--------+----------------+--------------------------------------------------------------------------------+
| FD     |     tasmin     | Nr of frost days  [tasmin < 0°C]                                               |
+--------+----------------+--------------------------------------------------------------------------------+
| CFD    |     tasmin     | Nr of consecutive frost days                                                   |
+--------+----------------+--------------------------------------------------------------------------------+
| TR     |      tasmin    | Tropical nights [tasmin >= 20°C]                                               |
+--------+----------------+--------------------------------------------------------------------------------+
| ID     |     tasmax     | Nr of Ice days [tasmax < 0°C]                                                  |
+--------+----------------+--------------------------------------------------------------------------------+
| HD17   |        tas     | Heating degree days [sum of 17 degrees - mean temperature]                     |
+--------+----------------+--------------------------------------------------------------------------------+
| GD4    |        tas     | Growing degree days [sum of TG >= 4 degrees]                                   |
+--------+----------------+--------------------------------------------------------------------------------+
| PRCPTOT|         pr     | Precipitation flux mean [sum]                                                  |
+--------+----------------+--------------------------------------------------------------------------------+
| RR1    |         pr     | Nr of days with precipitation > 1 mm                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| CWD    |         pr     | Consecutive wet days                                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| CDD    |         pr     | Consecutive dry days                                                           |
+--------+----------------+--------------------------------------------------------------------------------+
| SDII   |         pr     | Simple daily intensity index for wet days [mm/wet day]                         |
+--------+----------------+--------------------------------------------------------------------------------+
{'fraction_non_alphanumeric': 0.42392494136043785, 'fraction_numerical': 0.0028146989835809225, 'mean_word_length': 0.5303900454654223, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 12, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 78, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2628316', 'n_tokens_mistral': 2002, 'n_tokens_neox': 1859, 'n_words': 701}