<commit_before>### Arches 4.4.0 release notes

The Arches team has been busy improving Arches and fixing several bugs as well.
Below you'll find a listing of all the changes that are included in the latest release.

Some of the highlights:

- Debut of the Arches Collection Manager for designing mobile projects for the Arches Collector App
- Addition of Arches Plugin components
- Default Ubuntu installation is now Ubuntu 18.04 LTS
- Cards represented in reports are now collapsible
- Users can now edit any card for which they have write permissions (edited)
- Tile datatype validation is now always applied on save
- Provisional edit review is now fully available for file, map, and iiif widgets
- Usability enhancements in resource editor tree selection
- Enhancements to card component viewmodel for easier customization

#### Upgrading Arches

Users are encouraged to update at their earliest convenience.  Completely re-installing Arches is the easiest way to accomplish this.

If you can't completely re-install Arches (because you have data in the system that you want to preserve) then you'll need to upgrade by running the following commands in your activated virtual environment:

```
pip install arches --upgrade --no-binary :all:
python manage.py migrate
python manage.py es delete_indexes
python manage.py es setup_indexes
python manage.py es index_database
```

If you have Arches running on a web server such as Apache, be sure to update your static files directory and restart your web server.

As always the documentation can be found at <http://arches.readthedocs.io>

#### Upgrading an Arches project

1.  Add the following to your package.json file:

        "datatables.net-buttons": "^1.5.4",
        "datatables.net-buttons-bs": "^1.5.4"

        and run: `yarn install`

2. If you intend to use the Arches Collector you will need to install and configure CouchDB:

        sudo add-apt-repository "deb https://apache.bintray.com/couchdb-deb $(lsb_release -sc) main"
        wget --quiet -O - https://couchdb.apache.org/repo/bintray-pubkey.asc | sudo apt-key add -
        sudo apt-get update
        sudo apt-get install couchdb

    By default arches connects to couch using the following credentials:

    	username: admin
    	password: <PASSWORD>
    	http://localhost:5984/

    You'll also need to add the following settings to your project's settings.py file:

        MOBILE_OAUTH_CLIENT_ID = ''
        MOBILE_DEFAULT_ONLINE_BASEMAP = {'default': 'mapbox://styles/mapbox/streets-v9'}
        COUCHDB_URL = 'http://admin:admin@localhost:5984'

    You may want to update this setting to something more secure:

    	COUCHDB_URL = 'http://admin:admin@localhost:5984'

    Now you can create a new oauth client for the api:
        https://arches.readthedocs.io/en/stable/api/?highlight=application#authentication

    Finally, if you are running Apache, you will need to add the following directive to your site's `000-default.conf` file:

    	WSGIPassAuthorization on


# Testing Script

Before Version Release, go through this checklist to confirm that Arches is running as intended.

## Index

| Test Subject   |      Chrome     |      Safari     |     Firefox     |       IE11      | UI                        | Notes                                |
| -------------- | :-------------: | :-------------: | :-------------: | :-------------: | ------------------------- | ------------------------------------ |
| (Test Subject) | (use indicator from list below) | (use indicator from list below) | (use indicator from list below) | (use indicator from list below) | :white_check_mark: (to confirm that the UI has rendered correctly) or :x: (to confirm that the UI failed to render correctly) | (add ticket #, details on bug, etc.) |

When doing a test pass, consider using these status indicators:  
:white_check_mark: = Tested & Approved  
:x: = Merge blocking  
:construction: = Non-blocking bugs  
:ok: = Issue has been fixed  
:question: = Open question  

* * *

## Install

Assigned to: Cyrus

| Test Subject                                                   | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| -------------------------------------------------------------- | :----: | :----: | :-----: | :--: | --- | ----- |
| Confirm that upgrading from the previous release is issue free |:white_check_mark:|    ?   |    ?    |   ?  | ?   | -     |

* * *

## Future Release Features

Assigned to: Cyrus

| Test Subject                                                                              | Chrome | Safari | Firefox | IE11 | UI | Notes |
| ----------------------------------------------------------------------------------------- | :----: | :----: | :-----: | :--: | :-: | ----- |
| Test that users can't access the Mobile Survey Manager page |    ?   |    ?   |    ?    |   ?  | ?  | -     |

* * *

## Authentication

Assigned to: Ryan

Ensure that all browsers are compatible with Authentication process.

| Test Subject                                                             | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| ------------------------------------------------------------------------ | :----: | :----: | :-----: | :--: | --- | ----- |
| User can sign themselves up for a new Arches account                     |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| User is added to default group (Crowdsource Editor)                      |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| User can log in with their email address                                 |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| User can reset their password                                            |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| User can edit their profile (First and Last name, email address, etc...) |    ?   |    ?   |    ?    |   ?  | ?   | -     |

* * *

## System Settings

Assigned to: Cyrus

#### Basic Settings

| Test Subject                                                                                                                 | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| ---------------------------------------------------------------------------------------------------------------------------- | :----: | :----: | :-----: | :--: | --- | ----- |
| Project Name - Updating name updates in index.htm and the page tab                                                           |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Web Analytics - String value inserts in base.htm at the location of this template variable:{{GOOGLE_ANALYTICS_TRACKING_ID}} |    ?   |    ?   |    ?    |   ?  | ?   | -     |

#### Map Settings

Assigned to: Galen

| Test Subject                                                                                                                                                                                    | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :----: | :----: | :-----: | :--: | --- | ----- |
| API Key - Key saves and API calls are successful                                                                                                                                                |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Hex Grid Precision - Saves properly, but errors if precision is too high (\`Exception detail: TransportError(400, u'parsing_exception', u'[geohash_grid] failed to parse field [precision]')``) |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Hex Cell Size - Changes reflected in Search results                                                                                                                                             |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Default Zoom - Changes reflected in Card Config Manager                                                                                                                                         |    ?   |    ?   |    ?    |   ?  | ?   | -     |<commit_msg>Update pre-4.4.0.md<commit_after>### Arches 4.4.0 release notes

The Arches team has been busy improving Arches and fixing several bugs as well.
Below you'll find a listing of all the changes that are included in the latest release.

Some of the highlights:

- Debut of the Arches Collection Manager for designing mobile projects for the Arches Collector App
- Addition of Arches Plugin components
- Default Ubuntu installation is now Ubuntu 18.04 LTS
- Cards represented in reports are now collapsible
- Users can now edit any card for which they have write permissions (edited)
- Tile datatype validation is now always applied on save
- Provisional edit review is now fully available for file, map, and iiif widgets
- Usability enhancements in resource editor tree selection
- Enhancements to card component viewmodel for easier customization

#### Upgrading Arches

Users are encouraged to update at their earliest convenience.  Completely re-installing Arches is the easiest way to accomplish this.

If you can't completely re-install Arches (because you have data in the system that you want to preserve) then you'll need to upgrade by running the following commands in your activated virtual environment:

```
pip install arches --upgrade --no-binary :all:
python manage.py migrate
python manage.py es delete_indexes
python manage.py es setup_indexes
python manage.py es index_database
```

If you have Arches running on a web server such as Apache, be sure to update your static files directory and restart your web server.

As always the documentation can be found at <http://arches.readthedocs.io>

#### Upgrading an Arches project

1.  Add the following to your package.json file:

        "datatables.net-buttons": "^1.5.4",
        "datatables.net-buttons-bs": "^1.5.4"

        and run: `yarn install`

2. If you intend to use the Arches Collector you will need to install and configure CouchDB:

        sudo add-apt-repository "deb https://apache.bintray.com/couchdb-deb $(lsb_release -sc) main"
        wget --quiet -O - https://couchdb.apache.org/repo/bintray-pubkey.asc | sudo apt-key add -
        sudo apt-get update
        sudo apt-get install couchdb

    By default arches connects to couch using the following credentials:

    	username: admin
    	password: <PASSWORD>
    	http://localhost:5984/

    You'll also need to add the following settings to your project's settings.py file:

        MOBILE_OAUTH_CLIENT_ID = ''
        MOBILE_DEFAULT_ONLINE_BASEMAP = {'default': 'mapbox://styles/mapbox/streets-v9'}
        COUCHDB_URL = 'http://admin:admin@localhost:5984'

    You may want to update this setting to something more secure:

    	COUCHDB_URL = 'http://admin:admin@localhost:5984'

    Now you can create a new oauth client for the api:
        https://arches.readthedocs.io/en/stable/api/?highlight=application#authentication

    Finally, if you are running Apache, you will need to add the following directive to your site's `000-default.conf` file:

    	WSGIPassAuthorization on


# Testing Script

Before Version Release, go through this checklist to confirm that Arches is running as intended.

## Index

| Test Subject   |      Chrome     |      Safari     |     Firefox     |       IE11      | UI                        | Notes                                |
| -------------- | :-------------: | :-------------: | :-------------: | :-------------: | ------------------------- | ------------------------------------ |
| (Test Subject) | (use indicator from list below) | (use indicator from list below) | (use indicator from list below) | (use indicator from list below) | :white_check_mark: (to confirm that the UI has rendered correctly) or :x: (to confirm that the UI failed to render correctly) | (add ticket #, details on bug, etc.) |

When doing a test pass, consider using these status indicators:  
:white_check_mark: = Tested & Approved  
:x: = Merge blocking  
:construction: = Non-blocking bugs  
:ok: = Issue has been fixed  
:question: = Open question  

* * *

## Install

Assigned to: Cyrus

| Test Subject                                                   | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| -------------------------------------------------------------- | :----: | :----: | :-----: | :--: | --- | ----- |
| Confirm that upgrading from the previous release is issue free |:white_check_mark:|    ?   |    ?    |   ?  | ?   | -     |

* * *

## Future Release Features

Assigned to: Cyrus

| Test Subject                                                                              | Chrome | Safari | Firefox | IE11 | UI | Notes |
| ----------------------------------------------------------------------------------------- | :----: | :----: | :-----: | :--: | :-: | ----- |
| Test that users can't access the Mobile Survey Manager page |    ?   |    ?   |    ?    |   ?  | ?  | -     |

* * *

## Authentication

Assigned to: Ryan

Ensure that all browsers are compatible with Authentication process.

| Test Subject                                                             | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| ------------------------------------------------------------------------ | :----: | :----: | :-----: | :--: | --- | ----- |
| User can sign themselves up for a new Arches account                     |    :white_check_mark:   |    ?   |    ?    |   ?  | ?   | -     |
| User is added to default group (Crowdsource Editor)                      |    :white_check_mark:   |    ?   |    ?    |   ?  | ?   | -     |
| User can log in with their email address                                 |    :white_check_mark:   |    ?   |    ?    |   ?  | ?   | -     |
| User can reset their password                                            |    :white_check_mark:   |    ?   |    ?    |   ?  | ?   | -     |
| User can edit their profile (First and Last name, email address, etc...) |    :white_check_mark:   |    ?   |    ?    |   ?  | ?   | -     |

* * *

## System Settings

Assigned to: Cyrus

#### Basic Settings

| Test Subject                                                                                                                 | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| ---------------------------------------------------------------------------------------------------------------------------- | :----: | :----: | :-----: | :--: | --- | ----- |
| Project Name - Updating name updates in index.htm and the page tab                                                           |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Web Analytics - String value inserts in base.htm at the location of this template variable:{{GOOGLE_ANALYTICS_TRACKING_ID}} |    ?   |    ?   |    ?    |   ?  | ?   | -     |

#### Map Settings

Assigned to: Galen

| Test Subject                                                                                                                                                                                    | Chrome | Safari | Firefox | IE11 | UI  | Notes |
| ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :----: | :----: | :-----: | :--: | --- | ----- |
| API Key - Key saves and API calls are successful                                                                                                                                                |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Hex Grid Precision - Saves properly, but errors if precision is too high (\`Exception detail: TransportError(400, u'parsing_exception', u'[geohash_grid] failed to parse field [precision]')``) |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Hex Cell Size - Changes reflected in Search results                                                                                                                                             |    ?   |    ?   |    ?    |   ?  | ?   | -     |
| Default Zoom - Changes reflected in Card Config Manager                                                                                                                                         |    ?   |    ?   |    ?    |   ?  | ?   | -     |
{'fraction_non_alphanumeric': 0.17668599328654258, 'fraction_numerical': 0.005797985962770827, 'mean_word_length': 1.245888157894737, 'pattern_counts': {'":': 4, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 114, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '730961', 'n_tokens_mistral': 4058, 'n_tokens_neox': 3848, 'n_words': 1372}