<commit_before>---
title: SGID Database Policies
author:
  display_name: AGRC Office
  email: <EMAIL>
tags:
  - policy
  - sgid
categories: []
date: 2019-12-04 10:01:27 -0500
---

The following policies apply to data in the internal SGID Enterprise Geodatabase.

## Adding New Datasets to the SGID
{: .text-left }

We strive to achieve and maintain a high standard of quality for the SGID. One of the best ways to do this is making sure all datasets coming into the SGID are high-quality datasets. We use the following policies and procedures to guide this effort.

### Qualifying Datasets
{: .text-left }
<commit_msg>fix: remove sentance, explain SGID.<commit_after>---
title: SGID Database Policies
author:
  display_name: AGRC Office
  email: <EMAIL>
tags:
  - policy
  - sgid
categories: []
date: 2019-12-04 10:01:27 -0500
---

The following policies apply to data in the internal SGID geodatabase, which is a curated database of state-wide datasets. It is maintained as an internal, AGRC-only Esri Enterprise Geodatabase and is available to everyone as the cloud-hosted, PostGIS-backed [OpenSGID]({% link sgid/open-sgid/index.md %}). The contents of the SGID are also uploaded to the Utah SGID groups of our [ArcGIS Online Organization](https://utah.maps.arcgis.com).

## Adding New Datasets to the SGID
{: .text-left }

We strive to achieve and maintain a high standard of quality for the SGID. We use the following policies and procedures to guide this effort.

### Qualifying Datasets
{: .text-left }

{'fraction_non_alphanumeric': 0.08349900596421471, 'fraction_numerical': 0.02385685884691849, 'mean_word_length': 3.9834983498349836, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3189098', 'n_tokens_mistral': 492, 'n_tokens_neox': 450, 'n_words': 203}