<commit_before>#############
Release Notes
#############

0.7.2
------------
* Bug fixes:
  - The force_rerun setting was being ignored
  - Duplicate task attempts were being created on failure
  - Fixed import of nested templates with preexisting children
  - Python package conflicts resolved, migrated Docker image to ubuntu
  - Fixes to the Jenkins pipeline
* Added "size" and "index" special functions to workflow language
* Refactored views in portal for better performance

0.7.1
------------
* Bug fixes:
  - critical bug affecting all runs with multiple outputs
  - bug that prevented setting disk size for server or workers in Google Cloud
  - bug that prevented old logs from being automatically deleted

0.7.0
------------
* Import/export runs and templates with dependencies
* Re-use existing results if an identical Task has already been run

0.6.0
------------
* Installable from PyPi with "pip install loomengine"
* User authentication and authorization

0.5.3
------------
* Retry tasks on failure or lost heartbeat
* Paginated index views in browser
* Chunked index view queries by commandline client
* Migrated kibana logs to same port as Loom under /logs
* Critical bugfix for corrupted data trees
* Simplified output filenames and directory structure
* Periodic check for tasks that failed to clean up
* Client warns, not errors, for duplicate file or template imports
* Add setting LOOM_FORCE_DB_MIGRATIONS_ON_START

0.5.2
------------
* "loom server start" now starts a local server using default settings
* Required settings to launch on gcloud were reduced to a minimal set
* Server settings validation
* Removed deprecated commands "loom show", "loom import", and "loom export"
* Removed deprecated fixed_inputs in templates
* Deprecation warning for "loom server start --admin-files-dir", renamed flag as "--resource-dir"
* Server settings can be changed without destroying server, using "loom server start/stop"
* Docker image versions for Loom server components can be upgraded without destroying server, using "loom server start/stop"

0.5.1
-------------
* Enhanced validation of templates and data objects

0.5.0
-------------
* Tags and labels for files, templates, and runs
* Changed client commands to follow 'loom {noun} {verb}' pattern

0.4.1
-------------
* Notification for completed runs by email or posting JSON to URL
* Documentation for Loom templates
* Templates can be referenced by hash
* Added retries to file import/export, docker pull, other external services
* Added ``--original-copy`` option to "loom file import"
* Added LOOM_DEFAULT_DOCKER_REGISTRY setting

0.4.0
-------------
* Parallel workflows
* Deprecated fixed inputs, replaced with optional and overridable "data" field on standard inputs
* User-defined run names, using the optional ``--name`` flag with "loom run"
* Updated examples, including two parallel examples "word_scoring" and "word_combinations"
* Saving of templates is no longer asynchronous, so any errors are raised immediately with "loom import template"
* Outputs can now use "glob" source in addition to "filename" and "stream"

0.3.8
-------------
* Run overview shows nested runs, tasks, and task-attempts

0.3.7
-------------
* Retries for upload/download from Google Storage

0.3.6
-------------
* Runs have "waiting" status until they start
* Runs are no longer changed to "killed" if they already completed
* Input/output detail routes on runs

0.3.5
-------------
* Critical bugfix for 0.3.4

0.3.4
-------------
* Pre-configure Kibana
* Disable X-Pack features in Kibana and Elasticsearch
* Handle several sporadic failures from gcloud services
* Handle gcloud gucket to bucket file copies longer than 30s
* Prune docker data volumes

0.3.3
-------------
* Critical bugfix for 0.3.2 that prevented use on Google Cloud

0.3.2
-------------
* Fluentd for logging, with kibana+elasticsearch for log viewing
* Nested templates by reference
* API documentation with swagger
* Reduced lag time in running tasks

0.3.1
-------------
* Allow substitution in template output filenames
* Added LOOM_PRESERVE_ON_FAILURE and LOOM_PRESERVE_ALL flags for debugging
* Several bugfixes

0.3.0
-------------
* User-configurable playbooks
* Non-reverse-compatible simplifications to API
* Reduced server response times
* Dockerized deployment on local and google cloud
* Optional dockerized MySQL server
* Retry tasks if process stops responding

0.2.1
-------------
* Use release-specific DOCKER_TAG in default settings

0.2.0
-------------
* Loom can create a server locally or on Google Cloud Platform
* Accepts workflow templates in JSON or YAML format
* Web portal provides a brower interface for viewing templates, files, and runs
* Loom client for managing runs from the terminal
<commit_msg>0.7.3 release notes<commit_after>#############
Release Notes
#############

0.7.3
------------
* Support Google Cloud Registry authentication
* Handle conflicting filenames with automatic index
* Bug fixes:
  - Preserve order of steps in a run to match the template
  - Fix run, template, and data object delete functions
  - Add docker-py dependency needed for local deployment
  - Fix file_relative_path error related to run import
  - Quote env values to support ansible>=2.8.0

0.7.2
------------
* Bug fixes:
  - The force_rerun setting was being ignored
  - Duplicate task attempts were being created on failure
  - Fixed import of nested templates with preexisting children
  - Python package conflicts resolved, migrated Docker image to ubuntu
  - Fixes to the Jenkins pipeline
* Added "size" and "index" special functions to workflow language
* Refactored views in portal for better performance

0.7.1
------------
* Bug fixes:
  - critical bug affecting all runs with multiple outputs
  - bug that prevented setting disk size for server or workers in Google Cloud
  - bug that prevented old logs from being automatically deleted

0.7.0
------------
* Import/export runs and templates with dependencies
* Re-use existing results if an identical Task has already been run

0.6.0
------------
* Installable from PyPi with "pip install loomengine"
* User authentication and authorization

0.5.3
------------
* Retry tasks on failure or lost heartbeat
* Paginated index views in browser
* Chunked index view queries by commandline client
* Migrated kibana logs to same port as Loom under /logs
* Critical bugfix for corrupted data trees
* Simplified output filenames and directory structure
* Periodic check for tasks that failed to clean up
* Client warns, not errors, for duplicate file or template imports
* Add setting LOOM_FORCE_DB_MIGRATIONS_ON_START

0.5.2
------------
* "loom server start" now starts a local server using default settings
* Required settings to launch on gcloud were reduced to a minimal set
* Server settings validation
* Removed deprecated commands "loom show", "loom import", and "loom export"
* Removed deprecated fixed_inputs in templates
* Deprecation warning for "loom server start --admin-files-dir", renamed flag as "--resource-dir"
* Server settings can be changed without destroying server, using "loom server start/stop"
* Docker image versions for Loom server components can be upgraded without destroying server, using "loom server start/stop"

0.5.1
-------------
* Enhanced validation of templates and data objects

0.5.0
-------------
* Tags and labels for files, templates, and runs
* Changed client commands to follow 'loom {noun} {verb}' pattern

0.4.1
-------------
* Notification for completed runs by email or posting JSON to URL
* Documentation for Loom templates
* Templates can be referenced by hash
* Added retries to file import/export, docker pull, other external services
* Added ``--original-copy`` option to "loom file import"
* Added LOOM_DEFAULT_DOCKER_REGISTRY setting

0.4.0
-------------
* Parallel workflows
* Deprecated fixed inputs, replaced with optional and overridable "data" field on standard inputs
* User-defined run names, using the optional ``--name`` flag with "loom run"
* Updated examples, including two parallel examples "word_scoring" and "word_combinations"
* Saving of templates is no longer asynchronous, so any errors are raised immediately with "loom import template"
* Outputs can now use "glob" source in addition to "filename" and "stream"

0.3.8
-------------
* Run overview shows nested runs, tasks, and task-attempts

0.3.7
-------------
* Retries for upload/download from Google Storage

0.3.6
-------------
* Runs have "waiting" status until they start
* Runs are no longer changed to "killed" if they already completed
* Input/output detail routes on runs

0.3.5
-------------
* Critical bugfix for 0.3.4

0.3.4
-------------
* Pre-configure Kibana
* Disable X-Pack features in Kibana and Elasticsearch
* Handle several sporadic failures from gcloud services
* Handle gcloud gucket to bucket file copies longer than 30s
* Prune docker data volumes

0.3.3
-------------
* Critical bugfix for 0.3.2 that prevented use on Google Cloud

0.3.2
-------------
* Fluentd for logging, with kibana+elasticsearch for log viewing
* Nested templates by reference
* API documentation with swagger
* Reduced lag time in running tasks

0.3.1
-------------
* Allow substitution in template output filenames
* Added LOOM_PRESERVE_ON_FAILURE and LOOM_PRESERVE_ALL flags for debugging
* Several bugfixes

0.3.0
-------------
* User-configurable playbooks
* Non-reverse-compatible simplifications to API
* Reduced server response times
* Dockerized deployment on local and google cloud
* Optional dockerized MySQL server
* Retry tasks if process stops responding

0.2.1
-------------
* Use release-specific DOCKER_TAG in default settings

0.2.0
-------------
* Loom can create a server locally or on Google Cloud Platform
* Accepts workflow templates in JSON or YAML format
* Web portal provides a brower interface for viewing templates, files, and runs
* Loom client for managing runs from the terminal

{'fraction_non_alphanumeric': 0.10974874371859296, 'fraction_numerical': 0.015175879396984924, 'mean_word_length': 3.37598944591029, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1416640', 'n_tokens_mistral': 2685, 'n_tokens_neox': 2568, 'n_words': 1257}