<commit_before># Release Notes

## Next

* PR #668: Using spark default parallelism as default.

## 0.25.0 - 2022-05-31
* Issue #593: Allow users to disable cache when loading data via SQL query,
  by setting `cacheExpirationTimeInMinutes=0`
* PR #613: Added field level schema checks. This can be disabled by setting
  `enableModeCheckForSchemaFields=false`
* PR #618: Added support for the `enableListInterface` option. This allows to
  use parquet as an intermediate format also for arrays, without adding the
  `list` element in the resulting schema as described
  [here](https://cloud.google.com/bigquery/docs/reference/rest/v2/tables#ParquetOptions)
* PR #641: Removed Conscrypt from the shaded artifact in order to improve
  compatibility with Dataproc Serverless and with clusters where Conscrypt is
  disabled.
* BigQuery API has been upgraded to version 2.10.6
* BigQuery Storage API has been upgraded to version 2.12.0
* gRPC has been upgraded to version 1.46.0
* Netty has been upgraded to version 4.1.75.Final

## 0.24.2 - 2022-04-05
* PR #580: Fixed shaded artifacts version flattening, the version appears
  correctly in the released POM
* PR #583: netty-tcnative is taken from the Netty BOM
* PR #584: CVE-2020-36518 - Upgraded jackson

## 0.24.1 - 2022-03-29
* PR #576: Fixed error running on Datapoc clusters where conscrypt is disabled
  (the property`dataproc.conscrypt.provider.enable` set to `false`)<commit_msg>Updating CHANGES for next release<commit_after># Release Notes

## Next

* Issue #651: Fixing the write back to BigQuery.
* PR #664: Add support for BigLake external tables.
* PR #667: Allowing clustering on unpartitioned tables.
* PR #668: Using spark default parallelism as default.

## 0.25.0 - 2022-05-31
* Issue #593: Allow users to disable cache when loading data via SQL query,
  by setting `cacheExpirationTimeInMinutes=0`
* PR #613: Added field level schema checks. This can be disabled by setting
  `enableModeCheckForSchemaFields=false`
* PR #618: Added support for the `enableListInterface` option. This allows to
  use parquet as an intermediate format also for arrays, without adding the
  `list` element in the resulting schema as described
  [here](https://cloud.google.com/bigquery/docs/reference/rest/v2/tables#ParquetOptions)
* PR #641: Removed Conscrypt from the shaded artifact in order to improve
  compatibility with Dataproc Serverless and with clusters where Conscrypt is
  disabled.
* BigQuery API has been upgraded to version 2.10.6
* BigQuery Storage API has been upgraded to version 2.12.0
* gRPC has been upgraded to version 1.46.0
* Netty has been upgraded to version 4.1.75.Final

## 0.24.2 - 2022-04-05
* PR #580: Fixed shaded artifacts version flattening, the version appears
  correctly in the released POM
* PR #583: netty-tcnative is taken from the Netty BOM
* PR #584: CVE-2020-36518 - Upgraded jackson

## 0.24.1 - 2022-03-29
* PR #576: Fixed error running on Datapoc clusters where conscrypt is disabled
  (the property`dataproc.conscrypt.provider.enable` set to `false`)
{'fraction_non_alphanumeric': 0.07816091954022988, 'fraction_numerical': 0.06206896551724138, 'mean_word_length': 4.343859649122807, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4752533', 'n_tokens_mistral': 1037, 'n_tokens_neox': 901, 'n_words': 386}