<commit_before>---
layout: post
title:  Debezium 1.6.0.Final Released
date:   2021-06-30
tags: [ releases, mysql, postgres, sqlserver, cassandra, oracle, db2, vitess, outbox ]
author: gmorling
---

I'm pleased to announce the release of Debezium *1.6.0.Final*!

This release is packed full with tons of new features, including support for incremental snapshotting that can be toggled using the new the https://debezium.io/documentation/reference/1.6/configuration/signalling.html[Signal API].
Based on the excellent paper https://arxiv.org/pdf/2010.12597v1.pdf[DBLog: A Watermark Based Change-Data-Capture Framework] by Netflix engineers <NAME> and <NAME>,
the notion of incremental snapshotting addresses several requirements around snapshotting that came up repeatedly in the Debezium community:

+++<!-- more -->+++

* Ability to resume an on-going snapshot after a connector restart
* Re-snapshot selected tables during streaming, e.g. to re-bootstrap Kafka topics with change events for specific tables
* Snapshot tables newly added to the list of captured tables after changing the filter configuration
* Begin to stream changes while an initial snapshot is running

Incremental snapshotting is an incubating feature as of Debezium 1.6,
and we're looking for your feedback on this feature.
To learn more about this functionality, please refer to the individual connector docs, e.g. for the Debezium link:/documentation/reference/connectors/mysql#_incremental_snapshot[MySQL connector].
There are already some follow-up improvements in this area in the workings,
for instance the https://github.com/debezium/debezium/pull/2430[usage of MySQL GTIDs] for setting the high/low watermarks required for this snapshotting approach,
which will avoid the need for write access to the database by the connector.
You can expect these improvements to be rolled out in one of the upcoming 1.7 preview releases.

Besides incremental snapshotting, other new features in Debezium 1.6 include two brand new https://debezium.io/documentation/reference/1.6/operations/debezium-server.html[Debezium Server] sinks,
one for Apache Kafka and another for https://pravega.io/[Pravega],<commit_msg>[1.6] Fixing author name<commit_after>---
layout: post
title:  Debezium 1.6.0.Final Released
date:   2021-06-30
tags: [ releases, mysql, postgres, sqlserver, cassandra, oracle, db2, vitess, outbox ]
author: ccranfor
---

I'm pleased to announce the release of Debezium *1.6.0.Final*!

This release is packed full with tons of new features, including support for incremental snapshotting that can be toggled using the new the https://debezium.io/documentation/reference/1.6/configuration/signalling.html[Signal API].
Based on the excellent paper https://arxiv.org/pdf/2010.12597v1.pdf[DBLog: A Watermark Based Change-Data-Capture Framework] by Netflix engineers <NAME> and <NAME>,
the notion of incremental snapshotting addresses several requirements around snapshotting that came up repeatedly in the Debezium community:

+++<!-- more -->+++

* Ability to resume an on-going snapshot after a connector restart
* Re-snapshot selected tables during streaming, e.g. to re-bootstrap Kafka topics with change events for specific tables
* Snapshot tables newly added to the list of captured tables after changing the filter configuration
* Begin to stream changes while an initial snapshot is running

Incremental snapshotting is an incubating feature as of Debezium 1.6,
and we're looking for your feedback on this feature.
To learn more about this functionality, please refer to the individual connector docs, e.g. for the Debezium link:/documentation/reference/connectors/mysql#_incremental_snapshot[MySQL connector].
There are already some follow-up improvements in this area in the workings,
for instance the https://github.com/debezium/debezium/pull/2430[usage of MySQL GTIDs] for setting the high/low watermarks required for this snapshotting approach,
which will avoid the need for write access to the database by the connector.
You can expect these improvements to be rolled out in one of the upcoming 1.7 preview releases.

Besides incremental snapshotting, other new features in Debezium 1.6 include two brand new https://debezium.io/documentation/reference/1.6/operations/debezium-server.html[Debezium Server] sinks,
one for Apache Kafka and another for https://pravega.io/[Pravega],
{'fraction_non_alphanumeric': 0.07029997710098465, 'fraction_numerical': 0.018319212273872225, 'mean_word_length': 5.008253094910591, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 10, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3428425', 'n_tokens_mistral': 1208, 'n_tokens_neox': 1157, 'n_words': 530}