Learn how to enable automatic group offset synchronization in Streams Replication Manager. Enabling this feature can simplify the manual steps that you
need to take to migrate consumer groups in a failover or failback scenario.
By default, automatic group offset synchronization is disabled. It can be enabled
in Cloudera Manager by adding new entries to the Streams
Replication Manager's Replication Configs property.Depending on your use
case, you can set up automatic group offset synchronization on a global level or for
specific replications only.
-
In Cloudera Manager, select Streams Replication Manager.
- Go to Configuration.
- Find the Streams Replication Manager's Replication Configs
and add the following configuration entries:
sync.group.offsets.enabled = true
sync.group.offsets.interval.seconds = [***TIME IN SECONDS***]
In this example, all properties are set on a global level. This means that automatic
group offset synchronization is applied to all replications. Depending on your setup,
you can also choose to set these properties for specific replications using appropriate
replication prefixes.
The sync.group.offsets.enabled property enables automatic group offset
synchronization. The sync.group.offsets.interval.seconds property
controls how frequently offsets are synched. You only need to specify this property if
you want to customize synchronization frequency.
- Enter a Reason for change, and then click Save
Changes to commit the changes.
-
Restart Streams Replication Manager.
Automatic group offset synchronization is enabled. From now on, Streams Replication Manager automatically exports the translated offsets of the
configured source clusters and applies them to the configured target clusters.
