Fixed Issues in Kafka

Review the list of Kafka issues that are resolved in Cloudera Runtime 7.3.1, its service packs and cumulative hotfixes.

Cloudera Runtime 7.3.1.700 SP3 CHF 2

There are no fixed issues in this release.

Cloudera Runtime 7.3.1.600 SP3 CHF 1

There are no fixed issues in this release.

Cloudera Runtime 7.3.1.500 SP3

There are no fixed issues in this release.

Cloudera Runtime 7.3.1.400 SP2

There are no fixed issues in this release.

Cloudera Runtime 7.3.1.300 SP1 CHF 1

There are no fixed issues in this release.

Cloudera Runtime 7.3.1.200 SP1

There are no fixed issues in this release.

Cloudera Runtime 7.3.1.100 CHF 1

There are no fixed issues for Kafka in this release.

Cloudera Runtime 7.3.1

CDPD-65649: ReplicaAlterLogDirs stuck with Offset mismatch for the future replica
7.3.1
This is a backported fix, see KAFKA-9087 for more information.
CDPD-66986: Mirrormaker 2 auto.offset.reset=latest not working
7.3.1
This is a backported fix, see KAFKA-13988 for more information.
OPSAPS-71258: Kafka, SRM, and SMM cannot process messages compressed with Zstd or Snappy
7.3.1

Kafka, Streams Replication Manager, and Streams Messaging Manager can now process messages compressed with Zstd and Snappy if /tmp is mounted with the noexec option.

This fix changes the default Zstd and Snappy temporary directory from /tmp to the following service specific directories.

  • Kafka - /var/lib/kafka
  • Streams Messaging Manager - /var/lib/streams_messaging_manager
  • Streams Replication Manager - /var/lib/streams_messaging_manager

Ensure that each service user has write and execute permission on the directory specific to their service. Otherwise, the service will fail to process compressed messages.

  • The Kafka service user (default: kafka) must have write and execute permission on /var/lib/kafka.
  • The Streams Messaging Manager service user (default: streamsmsgmgr) must have write and execute permission on /var/lib/streams_messaging_manager.
  • The Streams Replication Manager service user (default: streamsrepmgr) must have write and execute permission on /var/lib/streams_replication_manager.
CDPD-71433: Connect logical type null values are not handled in AvroConnectTranslator
7.3.1
When the time.precision.mode property is set to connect for the Debezium connector, the connect logical types are used and null values are now handled.
CDPD-62059: AvroConnectTranslator should handle null values in fromConnectData method
7.3.1
Fix possible NPE exception issues in connector tasks which operate with Avro data format using the Cloudera AvroConverter.