Kafka Connect
Kafka Connect Overview
Setting up Kafka Connect
Using Kafka Connect
Configuring the Kafka Connect Role
Managing, Deploying and Monitoring Connectors
Writing Kafka data to Ozone with Kafka Connect
Writing data in an unsecured cluster
Writing data in a Kerberos and TLS/SSL enabled cluster
Using the AvroConverter
Enabling and configuring the AvroConverter
Configuring AvroConverter for Debezium connectors
Reading Debezium Avro records from Kafka
Configuring EOS for source connectors
Securing Kafka Connect
Kafka Connect to Kafka broker security
Configuring TLS/SSL encryption
Configuring Kerberos authentication
Kafka Connect REST API security
Authentication
Configuring TLS/SSL client authentication
Configuring SPNEGO authentication and trusted proxies
Authorization
Authorization model
Ranger integration
Kafka Connect connector configuration security
Kafka Connect Secrets Storage
Terms and concepts
Managing secrets using the REST API
Re-encrypting secrets
Configuring connector JAAS configuration and Kerberos principal overrides
Configuring a Nexus repository allow list
Single Message Transforms
Configuring an SMT chain
ConvertFromBytes
ConvertToBytes
Connectors
Installing connectors
Installing custom developed connectors
Installing FileStream connectors
Debezium Db2 Source
Debezium MySQL Source
Debezium Oracle Source
Debezium PostgreSQL Source
Debezium SQL Server Source
HTTP Source
Stateless NiFi Source properties reference
HTTP Source properties reference
JDBC Source
Stateless NiFi Source properties reference
JDBC Source properties reference
JMS Source
Stateless NiFi Source properties reference
JMS Source properties reference
MQTT Source
Stateless NiFi Source properties reference
MQTT Source properties reference
SFTP Source
Stateless NiFi Source properties reference
SFTP Source properties reference
Stateless NiFi Source and Sink
Dataflow development best practices
General recommendations and criteria
Dataflow execution and scheduling
Merging considerations for sink connectors
Considerations for listen-type source connectors
Mapping of NiFi features
Kafka Connect worker assignment
Kafka Connect log files
Kafka Connect tasks
Developing a dataflow
Deploying a dataflow
Downloading and viewing predefined dataflows
Configuring flow.snapshot
Tutorial: developing and deploying a JDBC Source dataflow
Syslog TCP Source
Stateless NiFi Source properties reference
Syslog TCP Source properties reference
Syslog UDP Source
Stateless NiFi Source properties reference
Syslog UDP Source properties reference
ADLS Sink
Stateless NiFi Sink properties reference
ADLS Sink properties reference
Amazon S3 Sink
Configuration example
Stateless NiFi Sink properties reference
Amazon S3 Sink properties reference
HDFS Sink
Configuration example for writing data to HDFS
Configuration example for writing data to Ozone FS
Stateless NiFi Sink properties reference
HDFS Sink properties reference
HDFS Stateless Sink
Stateless NiFi Sink properties reference
HDFS Stateless Sink properties reference
HTTP SInk
Stateless NiFi Sink properties reference
HTTP Sink properties reference
InfluxDB SInk
Stateless NiFi Sink properties reference
InfluxDB Sink properties reference
JDBC Sink
Stateless NiFi Sink properties reference
JDBC Sink properties reference
Kudu Sink
Stateless NiFi Sink properties reference
Kudu Sink properties reference
S3 Sink
Stateless NiFi Sink properties reference
S3 Sink properties reference