Apache Kafka Connect

 HOWTO

• https://docs.confluent.io/platform/current/connect/kafka_connectors.html
• https://www.confluent.io/product/connectors/
• JDBC source/sink connector https://www.confluent.io/hub/confluentinc/kafka-connect-jdbc
• https://www.baeldung.com/kafka-connectors-guide

Check plugin.path

config/connect-standalone.properties

plugin.path=libs/

File connector

$ bin/connect-standalone.sh config/connect-standalone.properties config/connect-file-sink.properties

file connector config

name=local-file-sink
connector.class=FileStreamSink
tasks.max=1
file=test.sink.txt
topics=connect-test
key.converter=org.apache.kafka.connect.storage.StringConverter
value.converter=org.apache.kafka.connect.storage.StringConverter
key.converter.schemas.enable=false
value.converter.schemas.enable=false

JSON connector

name=local-file-sink
connector.class=FileStreamSink
tasks.max=1
file=test.sink.txt
topics=connect-test
key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=false
value.converter.schemas.enable=false