Overview

Custom Kafka Connect add-ons:

• Connectors
• Converters
• SMTs

Connectors:

• org.hifly.kafka.mongo.CustomMongoSinkConnector - Custom Sink connector for MongoDB implementing upsert operations and deletes.

Build

Package:

cd mongo-custom-connector
mvn clean compile assembly:single

Execute tests

cd mongo-custom-connector
mvn clean test

---

Converters:

• org.hifly.kafka.OracleRawToBsonKeyConverter - Convert a byte [] to Oracle RAW data type.
• org.hifly.kafka.ByteArrayAndStringConverter - pass through for byte array schema type and string schema type.

SMTs:

• org.hifly.kafka.smt.JsonKeyToValue - Add message key to message value as a new field.
• org.hifly.kafka.smt.ExplodeJsonString - Create a Struct for a JSON Field. Extract JSON value from a massage field and copy the JSON fields in the output message as top-level fields

Build

Install oracle jdbc driver in maven local repo:

mvn install:install-file -Dfile=ojdbc10.jar -DgroupId=com.oracle -DartifactId=ojdbc10 -Dversion=19.3 -Dpackaging=jar

Package:

mvn clean compile assembly:single

Execute tests

mvn clean test