Use the Kafka configuration struct populated by CLI11 (!422) · Merge requests · ecdc / ess-dmsc / kafka-to-nexus

Created by: matthew-d-jones

DM-1479

Custom Kafka configuration (see https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md) given via the --kafka-config command line option was being parsed correctly but then not actually used when constructing producer or consumer configuration.

You can test this is now working by including the following in a config ini file:

kafka-config=queue.buffering.max.messages 999

and early in the logs after starting the File Writer you should see:

KafkaW/BrokerSettings.cpp:10 [7] [ServiceID:kafka-to-nexus--host:jonmd-OptiPlex-7040--pid:9363]: set config: queue.buffering.max.messages = 999

100000 is the default value, it should have used the value of 999 defined in the configuration file.

Use the Kafka configuration struct populated by CLI11