ECDC-2611: File writer system tests to use confluent_kafka (!598) · Merge requests · ecdc / ess-dmsc / kafka-to-nexus · GitLab

Afonso Mukai requested to merge ECDC-2611_file_writer_system_tests into development Jul 27, 2021

Created by: ebadkamil

Description of work

Start using confluent_kafka library in system tests.
wait_until_kafka_ready method in conftest, now uses producer to send message to kafka and waits until the message delivery was acknowledged (as it is done in forwarder library's system tests) and then only declares that kafka is ready. Old way of successfully creating consumer and declaring kafka is ready seems to create spurious and random errors while running system-tests locally.

NOTE: This PR does not fix assertion error in test_filewriter_static_data.py . That will be a different ticket.