Hi!
We have the Kafka connector working. However, it doesn’t seem to support reading from the beginning of a topic. I tried adding this to the config:
“consumer.override.auto (https://consumer.override.auto/).offset.reset”: “earliest”
but then I just got a “400 Bad Request” response from the connect server:
How can I get this to work?
Hello,
This article describes a very similar issue: Starting a Kafka Connect sink connector at the end of a topic
Note that one of the required steps is to set this in the worker config first: “connector.client.config.override.policy=All”.
I hope this helps. Please let us know if you have any other questions.
sg - let me see if i can get it to work
@karenshi We are in the process of launching the new private beta Kafka connector, which provides the option to set the starting offset to the topic beginning. Please reach out to us you are interested! https://rockset.com/contact-us/