Connector to database stopped

[pistoletov1974]

I deploy few outboundSQL connectors. When my VM with database stopped for the backup procedure, connectors go into stopping state due to error database connection. I need to shutdown and start connectors manually to restore functionality. Can connectors restore working state automaticaly after errors?

[digikata]

Hi @pistoletov1974 to fully address this requires automatic reconnect logic and offset management. For the first, an issue was opened to port the logic from the http connector infinyon/sql-connector#116 This shouldn't take long to add and should solve your immediate problem. With this, database stoppages will leave the connector up and running and waiting for the database to come back up.

We are in the close to an update to add offset management api which is required for restoring progress after a shutdown. This is required for a fuller set of conditions for which working state can be restored.

[pistoletov1974]

@digikata now i resolve my problem with cron script, deploy - shutdown -start connector, but it is bad solution. What is offset management api? Ыtopping the connector is very bad because it can lead to data loss. Tell me, do you have any plans to solve this problem?

[digikata]

The offset management api is described here https://github.com/infinyon/fluvio/blob/master/rfc/offset-management.md, right now it's just on the finishing steps of the implementation. The core logic is in the mainline hidden behind a features while the full set of admin user cli/api implementation and extended testing is completed. Once that is released, a fluvio cluster will be able to keep the last offset consumed vs a consumer_id. If you connector is shut down or is disconnected, on restart it will resume working at the last synced offset.

[ajhunyady]

@digikata, if we implement the retry logic in the database connector, it should allow @pistoletov1974 to remove the cron job. However, there is still packet loss until the offset management is finished.

[ajhunyady]

@galibey, is there an ETA for when @pistoletov1974 can test the engineering build?

[galibey]

End of the next week

[pistoletov1974]

Is there any news about retry logic? And one more question - What is the best way to autostart fluvio on system start? I need few commands to start fluvio - start claster and after that start connectors ?

[digikata]

There is retry logic in the 0.4.0 sql sink connector release, and we have released offset management with our latest stable fluvio 0.11.6, next we plan to add offset management to the sql connector.

[ajhunyady]

pistoletov1974 All these issues have been addressed, hence ready for testing.

[pistoletov1974]

@ajhunyady I will test in few days and reply

[ajhunyady]

Link to the docs:

• https://fluvio.io/cli/cluster/consumer/
• https://fluvio.io/docs/concepts/producer-consumer/#consumer-offsets