Opentelemetry instrumentation for async kafka in python

[dmozh]

Hi everyone!

Somebody know, there is a instrument for tracing aiokafka?
I find opentelemetry-instrumentation-kafka-python but this lib work with sync kafka lib. Me in my work task need use full async stack, and this place i have problem. This library don't work with aiokafka.
I would be grateful for any help or advice.

[srikanthccv]

No, there is no instrumentation for aiokafka.

[tarbaig]

Any insight into how much effort would be needed to build this? I build something similar for aiokafka based faust, a python based kafka-streams clone.

[Bashar200]

Hi do we have any support for this now ?

[Bashar200]

@srikanthccv

[srikanthccv]

No, what are supported can be found here https://github.com/open-telemetry/opentelemetry-python-contrib/tree/main/instrumentation#readme

[AMontagu]

Had the same issue at my company today. Decide to adapt the interceptor for aio. Please note that I have just started it this afternoon and it may not work in all cases: https://github.com/socotecio/opentelemetry-instrumentation-aiokafka

Is this can be part of a PR to be added in the list of supported contrib instrumentor or need to be hosted elsewhere ? To know if I make an PR or transform it to a real package in pypi.

[AMontagu]

I use it in production without issue.
But didn't make any PR because I need the guideline to avoid working for nothing

[ocelotl]

@AMontagu sorry, what guideline are you referring to? If it is this one, we do accept new instrumentations as long as there is someone willing to become a maintaier for that particular instrumentation.

[AMontagu]

Thank you @ocelotl,

Will add it into our platform team backlog and see if we can make it happen and support it.

[janario]

I was looking for the same thing. :-)

Tested the changes from https://github.com/socotecio/opentelemetry-instrumentation-aiokafka and they look promising.

hey @AMontagu any plans to integrate it as in the official support? that would be great :-)

[AMontagu]

Hello @janario

Still not prioritized. But we have more ressources coming. Will let you know.