(feat/component) Eventing Component Designed for Oversized Payloads (Video, JSON, files)

[nkreiger]

The default maximum message size for the Kafka broker, is 1 MB.

This can be increased to handle larger payloads, but their are performance implications, and design flaws to doing that, per their documentation.

I would like to propose/initiate the conversation around a new eventing component, based on strategy 1, of this documentation.

[nkreiger]

My initial thoughts are a custom

Producer

and

Consumer

component, where the producer would store, and create the reference to be passed on. And the consumer would bring back the full payload to the next step. So that you could do multiple hops with just the reference, before you want to decode it into its final destination.