Document Kubevirt incompatibility with Cilium

[xmudrii]

Cilium doesn't support specifying Pod's MAC address and therefore it can't be used for the KubeVirt infrastructure cluster. KubeVirt infrastructure clusters that use Cilium are not able to start VMs created by KKP/machine-controller.

Upstream reference: cilium/cilium#22119

/assign @moadqassem @embik
cc @toschneck

[kubermatic-bot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from xmudrii. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[xmudrii]

/hold
@moadqassem will confirm if it's possible to workaround this with the strict mode

[kubermatic-bot]

Issues go stale after 90d of inactivity.
After a furter 30 days, they will turn rotten.
Mark the issue as fresh with /remove-lifecycle stale.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[xmudrii]

/remove-lifecycle stale
@moadqassem Do you have any update on this issue?

[xmudrii]

Looks like this will be part of the Cilium v1.16.0 release: https://github.com/cilium/cilium/releases/tag/v1.16.0-pre.0 (cilium/cilium#29360)

[moadqassem]

Looks like this will be part of the Cilium v1.16.0 release: https://github.com/cilium/cilium/releases/tag/v1.16.0-pre.0 (cilium/cilium#29360)

I haven't tried it yet. But seems that it should work. Last problem that I encountered with cilium was due to the fact of MAC address propagation.