Support Pod Communication network options like OCI OKE

[sindhusri16]

What would you like to be added:
We need support for pod communication network options in ocimachine templates used as worker nodes. I believe we need some template options supporting this subnet and cniType. I think we also need support for pod native networking for this to work

Why is this needed:
Oracle Private Cloud Appliance(PCA) needs to support this as part of an enhancement request in the kubernetes engine.

[joekr]

I think we also need support for pod native networking for this to work

Will PCA support this? I believe this is built into OKE not CAPOCI.

[sindhusri16]

I am doing a PoC for the same but thought some kind of support is required on pod native netowrking in workload clusters from capoci. If its built in oke will look into that.

[joekr]

I believe we would have to expose the ability to modify capoci to allow users to select pod native networking but we couldn't do that until it is supported in PCA