[helm] fix PDB templating and add support for HPA, pod affinity etc

[enneitex]

Fixes #8340
Fixes #8137

• Updated podDisruptionBudget template file and splitted it in two files, so we can create a PDB per deployment instead of one for the whole app.
• Removed app.scheduling.nodeSelector as it was breaking tempalting when it was defined but not api.nodeSelector
• Added variables to set affinity, tolerations, replicas, topologySpreadConstraints and HorizontalPodAutoscaler for WEB and API deployments
• moved replicas from app.scaling to each component so we can set different replica for WEB and API deployments

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: enneitex
Once this PR has been reviewed and has the lgtm label, please assign desaintmartin for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• charts/helm-chart/kubernetes-dashboard/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[k8s-ci-robot]

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.