Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How do I set reasonable resource limits to prevent loss of logs? #3271

Open
txjjjjj opened this issue Sep 13, 2023 · 0 comments
Open

How do I set reasonable resource limits to prevent loss of logs? #3271

txjjjjj opened this issue Sep 13, 2023 · 0 comments
Labels
question Further information is requested

Comments

@txjjjjj
Copy link

txjjjjj commented Sep 13, 2023

Because we only use agent to collect eks logs, we don't need to collect metrics and trace.

  1. Is there any documentation on stress testing ? we need to set more reasonable resource limits.
  2. How to avoid not losing logs, is there any best practice. Because the same cluster may contains node group instances resource configuration gap is very large.
  3. We have some arm nodes in our eks cluster, is it recommended to use otel agent?

btw, I noticed some default configurations

    exporters:
      otlphttp:
        endpoint: http://${LOGS_METADATA_SVC}.${NAMESPACE}.svc.cluster.local.:4318
        sending_queue:
          queue_size: 10

    exporters:
      sumologic/containers:
        endpoint: ${SUMO_ENDPOINT_DEFAULT_LOGS_SOURCE}
        json_logs:
          add_timestamp: false
        log_format: json
        sending_queue:
          enabled: true
          num_consumers: 10
          queue_size: 10000
          storage: file_storage

daemonset
        resources:
          limits:
            cpu: 1000m
            memory: 1Gi
          requests:
            cpu: 100m
            memory: 32Mi


statefulset
        resources:
          limits:
            cpu: 1000m
            memory: 1Gi
          requests:
            cpu: 500m
            memory: 768Mi

@txjjjjj txjjjjj added the question Further information is requested label Sep 13, 2023
@txjjjjj txjjjjj changed the title How do I set resource limits to prevent loss of logs? How do I set reasonable resource limits to prevent loss of logs? Sep 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant