Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Container Runtime Interface (CRI) log format #4616

Open
sydp opened this issue Apr 5, 2023 · 2 comments · May be fixed by #4742
Open

Add support for Container Runtime Interface (CRI) log format #4616

sydp opened this issue Apr 5, 2023 · 2 comments · May be fixed by #4742
Assignees
Labels
enhancement New or improved functionality parsers Issues related to parsers and parser plug-ins

Comments

@sydp
Copy link
Contributor

sydp commented Apr 5, 2023

Describe the problem:

Kubernetes uses the CRI log format for container stdout/stderr log streams.

Additional context

Per https://github.com/kubernetes/kubernetes/blob/master/pkg/kubelet/kuberuntime/logs/logs.go#L125, CRI log format example:

2016-10-06T00:17:09.669794202Z stdout P log content 1
2016-10-06T00:17:09.669794203Z stderr F log content 2

where "log content 1", "log content 2" can be another log format e.g. apache access log.

Archived design proposal: https://github.com/kubernetes/design-proposals-archive/blob/main/node/kubelet-cri-logging.md

@sydp sydp added the parsers Issues related to parsers and parser plug-ins label Apr 5, 2023
@joachimmetz joachimmetz added the enhancement New or improved functionality label Apr 6, 2023
@sydp
Copy link
Contributor Author

sydp commented Apr 6, 2023

Was discussing with @roshanmaskey OOB today who expressed an interest to work on this as he has more familiarity with containerd/k8s (container-explorer) .

@sydp sydp assigned roshanmaskey and unassigned sydp Apr 6, 2023
@joachimmetz joachimmetz added this to To do in Format support Jun 17, 2023
@sydp sydp self-assigned this Aug 22, 2023
@sydp
Copy link
Contributor Author

sydp commented Aug 23, 2023

Datetime strings are formatted with nanosecond precision. These values appear to be based on the Golang time module.

log2timeline/dfdatetime#263

@sydp sydp linked a pull request Sep 4, 2023 that will close this issue
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New or improved functionality parsers Issues related to parsers and parser plug-ins
Projects
Format support
  
To do
Development

Successfully merging a pull request may close this issue.

3 participants