Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show chunk_limit_size respectively #3562

Merged
merged 1 commit into from Nov 24, 2021
Merged

Conversation

kenhys
Copy link
Contributor

@kenhys kenhys commented Nov 24, 2021

Follow up #3553

Which issue(s) this PR fixes:

Fixes #

What this PR does / why we need it:

No functionality changes.
It is more informative and distinguishable.

Docs Changes:

Release Note:

It is more informative and distinguishable.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
@ashie ashie merged commit 3bbedcc into fluent:master Nov 24, 2021
@kenhys kenhys deleted the show-chunk-limit-size branch November 24, 2021 04:03
@kenhys kenhys mentioned this pull request Nov 26, 2021
kenhys added a commit to kenhys/fluentd that referenced this pull request Nov 29, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With fluent#3562 (Fluentd v1.14.3), it can just ignore only problematic long
record, but it always raise an exception. Thus it has performance
regression.

In this fix, skip_long_lines option enables to just skip processing
event further more.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
kenhys added a commit to kenhys/fluentd that referenced this pull request Nov 30, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With fluent#3562 (Fluentd v1.14.3), it can just ignore only problematic long
record during processing buffer chunk, but it always raise an
exception. Thus it has performance regression.

In this fix, skip_long_lines option enables to just skip processing
event further more in in_tail plugin side.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
kenhys added a commit to kenhys/fluentd that referenced this pull request Nov 30, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With fluent#3562 (Fluentd v1.14.3), it can just ignore only problematic long
record during processing buffer chunk, but it always raise an
exception. Thus it has performance regression.

In this fix, skip_long_lines option enables to just skip processing
event further more in in_tail plugin side.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
kenhys added a commit to kenhys/fluentd that referenced this pull request Nov 30, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With fluent#3562 (Fluentd v1.14.3), it can just ignore only problematic long
record during processing buffer chunk, but it always raise an
exception. Thus it has performance regression.

In this fix, skip_long_lines option enables to just skip processing
event further more in in_tail plugin side.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
kenhys added a commit to kenhys/fluentd that referenced this pull request Dec 1, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With fluent#3562 (Fluentd v1.14.3), it can just ignore only problematic long
record during processing buffer chunk, but it always raise an
exception. Thus it has performance regression.

In this fix, skip_long_lines option enables to just skip processing
event further more in in_tail plugin side.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
kenhys added a commit to kenhys/fluentd that referenced this pull request Dec 1, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With fluent#3562 (Fluentd v1.14.3), it can just ignore only problematic long
record during processing buffer chunk, but it always raise an
exception. Thus it has performance regression.

In this fix, maximum_line_limit_size option enables to just skip processing
event further more in in_tail plugin side.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
kenhys added a commit to kenhys/fluentd that referenced this pull request Dec 1, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With fluent#3562 (Fluentd v1.14.3), it can just ignore only problematic long
record during processing buffer chunk, but it always raise an
exception. Thus it has performance regression.

In this fix, max_line_size option enables to just skip processing
event further more in in_tail plugin side.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
kenhys added a commit that referenced this pull request Dec 2, 2021
There is a case that processing unexpected long line causes a
BufferChunkOverflow exception.

With #3562 (Fluentd v1.14.3), it can just ignore only problematic long
record during processing buffer chunk, but it always raise an
exception. Thus it has performance regression.

In this fix, max_line_size option enables to just skip processing
event further more in in_tail plugin side.

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants