v0.12.1-victorialogs

Released at 2024-05-26

• FEATURE: add support for comments in multi-line LogsQL queries. See these docs.

• BUGFIX: properly apply in(...) filter inside if (...) conditions at various pipes. This bug has been introduced in v0.12.0.

v0.12.0-victorialogs

Released at 2024-05-26

• FEATURE: add pack_json pipe, which packs all the log fields into a JSON object and stores it into the given field.

• FEATURE: add unroll pipe, which can be used for unrolling JSON arrays stored in log fields.

• FEATURE: add replace_regexp pipe, which allows updating log fields with regular expressions.

• FEATURE: improve performance for format and extract pipes.

• FEATURE: improve performance for /select/logsql/field_names HTTP API.

• BUGFIX: prevent from panic in sort pipe when VictoriaLogs runs on a system with one CPU core.

• BUGFIX: do not return referenced fields if they weren't present in the original logs. For example, _time:5m | format if (non_existing_field:"") "abc" could return empty non_exiting_field, while it shuldn't be returned because it is missing in the original logs.

• BUGFIX: properly initialize values for in(...) filter inside filter pipe if the in(...) contains other filters. For example, _time:5m | filter ip:in(user_type:admin | fields ip) now works correctly.

v0.11.0-victorialogs

Released at 2024-05-25

• FEATURE: add replace pipe, which allows replacing substrings in log fields.
• FEATURE: support comparing log field values with special numeric values. For example, duration:>1.5s and response_size:<15KiB are valid filters now.
• FEATURE: properly sort durations and short numeric values in sort pipe. For example, 10s goes in front of 1h, while 10KB goes in front of 1GB.
• FEATURE: add an ability to preserve the original non-empty field values when executing extract, unpack_json, unpack_logfmt and format pipes.
• FEATURE: add an ability to preserve the original field values if the corresponding unpacked values are empty when executing extract, unpack_json, unpack_logfmt and format pipes.

v0.10.0-victorialogs

Released at 2024-05-24

• FEATURE: return the number of matching log entries per returned value in HTTP API results. This simplifies detecting field / stream values with the biggest number of logs for the given LogsQL query.

• FEATURE: improve performance for regexp filter in the following cases:

  • If the regexp contains just a phrase without special regular expression chars. For example, ~"foo".
  • If the regexp starts with .* or ends with .*. For example, ~".*foo.*".
  • If the regexp contains multiple strings delimited by |. For example, ~"foo|bar|baz".
  • If the regexp contains multiple words. For example, ~"foo bar baz".

• FEATURE: allow disabling automatic unquoting of the matched placeholders in extract pipe. See these docs.

• BUGFIX: properly parse ! in front of exact filter, exact-prefix filter and regexp filter. For example, !~"some regexp" is properly parsed as not ="some regexp". Previously it was incorrectly parsed as '~="some regexp"' phrase filter.

• BUGFIX: properly sort results by _time field when limit pipe is applied. For example, _time:5m | sort by (_time) desc | limit 10 properly works now.

v0.9.1-victorialogs

Released at 2024-05-22

• BUGFIX: web UI: fix loading web UI, which has been broken in v0.9.0.

v0.9.0-victorialogs

Released at 2024-05-22

• FEATURE: allow using ~"some_regexp" regexp filter instead of re("some_regexp").

• FEATURE: allow using ="some phrase" exact filter instead of exact("some phrase").

• FEATURE: allow using ="some prefix"* exact prefix filter instead of exact("some prefix"*).

• FEATURE: add ability to generate output fields according to the provided format string. See these docs.

• FEATURE: add ability to extract fields with extract pipe only if the given condition is met. See these docs.

• FEATURE: add ability to unpack JSON fields with unpack_json pipe only if the given condition is met. See these docs.

• FEATURE: add ability to unpack logfmt fields with unpack_logfmt pipe only if the given condition is met. See these docs.

• FEATURE: add fields_min and fields_max functions for stats pipe, which allow returning all the log fields for the log entry with the minimum / maximum value at the given field.

• FEATURE: add /select/logsql/streams HTTP endpoint for returning streams from results of the given query. See these docs for details.

• FEATURE: add /select/logsql/stream_label_names HTTP endpoint for returning stream label names from results of the given query. See these docs for details.

• FEATURE: add /select/logsql/stream_label_values HTTP endpoint for returning stream label values for the given label from results of the given query. See these docs for details.

• FEATURE: web UI: change time range limitation from _time in the expression to start and end query args.

• BUGFIX: fix invalid memory address or nil pointer dereference panic when using extract, unpack_json or unpack_logfmt pipes. See this issue.

• BUGFIX: web UI: fix an issue where logs with long _msg values might not display. See this issue.

• BUGFIX: properly handle time range boundaries with millisecond precision. See this issue.

v0.8.0-victorialogs

Released at 2024-05-20

• FEATURE: add ability to extract JSON fields from log fields. See these docs.

• FEATURE: add ability to extract logfmt fields from log fields. See these docs.

• FEATURE: add ability to extract arbitrary text from log fields into the output fields. See these docs.

• FEATURE: add ability to put arbitrary queries inside in() filter.

• FEATURE: add support for post-filtering of query results with filter pipe.

• FEATURE: allow applying individual filters per each stats function. See these docs.

• FEATURE: allow passing string values to min and max functions. Previously only numeric values could be passed to them.

• FEATURE: speed up sort ... limit N pipe for typical cases.

• FEATURE: allow using more convenient syntax for range filters if upper or lower bound isn't needed. For example, it is possible to write response_size:>=10KiB instead of response_size:range[10KiB, inf), or temperature:<42 instead of temperature:range(-inf, 42).

• FEATURE: add /select/logsql/hits HTTP endpoint for returning the number of matching logs per the given time bucket over the selected time range. See tese docs for details.

• FEATURE: add /select/logsql/field_names HTTP endpoint for returning field names from results of the given query. See these docs for details.

• FEATURE: add /select/logsql/field_values HTTP endpoint for returning unique values for the given field obtained from results of the given query. See these docs for details.

• BUGFIX: properly take into account offset sort pipe when it already has limit. For example, _time:5m | sort by (foo) offset 20 limit 10.

v0.7.0-victorialogs

Released at 2024-05-15

• FEATURE: add support for optional start and end query args to HTTP querying API, which can be used for limiting the time range for LogsQL query.
• FEATURE: add ability to return the first N results from sort pipe. This is useful when N biggest or N smallest values must be returned from large amounts of logs.
• FEATURE: add quantile and median stats functions.

v0.6.1-victorialogs

Released at 2024-05-14

• FEATURE: use natural sort order when sorting logs via sort pipe.

• BUGFIX: properly return matching logs in streams with small number of entries. Previously they could be skipped. The issue has been introduced in the release v0.6.0.

• BUGFIX: fix runtime error: index out of range panic when using sort pipe like _time:1h | sort by (_time). See this issue.

v0.6.0-victorialogs

Released at 2024-05-12

• FEATURE: return all the log fields by default in query results. Previously only _stream, _time and _msg fields were returned by default.

• FEATURE: add support for returning only the requested log fields. See these docs.

• FEATURE: add support for calculating various stats over log fields. Grouping by arbitrary set of log fields is supported. See these docs for details.

• FEATURE: add support for sorting the returned results. See these docs.

• FEATURE: add support for returning unique results. See these docs.

• FEATURE: add support for limiting the number of returned results. See these docs.

• FEATURE: add support for copying and renaming the selected log fields. See these and these docs.

• FEATURE: allow using _ inside numbers. For example, score:range[1_000, 5_000_000] for range filter.

• FEATURE: allow numbers in hexadecimal and binary form. For example, response_size:range[0xff, 0b10001101101] for range filter.

• FEATURE: allow using duration and byte size suffixes in numeric values inside LogsQL queries. See these docs.

• FEATURE: improve data ingestion performance by up to 50%.

• FEATURE: optimize performance for LogsQL query, which contains multiple filters for words or phrases delimited with AND operator. For example, foo AND bar query must find log messages with foo and bar words at faster speed.

• BUGFIX: prevent from possible corruption of short log fields during data ingestion.

• BUGFIX: prevent from additional CPU usage for up to a few seconds after canceling the query.

• BUGFIX: prevent from returning log entries with emtpy _stream field in the form "_stream":"" in search query results. See this issue.