Stas Spiridonov
32248ef0ba
chore(thor): Performance optimization for aggregator ( #20934 )
2026-02-24 04:07:43 +00:00
Stas Spiridonov
0b483ab9c0
fix(thor): Fix for column duplicates in consequent compat stages ( #20893 )
2026-02-20 14:00:14 -07:00
Ashwanth
a56220f22f
chore(planner): apply parallelPushdown optimisation to valid aggregations ( #20655 )
2026-02-19 19:01:59 +05:30
Robert Fratto
00c8211fbf
chore(engine): add concurrency to Pipeline.Open ( #20839 )
2026-02-18 08:19:18 -05:00
Ashwanth
73961f18a3
chore(xcap): leaner xcap API ( #20771 )
2026-02-17 19:42:33 +05:30
Stas Spiridonov
b1f059d4e0
fix(thor): incorrect empty records skipping ( #20812 )
2026-02-13 19:33:32 -03:00
Robert Fratto
11f885af7a
chore(engine): fix streamsView.Open semantics ( #20802 )
2026-02-13 08:37:16 -05:00
Robert Fratto
2d63582b15
chore: finish adding Open semantics in engine, metastore ( #20798 )
2026-02-13 07:34:24 -05:00
Robert Fratto
d85fb0317f
chore(dataobj): Add Open semantics to section readers ( #20790 )
...
Signed-off-by: Robert Fratto <robertfratto@gmail.com >
2026-02-12 13:50:28 -05:00
Robert Fratto
6a2c7c79e3
refactor(engine): introduce Pipeline.Open method ( #20785 )
2026-02-12 08:35:58 -05:00
Trevor Whitney
f6a6a4fad5
feat: add case-insensitive regex optimization ( #20578 )
2026-02-05 18:15:05 +00:00
Trevor Whitney
5acb96abbd
ci: add drilldown and case insensitive queries to correctness tests ( #20603 )
...
Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com >
2026-02-04 18:57:08 +00:00
Joe Elliott
a4e75ce474
perf: avoid bytes to runes allocs by decoding in place ( #20602 )
...
Signed-off-by: Joe Elliott <number101010@gmail.com >
2026-01-29 12:02:20 -05:00
Stas Spiridonov
514a142859
fix(thor): Fix error filtering before range aggregations ( #20560 )
2026-01-26 14:14:52 -07:00
Stas Spiridonov
efdb1f5a37
chore: Reducing waste on processing empty records ( #20562 )
2026-01-23 15:58:41 -05:00
Ashwanth
8b7161a9fc
chore(engine): enforce max_query_series ( #20557 )
2026-01-23 18:27:35 +05:30
Ashwanth
b21825ec23
chore: capture aggregation exec duration ( #20299 )
2026-01-23 11:45:16 +00:00
Stas Spiridonov
805b8020df
chore: Thor query engine memory improvements, part 3 ( #20530 )
2026-01-21 15:20:38 -07:00
Stas Spiridonov
bedfb78378
chore: Thor query engine memory improvements, part 2 ( #20473 )
2026-01-21 09:22:39 -05:00
Salva Corts
76a21de886
feat: Add Header Propagation and Stream Filtering to V2 Query Engine ( #20449 )
2026-01-21 09:21:09 +01:00
yy
0574159216
chore: typos in comments ( #20481 )
2026-01-20 08:24:56 -05:00
Ashwanth
8a6c4f8611
chore(planner): add filter stages to drop lines matching delete requests ( #20395 )
2026-01-20 14:32:11 +05:30
Stas Spiridonov
168da488db
fix: Out of bounds error fix for gapped window matcher ( #20396 )
2026-01-12 14:05:08 -07:00
Assel Meher
5663f9c26d
feat(engine): add regexp parser support for log queries ( #20286 )
2026-01-08 11:16:01 +00:00
Stas Spiridonov
c2116618bd
chore: Improving memory allocations for new query engine ( #20321 )
2026-01-07 12:34:15 -05:00
Stas Spiridonov
2203c1d8e8
chore: tweaks for feature parity ( #19940 )
2026-01-06 10:37:40 +00:00
Ivan Kalita
08e3c4385f
feat(metastore): shard sections queries over index files ( #20134 )
...
Running metastore queriesin a distributed manner using query engine workers:
- Build a distributed metastore plan from GetIndexes and execute it via the v2 scheduler/worker pipeline
- Split the request into per-index PointersScan tasks, then fan-in and CollectSections to produce final section descriptors
- Add physical plan + protobuf support for Merge/PointersScan, improve tracing/cleanup, and add coverage for planner/workflow/proto roundtrips
2025-12-22 12:56:45 +01:00
Stas Spiridonov
b6b7459435
chore: Aggregation groupings for by() and without() ( #19928 )
2025-12-17 12:38:01 -05:00
Robert Fratto
2d54ddc6d9
chore(engine): adjustments to log task short circuiting ( #20121 )
2025-12-04 19:26:50 +00:00
Ashwanth
54f9723af1
chore(xcap): adds exporter to summarise capture as a structured log line ( #20099 )
2025-12-04 13:34:55 +00:00
Ashwanth
356cd36d8e
chore: close stream section reader ( #20107 )
2025-12-04 13:09:24 +00:00
Ashwanth
728b308edf
chore: update read stats to use xcap ( #20095 )
2025-12-04 18:34:58 +05:30
Ashwanth
cbad9d4ccb
chore(xcap): support events, status and improve coverage ( #20096 )
2025-12-04 05:38:50 +00:00
benclive
99ba51e48a
fix(enginev2): Close pipeline before building query results ( #20100 )
2025-12-03 14:55:05 +00:00
Christian Haudum
8b59b944f2
chore(dataobj): Use common base config for indexobj and logsobj builders ( #20037 )
...
Use the same config struct for both the indexobj builder and the logsobj builder, since they are configured identically, only with different default values.
2025-11-28 07:41:36 +00:00
Stas Spiridonov
5b88bcef3a
chore: Short circuiting for new scheduler ( #20000 )
2025-11-26 16:49:26 +00:00
Ashwanth
5bb6b54052
chore: compat should also handles metadata collisions ( #20005 )
2025-11-25 13:54:29 +00:00
Ashwanth
11b1dcb2a3
chore(engine): introduce execution capture ( #19821 )
2025-11-19 10:34:25 +05:30
Christian Haudum
f066d378a5
chore(engine): Do not embed types.Literal interface in logical and physical Literal ( #19858 )
...
This ensures that logical.Literal and physical.LiteralExpr do not implicitly implement the types.Literal interface, which caused a bug fixed with #19853
Signed-off-by: Christian Haudum <christian.haudum@gmail.com >
2025-11-14 08:09:18 +01:00
renovate-sh-app[bot]
d76b3bf495
fix(deps): update module github.com/apache/arrow-go/v18 to v18.4.1 (main) ( #19750 )
...
Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>
Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>
Co-authored-by: Paul Rogers <paul.rogers@grafana.com >
2025-11-09 11:53:00 -05:00
Stas Spiridonov
f2c874e6ab
chore: scheduler tasks are aware of their time range ( #19709 )
2025-11-07 12:38:17 -05:00
benclive
36613bd017
fix: Empty keys are returned if desired in v2 engine ( #19717 )
2025-11-07 10:40:54 +00:00
benclive
01cab53447
feat(engine): implement strict and keepEmpty logfmt parsing ( #19668 )
2025-11-05 17:48:33 +00:00
Ashwanth
b3803113ad
chore(engine): registers functions for logical op ( #19704 )
2025-11-05 15:26:18 +05:30
Ashwanth
5d961a4cc3
chore(topk): improvements to reduce alloc bytes and alloc space ( #19660 )
2025-11-04 17:01:07 +05:30
Trevor Whitney
dd6b31473e
fix: errors in parse pipeline ( #19667 )
...
Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com >
2025-10-31 13:36:55 -04:00
Trevor Whitney
8b39d4d077
refactor: implment parse as a projection ( #19579 )
...
Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com >
Co-authored-by: Christian Haudum <christian.haudum@gmail.com >
2025-10-31 11:07:47 +00:00
Christian Haudum
73bc30d9a8
perf(engine): Improve regexp expression evaluation ( #19644 )
...
This PR changes the evaluation of regex-match binary expression evaluations so that the regexp on right hand side of the expression is only compiled once for each batch evaluation, rather than for each row.
This saves a ton of allocations and improves general performance of queries with a regexp line or label filter.
2025-10-30 13:26:26 +01:00
Robert Fratto
3c99535b0a
chore(engine): provide worker ( #19588 )
...
The new worker package connects to an instance of a scheduler (#19570 )
for task assignment and execution. A worker spawns a fixed number of
threads, each of which execute one task at a time.
Signed-off-by: Robert Fratto <robertfratto@gmail.com >
2025-10-28 14:53:45 +00:00
benclive
9a68900bc1
fix: Sanitize logfmt keys in v2 engine ( #19621 )
2025-10-28 14:49:23 +00:00
