156 Commits

Author SHA1 Message Date
Trevor Whitney
e569e10eec chore(bench): introduce metadata discovery tool (#21085) 2026-03-09 17:32:57 +00:00
Assel Meher
bbff4331ea fix: reject streams with labels exceeding 16MB (#20719) 2026-02-10 10:34:50 +01:00
Assel Meher
8fa8846c39 ci: add multi-arch build verification workflow for Loki binary (#20502) 2026-01-21 20:04:41 +00:00
John Newbigin
fc270fd535 fix: enforce maxRecvMsgSize and maxCompressedMsgSize for OTLP (#20312)
Co-authored-by: shantanualshi <shantanu.alshi@grafana.com>
2026-01-19 13:07:19 +05:30
Salva Corts
987840b5d3 feat: Resolve ingestion policy via a header (#19548) 2025-10-24 12:00:25 +02:00
Salva Corts
7b57b7da4e fix: Get applied limits endpoint returns valid yaml/json representation for otlp_config (#19576) 2025-10-23 17:28:38 +02:00
Stas Spiridonov
a6d4935c88 fix: Fix push stats calculation (#19319) 2025-09-29 16:24:51 -06:00
Sophie Waldman
98b411a649 chore(linter): Fix issues flagged by updated golangci-lint version (#19206) 2025-09-15 16:58:01 -04:00
Shantanu Alshi
4dfef8fc15 chore(otlp): Add support for zstd and lz4 content-encodings for OTLP logs (#18842) 2025-09-01 15:17:29 +05:30
Arve Knudsen
09d831ea85 chore: upgrade Prometheus to 208187eaa19b (#18756)
Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>
Co-authored-by: Salva Corts <salva.corts@grafana.com>
2025-08-08 11:23:21 +02:00
Robert Fratto
86c57c8616 chore: consistently use new labels.Labels API (#18490) 2025-07-18 13:15:40 -04:00
Shantanu Alshi
3ffed72f64 refactor: Upgrade to Prometheus to main (#18418)
Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>
Signed-off-by: Shantanu Alshi <shantanu.alshi@grafana.com>
Co-authored-by: Arve Knudsen <arve.knudsen@gmail.com>
Co-authored-by: Bryan Boreham <bjboreham@gmail.com>
Co-authored-by: Ashwanth <iamashwanth@gmail.com>
2025-07-15 11:18:38 +05:30
Shantanu Alshi
61e81c5a4c chore(otlp): OTLP Metrics (#18281) 2025-07-02 15:39:23 +05:30
JordanRushing
2161c8c52c fix(otlp): calculate entry metadata size before adding resource/scope attributes (#17629)
Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com>
2025-07-01 13:18:46 -05:00
Paul Rogers
08e33b4384 chore: Rename distributor lag counter to end in _total (#18151) 2025-06-18 15:26:33 -04:00
renovate[bot]
8b265ede15 fix(deps): update module github.com/prometheus/common to v0.64.0 (main) (#16750)
Signed-off-by: Paul Rogers <129207811+paul1r@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Paul Rogers <paul.rogers@grafana.com>
Co-authored-by: Paul Rogers <129207811+paul1r@users.noreply.github.com>
2025-06-13 12:01:18 -04:00
Christian Haudum
252de8540e chore(deps): Update github.com/prometheus/otlptranslator (#18095) 2025-06-12 20:07:38 +02:00
aarogoss
6495be0180 feat: adds distributor lag counter to push.go (#18012) 2025-06-10 15:22:16 +00:00
Trevor Whitney
fd7321c88b feat: persist patterns as aggregated metrics (#17737)
Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>
2025-06-05 11:30:23 -06:00
Ed Welch
ad0bef31e7 chore: improve logging of push request streams (#17872)
Signed-off-by: Ed Welch <ed@edjusted.com>
Co-authored-by: Paul Rogers <129207811+paul1r@users.noreply.github.com>
2025-06-02 10:02:04 -04:00
aarogoss
2902964705 feat: adds User-Agent to distributor push logging (#17764) 2025-05-20 16:38:26 +00:00
Shantanu Alshi
6eab6dc5e8 chore(otel): Push a metric for Loki exporter (#17521) 2025-05-02 11:29:28 +05:30
Trevor Whitney
4b0aaaaf2e fix: hide __aggregated_metric__ in /series and /labels (#14677) 2025-04-24 17:08:09 -06:00
matthewhudsonedb
d70b20e37f fix(push): fix guard clauses to prevent error spam in logs (#17372) 2025-04-24 14:07:37 -06:00
Shantanu Alshi
f70dd18f82 chore(deps): Use updated prometheus/otlptranslate (#17227) 2025-04-15 15:28:59 +05:30
Karsten Jeschkies
75593e0ed7 refactor(stringlabels): Support stringlabels in loghttp, pattern and ruler tests. (#17102) 2025-04-11 07:41:52 +02:00
Owen Diehl
2aed4c3da5 fix(json, structured metadata): json-parsing cleanup (#17072) 2025-04-08 20:43:38 +00:00
Hristo Venev
9629d07c60 fix: Unescape JSON strucutred metadata string values (#13919) 2025-04-08 13:17:08 -07:00
Owen Diehl
cf272892e4 revert: "fix(json, structured metadata): correctly handle escaping in json parsing API" (#17071) 2025-04-08 20:12:28 +00:00
Owen Diehl
243b155ff3 fix(json, structured metadata): correctly handle escaping in json parsing API (#17068) 2025-04-08 12:52:15 -07:00
JordanRushing
9000de1aa7 fix(push): Add guard clauses to prevent negative counter values (#17056)
Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com>
Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>
2025-04-08 18:04:09 +00:00
aarogoss
7fc9026208 feat: Add agent IPs to distributor log (#17011)
Signed-off-by: aarogoss <32306622+aarogoss@users.noreply.github.com>
Co-authored-by: Ed Welch <edward.welch@grafana.com>
2025-04-02 16:38:48 -06:00
Periklis Tsirakidis
1d99f4d86d feat(distributor): Add MaxRecvMsgSize config for uncompressed message size limits (#16915) 2025-04-01 10:51:59 +02:00
JordanRushing
4029561088 fix: Exclude aggregated metric streams from usage trackers in loghttp/push (#16862)
Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com>
2025-03-24 12:06:25 -05:00
Shantanu Alshi
4d1f5a774d chore(otel): Allow log attributes to be promoted to labels (#16673) 2025-03-19 11:14:01 +05:30
Paul Rogers
27431b7e7e chore: Linting update for new golangci (#16572) 2025-03-05 14:10:21 -05:00
Dylan Guedes
ea13730e63 feat: Snapshopt stream overrides values on each request (#16523)
**What this PR does / why we need it**:
Caches a snapshot of resolved policies and retention temporarily to guarantee consistent results on the same request.
We evaluate retention and policies in a map when emitting some metrics so having policies or retention inconsistent along the chain for the same push request can cause us to miscalculate things or worse, interact with a nil map.
2025-03-04 16:17:46 -03:00
JordanRushing
6e6658fe46 perf: Improve push.RetentionPeriodToString() efficiency (#16252)
Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com>
2025-02-14 11:46:01 -06:00
Dylan Guedes
9a356a1260 feat: Account for policy when reporting seen resource and metadata labels (#16189) 2025-02-11 12:04:24 -03:00
Dylan Guedes
affedafa0d feat: Introduce policy to received_bytes (#16056)
**What this PR does / why we need it**:
Introduce the `policy` label to the received_bytes metric family to be able to distinguish between different policies ingestion.
2025-02-10 15:35:30 -03:00
Salva Corts
c2e1e88e85 feat(policies): Add PoliciesStreamMapping to loghttp limits interface (#16105) 2025-02-05 13:06:06 +00:00
Travis Patterson
f2bff201d7 fix: Determine when all logs have been filtered (#16073) 2025-02-03 14:13:21 -07:00
Sandeep Sukhani
ebc84caaaf chore: update usage tracker with received bytes on stream level instead of each log line (#15812) 2025-01-22 11:22:58 +05:30
Paul Rogers
f2c2a22bdc chore: Preparation for incoming static code analysis CI check (#15164)
Co-authored-by: Danny Cooper <danny.cooper@grafana.com>
2024-11-28 08:54:04 -05:00
Salva Corts
63a2442191 fix(otlp): Write protobuf status on error (#15097) 2024-11-26 09:04:23 +01:00
Matt Veitas
2d407bd308 feat: Add otlp attribute deployment.environment.name to list of default labels (#14747) 2024-11-18 11:21:16 -07:00
JordanRushing
71d4d6a8c6 fix: Keep the service_name label after discovery in push.ParseLokiRequest before calculating retention and passing to the usage tracker (#14960)
Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com>
2024-11-15 13:26:15 -06:00
Vladyslav Diachenko
a962edba33 feat(loki): include structured_metadata size while asserting rate limit (#14571)
Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>
2024-10-25 09:18:44 +03:00
Trevor Whitney
b5462b6639 chore: remove copied loop vars (#14383) 2024-10-04 10:38:36 -06:00
Trevor Whitney
7983f94b15 feat: detected field values (#14350) 2024-10-03 08:45:50 -06:00