10 Commits

Author SHA1 Message Date
2a51fb42bf Distributor: Loki API can receive gzipped JSON (#3291)
* Push API recognize HTTP header "Content-Encoding: gzip" and upload gzipped JSON

* Fix documentation mistake
2021-02-05 10:21:53 -05:00
2afebbc064 Add config endpoint (#3228)
* Add config route

Signed-off-by: Michel Hollands <michel.hollands@grafana.com>

* Add documentation

Signed-off-by: Michel Hollands <michel.hollands@grafana.com>
2021-01-26 05:05:37 -05:00
54d1d3bea7 [doc] fix:querier do not handle "/flush" api (#3165) 2021-01-15 11:52:11 -05:00
6dc8bee9b0 ingester/shutdown -> ingester/flush_shutdown (#3146) 2021-01-08 10:25:38 -05:00
ee9c629f51 wal docs (#3026) 2021-01-04 09:55:55 -05:00
4d9865acd4 Adds WAL support (experimental) (#2981)
* marshalable chunks

* wal record types custom serialization

* proto types for wal checkpoints

* byteswith output unaffected by buffer

* wal & record pool ifcs

* wal record can hold entries from multiple series

* entry pool

* ingester uses noopWal

* removes duplicate argument passing in ingester code. adds ingester config validation & derives chunk encoding.

* segment writing

* [WIP] wal recovery from segments

* replay uses sync.Maps & preserves WAL fingerprints

* in memory wal recovery

* wal segment recovery

* ingester metrics struct

* wal replay locks streamsMtx in instances, adds checkpoint codec

* ingester metrics

* checkpointer

* WAL checkpoint writer

* checkpointwriter can write multiple checkpoints

* reorgs checkpointing

* wires up checkpointwriter to wal

* ingester SeriesIter impl

* wires up ingesterRecoverer to consume checkpoints

* generic recovery fn

* generic recovery fn

* recover from both wal types

* cleans up old tmp checkpoints & allows aborting in flight checkpoints

* wires up wal checkpointing

* more granular wal logging

* fixes off by 1 wal truncation & removes double logging

* adds userID to wal records correctly

* wire chunk encoding tests

* more granular wal metrics

* checkpoint encoding test

* ignores debug bins

* segment replay ignores out of orders

* fixes bug between WAL reading []byte validity and proto unmarshalling refs

* conf validations, removes comments

* flush on shutdown config

* POST /ingester/shutdown

* renames flush on shutdown

* wal & checkpoint use same segment size

* writes entries to wal regardless of tailers

* makes wal checkpoing duration default to 5m

* recovery metrics

* encodes headchunks separately for wal purposes

* merge upstream

* linting

* addresses pr feedback

uses entry pool in stream push/tailer

removes unnecessary pool interaction

checkpointbytes comment

fillchunk helper, record resetting in tests via pool

redundant comment

defers wg done in recovery

s/num/count/

checkpoint wal uses a logger

encodeWithTypeHeader now creates its own []byte

removes pool from decodeEntries

wal stop can error

* prevent shared access bug with tailers and entry pool

* removes stream push entry pool optimization
2020-11-27 09:42:58 -05:00
25e13254f0 fixes path in prom rules api docs (#2750) 2020-10-12 09:24:11 -04:00
0d64d2d912 fixes ruler docs & includes ruler configs in cmd/configs + docker img (#2657) 2020-09-22 15:46:30 -04:00
6f8bfe0c79 Ruler docs + single binary inclusion (#2637)
* starts alerting docs

* ruler in single binary

* make docs interactive

* alerting docs

* ruler prom alerts endpoint

* Apply suggestions from code review

Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>

* doc fixes

* capitalize ruler

* removes double spaces

* Update docs/sources/alerting/_index.md

Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Ed Welch <ed@oqqer.com>
Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>

Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>
Co-authored-by: Ed Welch <ed@oqqer.com>
2020-09-22 09:34:46 -04:00
5a8bc848db Sync docs to website (#2378)
* update docs location

* add workflow

* update docs content

* update content

* cleanup
2020-07-21 17:53:48 +02:00