Cyril Tovena 0be64fcb34 Improve metric queries by computing samples at the edges. (#2293) ...

* First pass breaking the code appart.

Wondering how we're going to achieve fast mutation of labels.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Work in progress.

I realize I need hash for deduping lines.
going to benchmark somes.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Tested some hash and decided which one to use.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Wip

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Starting working on ingester.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Trying to find a better hash function.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* More hash testing we have a winner. xxhash it is.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Settle on xxhash

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Better params interfacing.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Add interface for queryparams for things that exist in both type of params.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Add storage sample iterator implementations.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fixing tests and verifying we don't get collions for the hashing method.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fixing ingesters tests and refactoring utility function/tests.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fixing and testing that stats are still well computed.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fixing more tests.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* More engine tests finished.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fixes sharding evaluator.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fixes more engine tests.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fix error tests in the engine.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Finish fixing all tests.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fixes a bug where extractor was not passed in correctly.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Add notes about upgrade.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Renamed and fix a bug.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Add memchunk tests and starting test for sampleIterator.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Test heap sample iterator.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* working on test.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Finishing testing all new iterators.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Making sure all store functions are tested.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Benchmark and verify everything is working well.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Make the linter happy.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* use xxhash v2.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* Fix a flaky test because of map.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

* go.mod.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>

Co-authored-by: Edward Welch <edward.welch@grafana.com>

2020-07-11 18:22:19 -04:00

..

testdata.go

Improve metric queries by computing samples at the edges. (#2293)

2020-07-11 18:22:19 -04:00