f4ee58db50
unified-storage: split resource index client ( #106297 )
...
* split resource server and index server grpc connection if defined in config
2025-06-27 08:15:52 -04:00
0982cfd9a0
Unified Storage/Search: Add max count config for indexing ( #107255 )
...
* Add max count config for indexing
* Build empty index when max count is exceeded
* Address linting
* Refactor buildIndexes
* Add test for max count threshold
* Update test doc comments
* Refactor TestBuildIndexes_MaxCountThreshold to not use mock framework
* Rename mocks used in TestBuildIndexes_MaxCountThreshold
* Refactor mockResourceIndex
* Test setting of indexing threshold configs
* Tweak comments, log
* Fix logging in buildEmptyIndex
* Export and reuse TestDocumentBuilderSupplier
* Reuse MockResourceIndex
2025-06-27 14:00:39 +02:00
b2aaa9b3ce
kvstore: ensure we return notFound on delete ( #107288 )
...
* kvstore: ensure we return notFound on delete
* fix tests
2025-06-27 12:00:03 +02:00
2e9559a376
Include resource name in the event. ( #107185 )
2025-06-27 09:29:49 +00:00
53ec379af8
unistore: add metadata store ( #107151 )
...
* Add datastore
* too many slashes
* lint
* add metadata store
* simplify meta
* Add datastore
* too many slashes
* lint
* pr comments
* extract ParseKey
* readcloser
* remove get prefix
* use dedicated keys
* parsekey
* sameresource
* unrelated
* name
* renmae tests
* fix tests
* lint
* allow empty ns
* get keys instead of list
* rename the functions
* refactor yield candidate
2025-06-27 08:25:27 +00:00
dc79e6f3dc
unified-storage: fix auth handling in distributor ( #106062 )
...
* disable auth handling in the distributor
2025-06-26 12:32:59 -04:00
2297417374
Unistore: Add datastore ( #107137 )
...
* Add datastore
* too many slashes
* lint
* pr comments
* extract ParseKey
2025-06-26 10:36:31 +02:00
79fe8a9902
Library Panels: Modify connection api endpoint to be compatible with unified storage ( #107088 )
2025-06-25 22:21:56 +00:00
eeb01126b3
grpc: wrapContext should not replace existing metadata, but append to it. ( #107126 )
...
* grpc: wrapContext should not replace existing metadata, but append to it.
* Add test for wrapContext if there's no previous metadata.
* Rename encodeIdentityInMetadata to encodeIdentityInMetadataPairs
2025-06-25 08:06:45 +00:00
580b410e8c
DualWriter: Minor cleanup ( #107028 )
2025-06-25 07:41:51 +00:00
5150ebfba8
unistore: index search references ( #106954 )
2025-06-24 14:54:07 -05:00
53cb80e58c
Unistore: save should use a Reader not ReadCloser ( #107128 )
...
* save should use a Reader not ReadCloser
* save should use a Reader not ReadCloser
2025-06-24 15:37:22 +00:00
27a5bab1c1
unistore: Add kvstore interface ( #107094 )
...
* Add kvstore interface
* add owner
* go lint
* remove comment
* update comment
* remove GetOptions
* add sortorder unspecified
* nit
* nit
* nit
* move txn
* use io.reader
* use io.reader
* change again the default order + comments
* change again the default order + comments
* use readcloser for Save
2025-06-24 15:50:57 +02:00
6e5056e1be
Add tracing to bulk process. ( #107047 )
...
Add logging to bulk process.
2025-06-24 09:45:32 +01:00
9062d88ea0
unistore: filter trash requests ( #106767 )
...
* deleted by user
* use the correct checker
* add tests
* refactor
2025-06-24 10:17:34 +02:00
63bc65fa4c
Dashboards: Fix history list for dashboard uids that end in - ( #107073 )
2025-06-22 06:56:45 -06:00
945bc53b4c
DualWrite: Manage values from KV store (not file) ( #106772 )
2025-06-18 10:37:44 +03:00
b48337a7c8
feat: introduce ttl cache for bleve indices ( #106842 )
2025-06-17 16:28:51 +02:00
dbe815ee68
SecretsManager: keepers with secure values credentials ( #106761 )
...
* SecretsManager: keepers with secure values
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
* Keepers: Refactor extract secure values remove extra helper functions
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
---------
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
2025-06-16 14:37:36 +01:00
6097841e67
SecretsManager: add secure value store ( #106708 )
...
* SecretsManager: add secure value model and sql templates
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
* SecretsManager: secure value rest layer to use store
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
* SecretsManager: temporary add actor prefix to decrypters
* Remove list securevalue by namefor now
---------
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
2025-06-16 10:19:44 +01:00
5f21f320f7
fix(unified-storage): use continue token containing both formats for dualwriter ( #106525 )
2025-06-13 15:59:46 +02:00
5135d5c87d
Unified storage: Reconstruct index in the background every 24h ( #106422 )
2025-06-12 14:34:48 -05:00
de28231f2f
SecretsManager: Add outbox store ( #106613 )
...
SecretsManager: add outbox store
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
2025-06-12 13:31:48 +01:00
c22b4845bb
SecretsManager: Add encrypted value store ( #106607 )
...
* SecretsManager: add encrypted value store
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
* SecretsManager: wiring of encrypted value store
---------
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
2025-06-12 11:52:01 +01:00
7864c1660f
K8s: Get trash fixes ( #106411 )
2025-06-11 13:54:38 -05:00
1196d66c5e
feat(unified-storage): log continue token on error ( #106475 )
2025-06-10 16:41:39 +02:00
1a216a8fff
feat(unified-storage): use logger from context for dualwriter ( #106473 )
2025-06-10 15:33:14 +02:00
6fb0ed9886
Bump tempo to 20250529124718-87c2dc380cec ( #106220 )
...
* Bump tempo to 20250529124718-87c2dc380cec
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
* Add owners to pkg/build
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
* update workspace
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
* update pkg/build/go.sum
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
* update pkg/build/go.sum
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
---------
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
2025-05-29 23:43:13 -05:00
ab99211b40
Dashboard Provisioning: Reduce db load ( #106114 )
2025-05-29 09:39:07 +03:00
4519ef8d21
chore(unified-storage): increase background request timeout ( #106186 )
2025-05-28 22:59:28 +02:00
d4c446f42c
Chore: Update k8s.io to v0.33.1 ( #105307 )
2025-05-28 00:13:18 +03:00
9ba031364b
fix(unified-storage): use batching for index creation ( #106034 )
2025-05-27 09:48:39 +02:00
326081cdb7
Chore: Remove unified storage go modules ( #106035 )
2025-05-27 09:49:21 +03:00
814707152d
chore(unified-storage): contextualize the index build logger ( #106025 )
2025-05-26 21:33:51 +02:00
5401175562
SecretsManager: Conditionally lock DB before migrations using config setting ( #106003 )
...
Secrets: Conditionally lock DB before migrations using config setting (#105949 )
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
2025-05-26 18:28:53 +01:00
04d39cbbc6
unistore: split ListIterator and ListHistory in StorageBackend ( #105654 )
...
split listIterator from ListHistory
2025-05-23 15:00:18 +02:00
392c1a71c9
Storage: Take migration_locking setting into account ( #105938 )
2025-05-23 14:11:21 +02:00
c4d3eb1cd0
Remove support for Google Spanner database. ( #105846 )
...
* Remove support for Google Spanner database.
2025-05-23 11:35:59 +02:00
eb8f3bc071
fix(unified-storage): wait for result to be available ( #105922 )
2025-05-23 11:03:01 +02:00
e57be36936
fix(unified-storage): race in resource server watch ( #105786 )
2025-05-23 09:19:20 +02:00
95eabcf03d
refactor(unified-storage): rename cache to avoid import conflicts ( #105831 )
2025-05-22 17:12:31 +02:00
7f2923d4ed
SecretsManager: Introduce keeper store ( #105557 )
...
* SecretsManager: Introduce secret database wrapper
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
* SecretsManager: Introduce db migrator with keeper table
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
* SecretsManager: Introduce keeper store
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
* new line
* without query listByNameSecureValue
* remove unused extractSecureValues for now
* SecretsManager: Add keeper integration tests
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Dana Axinte <53751979+dana-axinte@users.noreply.github.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
---------
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
2025-05-22 14:26:47 +01:00
1dd59ca599
DualWriter: remove RV+UID for secondary update ( #105543 )
2025-05-21 18:25:40 +00:00
6e5e133f7d
SecretsManager: Introduce db migrator with keeper table ( #105538 )
...
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
2025-05-21 15:02:51 +01:00
a13fe75de8
refactor(unified-storage): set the GUID in the resource server ( #105683 )
2025-05-21 09:49:49 +02:00
13f4cf162e
CI: move grafana-build into pkg/build ( #105640 )
...
* move grafana-build into pkg/build
2025-05-20 10:48:00 -05:00
38de0cac3a
Chore: Replace usages of golang.org/x/net/context with stdlib context package ( #105676 )
2025-05-20 14:59:40 +02:00
3d1eac754b
unified-storage: distributor instructions and fix race condition ( #105630 )
...
* update unified storage README with instructions on how to run the distributor locally and fix race condition causing the server to crash on startup randomly
2025-05-20 14:46:33 +03:00
a7922912fe
SecretsManager: Introduce secrets database wrapper ( #105472 )
...
SecretsManager: Introduce secret database wrapper
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com>
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
2025-05-20 11:48:47 +01:00
91882cf50e
chore(unified-storage): add tracing for unified storage folder implementation ( #105601 )
2025-05-19 23:25:08 +03:00
