1366 Commits

Author SHA1 Message Date
f6d3238505 CI: Fix race condition when building docker on main (#77504)
* build docker after packages are updated

* use my branch for main pipelines for testing

* use my branch for main pipelines for testing

* use main instead now

* formatting
2023-11-01 18:25:49 +02:00
5d5f8dfc52 Chore: Upgrade Go to 1.21.3 (#77304) 2023-11-01 09:17:38 -07:00
8a5d4c4c6e CI: Update RGM steps to use the artifacts command (#77470)
* update rgm steps to use artifacts subcmd

* format-drone

* make drone
2023-10-31 22:52:09 +02:00
75005a8482 Chore: Update to yarn 4 (#77156)
* update to yarn 4

* update project to yarn 4

* update tetherdrop archive

* update sdks

* change puppeteer image to official node 20 one

* revert previous, use grafana/docker-puppeteer:pre-node-20 instead

* okay, try original docker image, but use npx instead of yarn for wait-on

* remove wait-on from deps as we use it via npx now

* yarn dedupe

* remove logs from drone

* empty commit testing yarn cache :)

* comment explaining why no -y
2023-10-31 16:11:54 +02:00
d8d7a40d13 Use latest grafana/docs-base image (#77299)
* Use latest grafana/docs-base image

The pinned tag does not support recent shortcodes like `docs/public-preview`.

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

* Always pull the image

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

---------

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
2023-10-27 18:30:56 +01:00
aa9fc3be72 CI: Fix release-npm-packages action (#77127)
* Remove dependency of NpmReleaseAction to the git binary

* Switch to using the node image for the release-npm-packages step
2023-10-27 10:20:20 +03:00
9a0af13dbc Remove pr-swagger-gen dependency on clone-enterprise (#77217)
clone-enterprise step can fail in swagger-gen pipeline
2023-10-26 12:55:56 -04:00
69af9f9ad7 Chore: Update to node 20 (#76097)
* chore(node): update node version to 20

* chore(node): bump to 20.8.0, update drone variables

* chore(drone): update yaml config

* chore(yarn): bump yarn to latest to fix building binaries ERR_IMPORT_ASSERTION_TYPE_MISSING errors

* test(grafana-data): update whitespace in time formats for node 20 (18.13+)

* chore(node): move to LTS 20.8.1

* chore(node): bump to LTS 20.9.0
2023-10-26 09:34:50 +02:00
89f63dcddb Docs: fix broken link to moved content (#77147)
* Remove docs/reference shortcode for moved content

* Updated transformers content file

* Updated README.md to make Transformations section more prominent

* Updated index file to make super clear where you must update this content

* Added doc/ref back in with new format

* Removed bracket

* Added missing quotation marks

* Added reference style link and removed link from docs/ref shortcode

* Updated link

* Add warning to only use reference style links in content.ts

* ihm/251023-link-fix/ update scripts/docs/generate-transformations.ts with proposed changes, and build markdown

* ihm/251023-link-fix/ build docs

* Fix extraneous whitespace

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

* Add precheck for ONESHELL support

Otherwise the recipe doesn't work.

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

---------

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
Co-authored-by: jev forsberg <jev.forsberg@grafana.com>
Co-authored-by: Jack Baldry <jack.baldry@grafana.com>
2023-10-25 14:09:33 -04:00
bbcc81405b Chore: Add CI Pipeline to generate Grafana's OpenAPI specification (#75393)
* chore: move over initial changes from sofia's pr #58029

* chore: remove go_image

* chore: begin removing edition, remove unused imports

* chore: remove edition from swagger_gen.star and generate .drone.yml

* chore: regen drone.yml

* fix: fix order of load statements

* fix: try #2 fix order of load statements

* linter fixes

* chore: add doc comment explaining purpose of new clone_pr_branch step

* fix: add placeholder documentation for ver_mode arg

* attempt #1 to import and use clone_enterprise_step_pr

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* attempt #2 to import and use clone_enterprise_step_pr

* fix: fix drone lint err invalid or unknown step dependency

* fix: regen hmac to make drone run

* fix: fix drone lint err

* fix: update swagger-clean cmd in step

* attempt to return non zero exit code

* test to see if pipeline fails

* fix: add git to clone pr branch step

* fix: add git and make to swagger-gen step

* try to rerun drone

* debug: figure out why cannot find make swagger-clean

* debug: see if cd grafana/grafana fixes things

* debug: undo cd grafana/grafana

* debug: add more logging statements

* debug: try and remove cd grafana in swagger-gen

* debug: removed grafana after clone statement; add debug before cloning

* fix: remove disable clone

* regen specs to see if swagger-gen step passes now

* add descriptive error message to swagger-gen step

* remove api-spec.json from .gitignore

* revert backend change, regen spec

* add back backend change, regen specs

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* revert gitignore change, set enterprise source to drone source branch

* chore: remove unused variable, change committish var name to source

* testing functionality: make a new BE change without gen spec, pipeline should fail

* test functionality: does removing err msg cause step to fail properly

* test functionality: add back err msg and && after

* chore: remove debug statements from swagger gen step

* chore: remove debug lines from clone_pr_branch step

* test functionality: regen specs, swagger_gen step should pass

* test funcionality: regen specs again ????

* chore: update swagger-gen step err msg

* test functionality: make BE change dont regen spec, swagger gen should fail

* test functionality: regen the specs, swagger-gen should pass

* chore: revert test BE change, regen spec

* chore: remove unused clone step

* chore: regen drone.yml

---------

Co-authored-by: Timur Olzhabayev <timur.olzhabayev@grafana.com>
Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>
2023-10-24 13:01:04 -04:00
41db5b645c Transformations: Separate useful doc content for UI use (#75781)
* baldm0mma/doc_builder/ add to gitignore

* baldm0mma/doc_builder/ add makefile commands

* baldm0mma/doc_builder/ add content

* baldm0mma/doc_builder/ format content

* baldm0mma/doc_builder/ update makefile

* baldm0mma/docs_builder/ update content

* baldm0mma/doc_builder/ add back content

* baldm0mma/doc_builder/ run builder

* baldm0mma/doc_builder/ update naming

* baldm0mma/doc_builder/ remove unused note

* baldm0mma/doc_builder/ update template

* baldm0mma/doc_builder/ add new line in makefile

* baldm0mma/doc_builder/ rem new line

* baldm0mma/doc_builder/ add final line

* Much of this full PR was Co-Authored-By: Jack Baldry <jack.baldry@grafana.com>

* baldm0mma/doc_builder/ update readme

* baldm0mma/doc_builder/ update guidlines

* Update scripts/docs/generate-transformations.ts

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* Update scripts/docs/generate-transformations.ts

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* Update scripts/docs/generate-transformations.ts

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* Update scripts/docs/generate-transformations.ts

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* Update scripts/docs/generate-transformations.ts

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* Update docs/README.md

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* Update docs/README.md

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* Update scripts/docs/generate-transformations.ts

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* baldm0mma/doc_builder/ update concat

* baldmomma/doc_builder/ finish concat table

* baldm0mma/docs_builder/ update with suggestions

* baldm0mma/doc_builder/ update content to use getHelperDocs

* baldm0mma/doc_builder/ update calculateField

* baldm0mma/doc_builder/ update to byRefId

* baldm0mma/doc_builder/ update filterByValue

* baldm0mma/doc_builder/ update filterFieldsByName

* baldm0mma/doc_builder/ update formatTime

* baldm0mma/doc_builder/ update groupBy

* baldm0mma/doc_builder/ update groupingToMatrix

* baldm0mma/doc_update/ update heatmap

* baldm0mma/doc_builder/ update histogram

* baldm0mma/doc_builder/ update joinByField

* baldm0mma/doc_builder/ update joinByLabels

* baldm0mma/doc_builder/ update labelsToFields

* baldm0mma/doc_builder/ update limit

* baldm0mma/doc_builder/ update merge

* baldm0mma/doc_builder/ update organize

* baldm0mma/doc_builder/ update partitionByValues

* baldm0mma/doc_builder/ update prepareTimeSeries

* baldm0mma/doc_builder/ update reduce

* baldm0mma/doc_builder/ update renameByRegex

* baldm0mma/doc_builder/ update rowsToFields

* baldm0mma/doc_builder/ update seriesToRows

* baldm0mma/doc_builder/ update sortBy

* baldm0mma/doc_builder/ update spatial

* baldm0mma/doc_builder/ update timeSeriesTable

* baldm0mma/doc_builder/ rerender all

* baldm0mma/doc_builder/ update calculateField

* baldm0mma/doc_builder/ gitignore conflicts

* baldm0mma/doc_builder/ add formatString

* baldm0mma/doc_builder/ update vars

* baldm0mma/doc_builder/ update naming

* baldm0mma/doc_builder/ rerender markdown

* Update public/app/features/transformers/docs/content.ts

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>

* baldm0mma/doc_builder/ update content

* baldm0mma/doc_builder/ add to codeownders

* baldm0mma/doc_builder/ correct spelling

* baldm0mma/doc_builder/ update comment

---------

Co-authored-by: Isabel <76437239+imatwawana@users.noreply.github.com>
2023-10-24 10:30:10 -06:00
bd2b4e956b CI: rgm-package must wait for update-package-json-version in main pip… (#77022)
CI: rgm-package must wait for update-package-json-version in main pipeline
2023-10-24 11:52:14 +03:00
442e533803 CI: Rename scripts that build artifacts to use _build_ (#77005)
Rename scripts that build artifacts to use _build_
2023-10-23 20:14:12 -03:00
d29af5ec08 CI: Fix validate-npm-packages regex to work without version suffix (#76838)
Fix validate-npm-packages regex to work without suffix
2023-10-19 15:06:00 -05:00
24a14f3cd7 CI: Implement RGM pipeline parity between editions (#76283)
* Implement RGM pipeline parity between editions

* Use grafana/grafana-build:dev-11c8a20

* Use grafana/grafana-build:dev-261c863

* Use grafana/grafana-build:dev-2db3b18

* Switch nightly trigger for testing purposes

* Use grafana-dev api key for testing

* Use grafana/grafana-build:dev-d4d2e26

* Use grafana-dev api key

* Use production variables

* Revert nightly trigger to cron
2023-10-17 11:13:14 -03:00
7d9b2c73c7 Alerting: Use Mimir image to run integration tests for the remote Alertmanager (#76608)
* Alerting: Use Mimir image to run integration tests for the remote Alertmanager

* skip integration test when running all tests

* skipping integration test when no Alertmanager URL is provided

* fix bad host for mimir_backend

* remove basic auth testing until we have an nginx image in our CI
2023-10-17 12:21:45 +02:00
d28e365f74 Slack notifications: Remove CI changes notifications from the grafana-delivery channel (#76671)
Remove notification from the grafana-delivery channel
2023-10-17 12:12:02 +03:00
676877f882 Chore: Reduce flakiness of e2e tests caused by write contention in sqlite (#76659)
Reduce flakiness of e2e tests caused by write contention in sqlite

Write contention in sqlite on startup intermittently causes failed tests because
 of failed service runs. This can have various root causes, one example is
 dashboard provisioning:

Dashboard provisioning's frequent commits can cause other read transaction
 snapshots to invalidate and throw SQLITE_BUSY/SQLITE_BUSY_SNAPSHOT. If those
 failing transactions have a long length but not long enough to ensure all of
 the dashboards have finished provisioning it will run out of retries and fail
 entirely.

 This change helps indirectly reduce these write contentions by limiting the
 connection pool for e2e tests.

 As a bonus, having our e2e tests run using `max_open_conn = 2` means it acts
 as a guard against regressions that would affect certain internal instances
 that run with these settings.
2023-10-17 10:49:49 +03:00
faa22b8f20 CI: Remove 0.0.0-test tag event (#76662)
Remove 0.0.0-test tag event
2023-10-17 10:20:14 +03:00
157ea31b03 Build testdata frontend standalone (#75833) 2023-10-16 17:31:43 +02:00
d282b7a6f8 Grafana UI: Make it possible to bundle package with plugins (#76191)
* moved themecontext to data

* chore(grafana-ui): re-export ThemeContext from grafana/data for backwards compatibility

* Moved icon bundling to core.

* feat(plugins): share react-inlinesvg with plugins for grafana/ui bundling

* chore(codeowners): add generate-icon-bundle.js to file

* chore(storybook): update path to iconBundle file for theme

* feat(plugins): share i18n dependency via systemjs

* Make sure that icon bundle is initialized for tests.

* Removed comment.

* added tests for icon root.

* Removing the need of having an init variable.

* feat(grafana-ui): add icon svgs to bundle for projects that don't rely on grafana

---------

Co-authored-by: Marcus Andersson <marcus.andersson@grafana.com>
2023-10-13 14:11:41 +02:00
6b52bb9c27 Chore: Upgrade Go to 1.20.10 (#76359) 2023-10-11 16:49:24 +03:00
8d9ef716fe I18N: Collect stats on number of untranslated strings in message catalogues (#76272)
* I18N: Collect stats on number of untranslated strings in message catalogues

* eachLeaf -> eachMessage

* use __dirname
2023-10-11 12:26:39 +03:00
165b4c3f66 CI: Use production gcom api for nightly builds (#76201)
* Use production gcom api for nightly builds

* Use production package repositories

* Remove unused confusing env variable

* Comment out previous gcom nightly pipeline

* Remove unused grafana-com-nightly pipeline

* Remove unused import from cron.star
2023-10-09 12:55:15 -03:00
726260b2f6 CI: Add test Mimir backend image for integration tests (#76051)
* test mimir image drone

* add mimir service to services.star

* change name for mimir step

* change remote alertmanager step names, add commands for integration tests

* add  tag to mimir image
2023-10-05 15:09:26 -03:00
3b727eb96c CI: Use nightly-release cron for nightly releases (#76000)
Use nightly-release cron for nightly releases
2023-10-05 07:44:24 +02:00
55781b486c CI: Add nightly prerelease builds (#74119)
* Add nightly prerelease builds

* Fix duplicated pipeline names

* Fix misnamed dependencies

* Fix misnamed dependencies

* Fix string formatting

* Add option to specify bucket to RGM pipeline

* Fix trigger?

* Comment out cron triggers

* Fix windows bucket for nightly

* Fix versioning for windows and verify pipelines

* Use grafana/grafana-build:dev-209553c

* Fix version on windows steps

* Fix version on windows steps

* Fix windows .zip path

* Fix windows .zip path

* Remove windows builds from nightly for now

* Remove verify release pipeline from nightly

* Add docstring to rgm_release

* Revert changes to get_windows_steps

* Simplify changes to rgm.star

* Use grafana/grafana-build:dev-f5a15d4

* Add rgm copy step

* Use grafana/grafana-build:dev-d88be0f

* Fix destination variable

* Escape copy destination environment variable

* Add -r flag to rgm copy command

* Add dependency to rgm-copy step

* Add dist volume

* Use absolute path for dist volume

* Move dist folder to drone workspace

* Delegate drone workspace path to grafana-build

* Use grafana/grafana-build:dev-66149b8

* Lower folder depth

* Use grafana/grafana-build:dev-7355791

* Add rgm-nightly-publish pipeline

* Merge imports on rgm.star

* Fix rgm_copy to allow copying to local destination

* Use grafana/grafana-build:dev-36ec1e2

* Use grafana/grafana-build:dev-634d8dc

* Use grafana/grafana-build:dev-7a93728

* Use grafana/grafana-build:dev-5e36725

* Use grafana/grafana-build:dev-f5ebe1f

* Fix copy source for nightly builds

* Fix drone build number on rgm-copy step

* Use grafana/grafana-build:dev-637583f

* Use grafana/grafana-build:dev-f2cc524

* Allow tag trigger on grafana/grafana for testing

* Use grafana/grafana-build:dev-c71d4b7

* Use grafana/grafana-build:dev-63beac8

* Use grafana/grafana-build:dev-224a0dd

* Add environment variables for package publishing

* Revert unintentional change to dataquery.cue

* Add package publish step to nightly pipeline

* Use GCS path for package publish

* Pre-evaluate drone workspace on packages path

* Use hardcoded drone workspace path

* Remove unused env from publish packages step

* Use grafana/grafana-build:dev-657ea6a

* Use grafana/grafana-build:dev-1a9beec

* Use grafana/grafana-build:dev-f0053c8

* Use grafana/grafana-build:main

* Use grafana/grafana-build:dev-ae5182f

* Use grafana/grafana-build:dev-ec3ec36

* Use grafana/grafana-build:dev-5e160d8

* Use grafana/grafana-build:dev-142d2dc

* Use grafana/grafana-build:dev-db6bff1

* Use grafana/grafana-build:main

* Change nightly trigger to cron
2023-10-04 13:55:43 -03:00
9c295ea072 Add front matter that informs Hugo that the Grafana content is versioned (#74259)
This is necessary to allow version inference in CI builds.
Shortcodes like `docs/reference` and `docs/shared` use version inference to avoid the writer having to hardcode specific versions or use relative paths within the documentation set.

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
2023-10-03 09:14:06 +01:00
c08606d2c5 Bug: Exclude 32-bit arm builds (#75448)
* Exclude 32 bit arm builds

# Conflicts:
#	pkg/build/config/versions.go

* Bump grabpl - remove arm/v7 from build.star

# Conflicts:
#	.drone.yml
2023-09-29 12:33:01 -05:00
b0b2158dea Chore: Update ubuntu image to 22.04 (#70719) 2023-09-28 08:48:41 -05:00
1867fc5cee Arm: Exclude armv6/v7 from downstream builds only (#75465)
* Bump grabpl

* Disable armv6 and armv7 in downstream builds
2023-09-26 18:42:06 +03:00
95889b2e25 Tests: Add basic e2e tests for frontend plugin sandbox (#70759)
* Add initial e2e tests for sandboxing

* Add tests for sandbox on

* Add additional sandbox tests

* Move sandbox into various suite

* Test drone setup

* Move variable

* Update drone

* Update plugins path for e2e

* Revert drone changes

* use drone from main

* Use lib.star from main

* Move sandbox test to its own suite

* Expand methods to inject iframes

* Restore e2e script

* Add back change to script

* Update tests for trusted types

* Integrate custom plugins into grafana-server

* Echo for deubging

* add debugging message

* Expand message

* Add extra for ci

* fix path

* Improve start-server logic

* Remove duplicated logic

* Restore file deleted by mistake

* Restore file to main
p

* restore file

* Restore start script

* Update e2e/panels-suite/frontend-sandbox-panel.spec.ts

Co-authored-by: Levente Balogh <balogh.levente.hu@gmail.com>

---------

Co-authored-by: Levente Balogh <balogh.levente.hu@gmail.com>
2023-09-26 10:58:47 +02:00
9532ff3799 Chore: Split OSS and Enterprise OAPI Spec Generation (#75133)
* chore: implement sofia makefile changes from #62456

* chore: clean up makefile and generate specs

* docs: update command to delete old specs

* fix: regenerate specs with enterprise linked

* chore: implement review comments

* Update Makefile

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* chore: update make command in drone step

* chore: update bingo, fix makefile indentation error, regen specs

* fix: revert .bingo/README changes to make prettier happy

* chore: add BEP as owners of api-enterprise-spec.json

* chore: rerun drone

---------

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>
2023-09-25 15:34:57 -04:00
f46b78ec38 CI: Remove pre from npm canary packages (#75376)
Remove pre from npm canary packages
2023-09-25 18:01:17 +03:00
24a1f12826 Chore: Add new drone step to validate OpenAPI specification (#75034)
* chore: add new drone step to validate openapi specification

* fix: update make before running make command
2023-09-20 11:46:15 -04:00
49ff1b9060 CI: Fix bump version step (#75047)
needs brackets
2023-09-19 01:37:32 +03:00
c7ef496750 CI: Add a step on main pipelines to temporarily update the package.json v… (#75018)
* Add a step on main pipelines to temporarily update the package.json version to include the build number
2023-09-18 18:53:42 -03:00
85abf2bebd Chore: Upgrade Alpine base image to 3.18.3 (#74984) 2023-09-18 12:44:04 +03:00
39dbd98458 Chore: Upgrade Go to 1.20.8 (#74978)
chore: Update to Go 1.20.8
2023-09-18 11:29:50 +03:00
1ee485ac43 CI: Fix npm canary release (#74915)
Install bash on this step
2023-09-14 16:59:34 +03:00
84d35e9f0b CI: Fix frontend-metrics-step (attempt #1) (#74838)
* use grafana/public instead

* parameterise script (still need to fix + run drone locally)

* make drone

---------

Co-authored-by: Ashley Harrison <ashley.harrison@grafana.com>
2023-09-14 14:48:31 +01:00
ad13663e74 CI: Don't run tag builds in grafana/grafana (#74850)
* Don't run tag builds in grafana/grafana

* remove unused code
2023-09-13 10:49:20 -05:00
fcdae0ca0b Chore: move to cypress 13.1 (#74718)
* move to cypress 13.1

* update cloud-data-sources docker image
Co-authored-by: Ashley Harrison <ashley.harrison@grafana.com>
2023-09-13 11:08:43 +01:00
49165d35ad Chore: Remove unused secret enterprise2-cdn-path (#74741)
Remove unused secret

# Conflicts:
#	.drone.yml
2023-09-13 10:35:51 +03:00
69737cba6d CI: Fixes for various main steps (#74768)
Fixes for various main steps
2023-09-13 00:44:33 +03:00
3d50a6c87f CI fix docker image format in PRs (#74766)
* fix docker image format
2023-09-12 22:02:32 +03:00
d2154387d8 This moves the ubuntu:22.10 image to 22.04 (which is available until… (#74757)
This moves the ubuntu:22.10 image to 22.04 (which is avaailable until april 2027)
2023-09-12 20:59:02 +03:00
9221822dfe CI: fix docker tag format on main branch and missing dependency on ci-frontend-metrics.sh (#74753)
* On main, set the docker tag format to be the same as it is in PRs

* Install bash when trying to push frontend metrics
2023-09-12 19:05:02 +03:00
915f198ecb Refactor starlark to remove references to the build_image (#74624)
* Refactor starlark to remove references to the build_image
2023-09-12 12:19:06 -03:00
02f617a20d Nightlies: Push windows artifacts to GCS on main builds (#74709)
* Push windows artifacts to gcs

* Lint starlark

* Sign drone
2023-09-12 13:28:32 +03:00