Commit Graph

218 Commits

Author SHA1 Message Date
Matthias Oesterheld
9641bbf1b2 Use OS java client in data node (#25134)
* start migration

* fix cluster/node metrics and test

* fix OpensearchProcessImplTest

* avoid problems with null values

* fix node query

* await async response

* fix type

* code cleanup, removal of plain json api

---------

Co-authored-by: Tomas Dvorak <tomas.dvorak@graylog.com>
2026-03-02 12:35:23 +01:00
Matthias Oesterheld
1868e3242e Small data node fixes (#25067)
* make state machine tracer less chatty

* fix Argument list too long error on MacOS builds
2026-02-23 09:21:15 +01:00
Tomas Dvorak
c2a796a330 update opensearch and its plugins to 2.19.4 (#24630)
* update opensearch and its plugins to 2.19.4

* Added changelog

---------

Co-authored-by: Matthias Oesterheld <33032967+moesterheld@users.noreply.github.com>
2026-02-18 12:11:48 +01:00
github-actions[bot]
082f21e234 [graylog2-server] prepare for next development iteration 2026-01-26 12:07:21 +00:00
github-actions[bot]
7d047f6483 [graylog2-server] prepare release 7.1.0-alpha.2 2026-01-26 12:07:12 +00:00
dependabot[bot]
08a9b219ac Bump org.codehaus.mojo:buildnumber-maven-plugin from 3.2.1 to 3.3.0 (#24827)
Bumps [org.codehaus.mojo:buildnumber-maven-plugin](https://github.com/mojohaus/buildnumber-maven-plugin) from 3.2.1 to 3.3.0.
- [Release notes](https://github.com/mojohaus/buildnumber-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/buildnumber-maven-plugin/compare/3.2.1...buildnumber-maven-plugin-3.3.0)

---
updated-dependencies:
- dependency-name: org.codehaus.mojo:buildnumber-maven-plugin
  dependency-version: 3.3.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-26 10:58:45 +01:00
Tomas Dvorak
7b4725cb0d Add support for azure blob storage to datanode (#24567)
* Add support for azure blob storage to datanode

* Added changelog

* fixed hdfs plugin for aarch64
2025-12-17 09:23:51 +01:00
Othello Maurer
e23c8d579e Move management for exec-maven-plugin to parent (#24496) 2025-12-11 10:51:30 +01:00
Tomas Dvorak
83a1cdf557 Documentation augmentation (#24508)
* removal of classes that went to Jadconfig
adding new steps to the server package

* adding missing license

* adding the config descriptions from server.conf to the annotations

* adding the config descriptions from server.conf to the annotations

* Update feature-flag.config

* jadconfig 1.0.0

* setting a valid default for the node id file in tests

* fixing dependency

* fix validation + fix test

* fixing test

* fixing test

* fix directories

* fix test

* fix test

* fix test

* fix test

* adding missing doc annotations

* merge master & fix missing doc annotation

* Adapt section headings for documentation

* Removed documentation test (will be replaced by annotation processor)

---------

Co-authored-by: Jan Heise <jan.heise@graylog.com>
2025-12-10 16:29:01 +01:00
Jan Heise
6553cf2adf Revert "Using the Documentation Annotations for Server (#23862)" (#24418)
This reverts commit ad1ee1292b.
2025-12-02 17:07:01 +01:00
Jan Heise
ad1ee1292b Using the Documentation Annotations for Server (#23862)
* removal of classes that went to Jadconfig
adding new steps to the server package

* adding missing license

* adding the config descriptions from server.conf to the annotations

* adding the config descriptions from server.conf to the annotations

* Update feature-flag.config

* jadconfig 1.0.0

* setting a valid default for the node id file in tests

* fixing dependency

* fix validation + fix test

* fixing test

* fixing test

* fix directories

* fix test

* fix test

* fix test

* fix test

* adding missing doc annotations

* merge master & fix missing doc annotation

* Adapt section headings for documentation

---------

Co-authored-by: Tomas Dvorak <tomas.dvorak@graylog.com>
2025-12-02 13:04:47 +01:00
github-actions[bot]
c6ca5cb002 [graylog2-server] prepare for next development iteration 2025-12-01 13:04:26 +00:00
github-actions[bot]
a9355313df [graylog2-server] prepare release 7.1.0-alpha.1 2025-12-01 13:04:18 +00:00
github-actions[bot]
4e677e082a [graylog2-server] prepare for next development iteration 2025-12-01 12:30:39 +00:00
github-actions[bot]
f70e34c5ae [graylog2-server] prepare release 7.1.0-alpha.1 2025-12-01 12:30:30 +00:00
dependabot[bot]
490d0bafa8 Bump org.codehaus.mojo:exec-maven-plugin from 3.6.1 to 3.6.2 (#23970)
Bumps [org.codehaus.mojo:exec-maven-plugin](https://github.com/mojohaus/exec-maven-plugin) from 3.6.1 to 3.6.2.
- [Release notes](https://github.com/mojohaus/exec-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/exec-maven-plugin/compare/3.6.1...3.6.2)

---
updated-dependencies:
- dependency-name: org.codehaus.mojo:exec-maven-plugin
  dependency-version: 3.6.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Bernd Ahlers <bernd@users.noreply.github.com>
2025-10-21 10:46:30 +02:00
github-actions[bot]
7c66020f7a Bump to 7.1.0-SNAPSHOT 2025-10-20 12:54:36 +00:00
Jenkins
606ea53d37 [graylog2-server] prepare for next development iteration 2025-10-20 14:12:12 +02:00
Jenkins
664203b735 [graylog2-server] prepare release 7.0.0-rc.1 2025-10-20 13:53:28 +02:00
Bernd Ahlers
f48396ab1a Revert version to 7.0.0-SNAPSHOT 2025-10-20 13:33:10 +02:00
Jenkins
567ccbf7f8 [graylog2-server] prepare release 7.0.0-rc.1 2025-10-20 13:23:27 +02:00
Jenkins
2e72d3daac [graylog2-server] prepare for next development iteration 2025-10-15 14:01:59 +02:00
Jenkins
932e50d47f [graylog2-server] prepare release 7.0.0-beta.5 2025-10-15 13:43:12 +02:00
Jenkins
e0164a4046 [graylog2-server] prepare for next development iteration 2025-10-13 13:39:03 +02:00
Jenkins
959028630d [graylog2-server] prepare release 7.0.0-beta.4 2025-10-13 13:20:31 +02:00
dependabot[bot]
c0f7fcf4b9 Bump org.codehaus.mojo:exec-maven-plugin from 3.6.0 to 3.6.1 (#23834)
Bumps [org.codehaus.mojo:exec-maven-plugin](https://github.com/mojohaus/exec-maven-plugin) from 3.6.0 to 3.6.1.
- [Release notes](https://github.com/mojohaus/exec-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/exec-maven-plugin/compare/3.6.0...3.6.1)

---
updated-dependencies:
- dependency-name: org.codehaus.mojo:exec-maven-plugin
  dependency-version: 3.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-07 09:14:51 +02:00
Jenkins
6e28df8e51 [graylog2-server] prepare for next development iteration 2025-10-06 13:43:45 +02:00
Jenkins
6ed62f74cc [graylog2-server] prepare release 7.0.0-beta.3 2025-10-06 13:25:08 +02:00
dependabot[bot]
c1e855f99b Bump org.codehaus.mojo:exec-maven-plugin from 3.5.1 to 3.6.0 (#23802)
Bumps [org.codehaus.mojo:exec-maven-plugin](https://github.com/mojohaus/exec-maven-plugin) from 3.5.1 to 3.6.0.
- [Release notes](https://github.com/mojohaus/exec-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/exec-maven-plugin/compare/3.5.1...3.6.0)

---
updated-dependencies:
- dependency-name: org.codehaus.mojo:exec-maven-plugin
  dependency-version: 3.6.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-01 10:33:28 +02:00
Jenkins
30e4ecee45 [graylog2-server] prepare for next development iteration 2025-09-29 13:47:08 +02:00
Jenkins
2c473b49b9 [graylog2-server] prepare release 7.0.0-beta.2 2025-09-29 13:28:29 +02:00
Bernd Ahlers
3a5cf77ae7 Revert "Use cached OpenSearch artifacts for Data Node (#23714)" (#23732)
Doesn't help with the issues and makes downloads from non-EU locations
slow.

This reverts commit a131508022.
2025-09-23 09:20:27 +02:00
Jenkins
3484057624 [graylog2-server] prepare for next development iteration 2025-09-22 14:12:05 +02:00
Jenkins
e611aacff3 [graylog2-server] prepare release 7.0.0-beta.1 2025-09-22 13:53:23 +02:00
Bernd Ahlers
a131508022 Use cached OpenSearch artifacts for Data Node (#23714)
We run into frequent DNS resolution errors for artifacts.opensearch.org.
2025-09-22 11:34:51 +02:00
Bernd Ahlers
28a7b6691d Remove WithBeanGetter annotation (#23551)
* Replace WithBeanGetterTest with AutoValueValidatorTest

We want to ensure that auto-value adds the validation annotations to the
generated class fields.

* Remove all WithBeanGetter annotation usages

- Fix classes where the constructor became private because of the
  builder usage
- Fix wrong "$AutoValue" references

* Remove auto-value-javabean dependency

* Restore InputCreateRequest#create method

* Revert some JsonSeserialize conversions

The changes introduced a breaking change in InputCreateRequest, so we
play safe for now.

* Remove JsonDeserialize from ShardRouting

* Convert CreateEntityRequest to a POJO to fix validation issues

* Check that CreateEntityRequest#title is not null

* Fix botched merge

* Explicitly set JsonProperty names to fix parsing issue

* Remove unused files

* Use explicit values for JsonProperty annotations

Removing the WithBeanGetter annotation resulted in some de/serialization
errors. We prevent those by using explicit annotation values.

* Fix wrong property name

* Add PMD rule to check for missing values in JsonProperty annotations

* Remove newly introduced WithBeanGetter usages

* Add missing license header

* Fix "$AutoValue_*" usage
2025-09-18 18:03:52 +02:00
Matthias Oesterheld
d7a0cf4fee Bump OpenSearch to 2.19.3 (#21537)
* use os 2.19.0-rc4 in data node

* use 2.18.0 version of repository-s3 plugin

* fix s3 plugin version

* use repository-s3 from build

* remove expired certificates from data node truststore

* use ga release

* disable system indices temporarily because replicas are not set correctly in single-node installations (see https://github.com/opensearch-project/security/issues/4739)

* remove query-insights plugin

* do not use shaded lucene classes to avoid running into UnsupportedOperationException - if the singleton getter is not called from known Lucene classes in the lucene `VectorizationProvider` called by `DirectoryReader#open`

* use OS 2.19.0 shaded clients

* use patched repository-s3 (see
https://github.com/opensearch-project/OpenSearch/issues/17363)

* add lucene-backward-codecs

* use OS 2.19.1

* update to 2.19.3

* correct testcontainers version

* change order of deleting os plugins

* temporarily use 2.19.2

* temporarily use 2.19.2

* switch back to 2.19.3, temporarily disable remote reindexing it

* Changelog

* update containermatrix os server to 2.19.3

* adjust hdfs plugin hash

* Better error message in test

* add more verbose failure message

* change default_number_of_indices for test OS

* add setting only for 2.19.3

---------

Co-authored-by: Tomas Dvorak <tomas.dvorak@graylog.com>
2025-09-18 15:22:28 +02:00
Tomas Dvorak
8ff655a801 Install repository-hdfs plugin in datanode (#23507)
* Install repository-hdfs plugin in datanode/opensearch

* fixed sha for hdfs download

* Added HdfsRepositoryConfiguration and support for snapshots in datanode config

* added changelog

* fixed changelog

* fixed typo
2025-09-04 16:55:37 +02:00
Jenkins
9cfd72871a [graylog2-server] prepare for next development iteration 2025-08-29 13:16:04 +02:00
Jenkins
d59c56b2c1 [graylog2-server] prepare release 7.0.0-alpha.2 2025-08-29 12:57:02 +02:00
Bernd Ahlers
5dc5cc8740 Update to Java 21 (#22908)
* Remove maven.compiler.* properties from plugin archetype

They are already defined in org.graylog:graylog-parent

* Maven: update java compiler version from 17 to 21

* Update java in Github workflows

* Fix deprecated usage of URL constructor

* Fix deprecated usage of Thread#id

* Catch IllegalArgumentException when URLs are not absolute

* Remove PMD plugin for lack of java 21 support

* Update to Java 21

* Inherig compiler source/target settings from parent

* Use Java 21 in test containers

* Fix URL deprecation error for Java 21

* Setup Mockito Java Agent for surefire

See "Explicitly setting up instrumentation for inline mocking (Java 21+)"
at https://javadoc.io/doc/org.mockito/mockito-core/latest/org.mockito/org/mockito/Mockito.html#0.3

* Switch dependency plugin to test phase and fix argLine

* Get dependency properties in test-compile phase

* Add changelog entry and adjust UPGRADING.md

---------

Co-authored-by: Othello Maurer <othello@graylog.com>
2025-08-18 12:42:27 +02:00
Jenkins
4fc979053f [graylog2-server] prepare for next development iteration 2025-07-28 13:48:14 +02:00
Jenkins
dac42698ec [graylog2-server] prepare release 7.0.0-alpha.1 2025-07-28 13:28:19 +02:00
Matthias Oesterheld
d8f447e492 Download and use static jdk for OpenSearch with data node on Mac (#22993)
* download and use static jdk for os with data node on mac

* move opensearch java home resolution for mac to OpensearchDistribution

---------

Co-authored-by: Tomas Dvorak <tomas.dvorak@graylog.com>
2025-06-30 10:40:05 +02:00
github-actions[bot]
17468be528 Bump to 7.0.0-SNAPSHOT 2025-06-16 12:12:52 +00:00
Jenkins
84e794377f [graylog2-server] prepare for next development iteration 2025-06-16 13:46:08 +02:00
Jenkins
a4d383c613 [graylog2-server] prepare release 6.3.0-rc.1 2025-06-16 13:28:04 +02:00
Jenkins
cca9396e0d [graylog2-server] prepare for next development iteration 2025-06-10 13:39:16 +02:00
Jenkins
000fdd91d0 [graylog2-server] prepare release 6.3.0-beta.5 2025-06-10 13:19:38 +02:00
dependabot[bot]
28693ea083 Bump org.codehaus.mojo:build-helper-maven-plugin from 3.6.0 to 3.6.1 (#22797)
Bumps [org.codehaus.mojo:build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 3.6.0 to 3.6.1.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/3.6.0...3.6.1)

---
updated-dependencies:
- dependency-name: org.codehaus.mojo:build-helper-maven-plugin
  dependency-version: 3.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-05 07:08:13 +02:00