feat: add make target for local kind cluster setup. by crstrn13 · Pull Request #887 · Kuadrant/testsuite

crstrn13 · 2026-03-11T13:07:56Z

Description

Add comprehensive make local-setup command for one-step local Kuadrant environment creation using Kind
Implement modular Makefile structure with conditional tool deployment and configurable gateway providers
Add support for optional AWS credentials and Red Hat registry authentication
Configure Kuadrant operator with optimized service timeouts for faster test execution

Changes

New Makefile Structure

Split monolithic Makefile into modular components under make/ directory:
- make/vars.mk - Centralized configuration variables with sensible defaults
- make/kind.mk - Kind cluster management (create, delete)
- make/dependencies.mk - Infrastructure dependencies (metrics-server, MetalLB, Gateway API, cert-manager)
- make/istio.mk - Istio gateway provider installation
- make/envoygateway.mk - EnvoyGateway provider installation
- make/kuadrant.mk - Kuadrant operator deployment and configuration
- make/tools.mk - Testing tools deployment (Keycloak, Mockserver, etc.)
- make/local-setup.mk - Main local setup orchestration

Local Setup Features

One-command setup: make local-setup creates complete environment
Gateway provider selection: Choose between Istio or EnvoyGateway via GATEWAYAPI_PROVIDER variable
Conditional tool deployment: Testing tools only deployed if Red Hat registry credentials provided
Conditional AWS secret: DNS credentials secret only created if AWS vars provided
Self-signed ClusterIssuer: Automatically created for TLS testing
MetalLB support: Enables LoadBalancer services in Kind cluster

Kuadrant Operator Configuration

Environment variable patching: New patch-kuadrant-operator-env target merges custom env vars with Helm defaults
Service timeout optimization: Default timeouts set to 1000ms for faster test execution
- AUTH_SERVICE_TIMEOUT=1000ms
- RATELIMIT_SERVICE_TIMEOUT=1000ms
- RATELIMIT_CHECK_SERVICE_TIMEOUT=1000ms
- RATELIMIT_REPORT_SERVICE_TIMEOUT=1000ms
Proper env var merging: Uses jq to merge with existing env vars (preserves OPERATOR_NAMESPACE, RELATED_IMAGE_*, etc.)

Documentation

Comprehensive README section for local setup
Prerequisites and quick start guide
Environment variable documentation
Red Hat registry credential instructions
AWS credentials configuration for DNS testing

Configuration

All configuration is centralized in make/vars.mk:

# Override any variable
GATEWAYAPI_PROVIDER ?= istio  # or envoygateway
KUADRANT_OPERATOR_VERSION ?= latest
KUADRANT_OPERATOR_ENV_VARS ?= AUTH_SERVICE_TIMEOUT=1000ms,...

# Optional credentials
RH_REGISTRY_USERNAME ?=
RH_REGISTRY_PASSWORD ?=
AWS_ACCESS_KEY_ID ?=
AWS_SECRET_ACCESS_KEY ?=

Usage

# Quick setup with defaults (Istio)
make local-setup

# Use EnvoyGateway instead
GATEWAYAPI_PROVIDER=envoygateway make local-setup

# With credentials for full testing capabilities
RH_REGISTRY_USERNAME=user RH_REGISTRY_PASSWORD=pass make local-setup

# Custom operator image
KUADRANT_OPERATOR_IMAGE=quay.io/user/kuadrant:dev make local-setup

# Cleanup
make local-cleanup

Breaking Changes

None - this is purely additive functionality. Existing workflows are unchanged.

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

crstrn13 · 2026-03-11T13:10:21Z

closes #859

make/dependencies.mk

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

silvi-t · 2026-03-13T09:49:53Z

I think it would be nice to have a gitignored file where we can store the env variables needed for local setup (AWS credentials, RH registry credentials, etc.) so setting up the testing environment is easier and we don't have to export them manually each time.

make/envoygateway.mk

make/kuadrant.mk

make/vars.mk

silvi-t · 2026-03-13T12:49:55Z

I ran into an issue with the kubeconfig setup when running tests against the Kind cluster. The testsuite requires kubeconfig_path in settings.local.yaml, but Kind writes its config to a separate file and the default
~/.kube/config may not contain the Kind context. I had to manually run kind get kubeconfig --name kuadrant-local > /tmp/kind-kubeconfig and point the settings there. It might be worth having make local-setup handle this
automatically. Not sure if this is specific to my setup or if others would hit the same issue.

crstrn13 · 2026-03-13T16:01:03Z

@silvi-t kind should add the context to the default kubeconfig, i.e ~/.kube/config. By default, if you don't provide a kubeconfig_path in the config it will use the default location. You might need to change the context after instalaltion to use the local kind one.

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

azgabur

Future work: Add tracing, Add multicluster kind setup

make clean is not working due to missing crd's, the make clean can be refactored

The .PHONY target is used multiple times, can you check its not overriding itself each time

azgabur · 2026-03-16T14:33:46Z

README.md

+# Optional: Red Hat registry credentials (for testing tools like Keycloak)
+# (if not provided, tools won't be deployed but core functionality will work)
+export RH_REGISTRY_USERNAME=<your-username>
+export RH_REGISTRY_PASSWORD=<your-token>


Not needed if Kuadrant/helm-charts-olm#77 merged

azgabur · 2026-03-16T14:34:53Z

README.md

+# Optional: AWS credentials for DNS testing
+# (if not provided, the secret won't be created and DNS tests will be skipped)
+export AWS_ACCESS_KEY_ID=<your-aws-key>
+export AWS_SECRET_ACCESS_KEY=<your-aws-secret>
+export AWS_REGION=us-east-1
+export AWS_BASE_DOMAIN=test.example.com


Maybe take additionalManifests.yaml used in helm-olm to create needed secrets.

that one is not actually populated with any secrets. The installation will not fail if these are not available, one could create the secret by himself with the help of the 'additionalManifest' as well. In CI, we can have this vars set in the secrets of the repository.

azgabur · 2026-03-16T14:38:24Z

make/vars.mk

+# Kuadrant Operator environment variables
+# Default: Service timeouts for faster test execution
+# Override with your own: KUADRANT_OPERATOR_ENV_VARS="LOG_LEVEL=debug,..."
+KUADRANT_OPERATOR_ENV_VARS ?= AUTH_SERVICE_TIMEOUT=1000ms,RATELIMIT_SERVICE_TIMEOUT=1000ms,RATELIMIT_CHECK_SERVICE_TIMEOUT=1000ms,RATELIMIT_REPORT_SERVICE_TIMEOUT=1000ms


Maybe also add the DNS tls values for dnstls tests, and metrics endpints if needed
https://github.com/Kuadrant/helm-charts-olm/blob/main/charts/kuadrant-operators/templates/kuadrant/06-subscription.yaml

azgabur · 2026-03-16T14:40:46Z

Makefile


+# Include local environment setup modules
+# Load variables first, then all other modules
+include ./make/vars.mk


Not needed because of the following line

this is importing the vars first as the other make files need it as well. One the next line is actually importing all the other make files, except this one.

azgabur · 2026-03-16T14:41:19Z

Makefile

+# Include local environment setup modules
+# Load variables first, then all other modules
+include ./make/vars.mk
+include $(filter-out ./make/vars.mk,$(wildcard ./make/*.mk))


Here is the make/vars.mk two times if I understand the wildcard corrently

this is importing the vars first as the other make files need it as well. One the next line is actually importing all the other make files, except this one.

azgabur · 2026-03-16T15:16:07Z

make/kuadrant.mk

+		helm install kuadrant-operator kuadrant/kuadrant-operator --create-namespace --namespace $(KUADRANT_NAMESPACE), \
+		helm install kuadrant-operator kuadrant/kuadrant-operator --version $(KUADRANT_OPERATOR_VERSION) --create-namespace --namespace $(KUADRANT_NAMESPACE))


Add --wait

azgabur · 2026-03-16T15:26:10Z

make/kuadrant.mk

+		'metadata:' \
+		'  name: kuadrant-sample' \
+		'  namespace: $(KUADRANT_NAMESPACE)' \
+		'spec: {}' \


In the future lets add observability and tracing
https://github.com/Kuadrant/helm-charts-olm/blob/main/charts/kuadrant-instances/templates/kuadrant/01-kuadrant.yaml

will create issue for this

azgabur · 2026-03-16T15:28:21Z

make/kuadrant.mk

+endif
+
+.PHONY: deploy-kuadrant-operator-local
+deploy-kuadrant-operator-local: ## Deploy Kuadrant Operator from local build/image


If this is the OLM install, it wont work on Kind, rather remove it and just use kuadrant helm chart

removed, added component mode.

azgabur · 2026-03-16T15:29:35Z

make/local-setup.mk

+	$(MAKE) create-cluster-issuer
+	$(MAKE) $(GATEWAYAPI_PROVIDER)-install
+	$(MAKE) create-test-namespaces
+	$(MAKE) create-aws-credentials


Can be replaced with "apply additionalManifests" to also add other secrets needed

reworked to do additionalManifests.

azgabur · 2026-03-16T15:33:29Z

make/tools.mk

+		helm repo update; \
+		helm install \
+			--set=tools.keycloak.keycloakProvider=deployment \
+			--set=tools.coredns.enable=false \


This disable doesnt need to be here, coredns can be installed in kind

set to true, instead

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

crstrn13 added 8 commits March 9, 2026 18:06

feat: make local-setup.

eb0e6a6

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: cosmetic changes.

8c98821

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: add cluster issuer.

012081e

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: add cluster issuer.

87e6693

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: added aws creds secret creation for dns.

2b0c1da

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: cosmetic changes.

375cb51

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

feat: added env patch for kuadrant-operator.

e4efe50

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: env patch on kuadrant-operator.

5599247

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

crstrn13 requested review from averevki, azgabur, emmaaroche, silvi-t and trepel March 11, 2026 13:07

crstrn13 self-assigned this Mar 11, 2026

emmaaroche reviewed Mar 11, 2026

View reviewed changes

make/dependencies.mk Outdated Show resolved Hide resolved

fix: cosmetic changes.

5e9f6ea

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

emmaaroche reviewed Mar 13, 2026

View reviewed changes

make/envoygateway.mk Outdated Show resolved Hide resolved

make/kuadrant.mk Show resolved Hide resolved

make/vars.mk Show resolved Hide resolved

fix: cosmetic changes.

4c34a39

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

crstrn13 requested a review from emmaaroche March 13, 2026 16:34

crstrn13 added 2 commits March 13, 2026 17:59

revert: istio versions - 1.27 causes restart

6ff7840

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

docs: document macOS limitation.

40ad4f3

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

azgabur reviewed Mar 16, 2026

View reviewed changes

crstrn13 added 3 commits March 17, 2026 11:31

fix: added component mode.

d5de51c

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: component mode vars.

56e0adb

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

fix: install prometheus crds for make clean.

f69cd27

Signed-off-by: Alexander Cristurean <acristur@redhat.com>

crstrn13 requested a review from azgabur March 17, 2026 11:13

		helm install kuadrant-operator kuadrant/kuadrant-operator --create-namespace --namespace $(KUADRANT_NAMESPACE), \
		helm install kuadrant-operator kuadrant/kuadrant-operator --version $(KUADRANT_OPERATOR_VERSION) --create-namespace --namespace $(KUADRANT_NAMESPACE))

Conversation

crstrn13 commented Mar 11, 2026

Description

Changes

New Makefile Structure

Local Setup Features

Kuadrant Operator Configuration

Documentation

Configuration

Uh oh!

crstrn13 commented Mar 11, 2026

Uh oh!

Uh oh!

silvi-t commented Mar 13, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

silvi-t commented Mar 13, 2026

Uh oh!

crstrn13 commented Mar 13, 2026

Uh oh!

azgabur left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

crstrn13 Mar 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

crstrn13 Mar 17, 2026 •

edited

Loading