Skip to content

Enable cd-test deployments for folder-collection service and api-services#2563

Merged
JacobWang-bc merged 59 commits intomasterfrom
dev
Mar 15, 2026
Merged

Enable cd-test deployments for folder-collection service and api-services#2563
JacobWang-bc merged 59 commits intomasterfrom
dev

Conversation

@Veerendrakak
Copy link
Collaborator

Summary

  • Enabled cd-test for folder-collection — deploys to 9b301c-test on push to master
  • Added api-services-cicd.yml — new GitHub Actions CI/CD workflow
  • Builds and pushes api image to OpenShift registry
  • Deploys to 9b301c-dev on push to dev or folder-collection branch
  • Deploys to 9b301c-test on push to master
  • Health check via port-forward since curl is not available in the container
  • Rollout timeout set to 600s with continue-on-error due to slow PVC attach times

Test Plan

  • Merge PR, verify cd-test triggers for both folder-collection service and api-services
  • Check folder-collection-service pod is Running in 9b301c-test
  • Check api-services pod is Running in 9b301c-test
  • Verify deployment report in GitHub Actions shows pod status, health check and recent logs for both services
  • Confirm no impact to 9b301c-dev — both services should remain healthy

Fosol and others added 30 commits August 28, 2025 10:50
Publish tno-core:1.0.21
Add DB migration 1.3.34
Publish tno-core:1.0.22
* Add FindByIdMinimal method to IUserService and UserService for optimized user retrieval

* use FindByIdMinimal to speed up

* improvement for adding content in existing reports

* simplify the content metadata and add functions that the subscriber has the lighter-weight content payload after insert

* remove checks on subscribers allowing to add content to someone else report

* restore changes for checking reports is public or not

* update tno-core package version

* reduce latency for adding content in report

* fix lint errors and build errors

* add missing files

* update

* update

* add missing files

* update addtoreportmenu to load minimal data

* update npm package version

* fix build error

* fix infinite regenerate report bug and others

* fixed bug

* fix the bug that causes the reports not showing up

* fix the loading report bug

* update

* fix the duplicated id

* fix build error

---------

Co-authored-by: Jacob Wang <jacob.wang@gov.bc.ca>
Update error handling
Add Serilog
Handle log level
* Add FindByIdMinimal method to IUserService and UserService for optimized user retrieval

* use FindByIdMinimal to speed up

* improvement for adding content in existing reports

* simplify the content metadata and add functions that the subscriber has the lighter-weight content payload after insert

* remove checks on subscribers allowing to add content to someone else report

* restore changes for checking reports is public or not

* update tno-core package version

* reduce latency for adding content in report

* fix lint errors and build errors

* add missing files

* update

* update

* add missing files

* update addtoreportmenu to load minimal data

* update npm package version

* fix build error

* fix infinite regenerate report bug and others

* fixed bug

* fix the bug that causes the reports not showing up

* fix the loading report bug

* update

* fix the duplicated id

* fix the report instance bug when adding content

---------

Co-authored-by: Jacob Wang <jacob.wang@gov.bc.ca>
* mmi-3349

* app/editor/yarn.lock

* Revert "mmi-3349"

This reverts commit ceabb6b.
…lphabet (#2516)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511)

* Update "shows & programs" dropdown list sort order

* update "shows & programs" dropdown sort order (#2513)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* MMI-3363: update "shows & programs" dropdown list sort order (#2514)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* use utility function to sort
* include IsOther for series and added () option

* include IsOther for series and added () option (#2511)

* Update "shows & programs" dropdown list sort order

* update "shows & programs" dropdown sort order (#2513)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* MMI-3363: update "shows & programs" dropdown list sort order (#2514)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* use utility function to sort

* MMI-3363 (#2517)

* MMI-3363: Update the "shows & programs" dropdown list sort order by alphabet  (#2516)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511)

* Update "shows & programs" dropdown list sort order

* update "shows & programs" dropdown sort order (#2513)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* MMI-3363: update "shows & programs" dropdown list sort order (#2514)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* use utility function to sort

* update "shows & program" value () returns null
* include IsOther for series and added () option

* include IsOther for series and added () option (#2511)

* Update "shows & programs" dropdown list sort order

* update "shows & programs" dropdown sort order (#2513)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* MMI-3363: update "shows & programs" dropdown list sort order (#2514)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* use utility function to sort

* update "shows & program" value () returns null

* MMI-3363 (#2517)

* MMI-3363: Update the "shows & programs" dropdown list sort order by alphabet  (#2516)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511)

* Update "shows & programs" dropdown list sort order

* update "shows & programs" dropdown sort order (#2513)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* MMI-3363: update "shows & programs" dropdown list sort order (#2514)

* include IsOther for series and added () option

* include IsOther for series and added () option (#2511) (#2512)

* Update "shows & programs" dropdown list sort order

* use utility function to sort

* update "shows & program" value () returns null

* update shows & program null value to be [NONE]

* resolve conflict

* update shows & program null value to be [NONE]
* MMi-3364 Enhance Charts
Publish tno-core:1.0.27
Fix build issue

* Update package to fix bug
* Add fileupload service config

* cron-job base

* Add kustomization files for fileupload service in dev, prod, and test overlays

* don't need securityContext

* change DAYS_BEFORE_END to 7 days and update image tags to 'latest' in production and test.

* Update cron job schedule to run daily at 3 AM UTC

* clean up patch
* added remove duplicate titles for the last 3 days

* update npm package

* fix editor bug

* fix editor build error

* add missing changes

* remove files and added missing files

* update logic if content with the same title already sent out, it will not send to subscribers again when the flag is on

* update
Fosol and others added 29 commits December 16, 2025 16:26
Replace DeploymentConfig with Deployment objects
Update DevOps Pipeline scripts and Tasks
Publish tno-core:1.0.31
Add DB migration 1.4.1
Add DevOps configs
Publish tno-core:1.0.30

Co-authored-by: AlessiaYChen <alessia.yanchen@gov.bc.ca>
…e headline format. Adjusted PublishedOn to reflect calculated clip time when available. (#2543)
* auto-clipper initial commit

* segment refine

* update segmentation and labels, added weather/traffic/ads labels

* add documents

* Update auto clipper
Add DevOps configs

* Publish tno-core:1.0.30

* Fix UI

* Fix build

* Debug

* Debug

* Fix config

* change to batch transcription and update prompt, heuristics,etc

* update prompt amd heuristics

* Add Auto Clipper Service
segment refine
update segmentation and labels, added weather/traffic/ads labels
add documents
Add DevOps configs
Publish tno-core:1.0.30

* add missing file

* update prompt for clip summary

* remove deleted files

* update

* update station file

* update title format

* update llm temprature

* update temperature

* add category in the title

---------

Co-authored-by: Jeremy Foster <jeremy.foster@fosol.ca>
Publish tno-core:1.0.32
Add DB migration 1.4.1
Fix linting
* update prompt

* update
* Update .gitignore to include additional media file types and output directories for auto-clipper harness

* Enhance .env.sample for Auto Clipper

* Add Video Indexer support to AutoClipper Harness

- Introduced VideoIndexerClient for handling video uploads and transcript extraction with speaker identification.
- Added VideoIndexerRequest class for configuring transcription requests.
- Enhanced Program.cs to support Azure Video Indexer as a provider, including error handling for output directory creation.
- Updated README.md with new configuration options and output details.
- Implemented TranscriptSegment for managing transcript segments with optional speaker identification.
- Improved transcript handling to include speaker labels when enabled.

* feat(auto-clipper): extend TimestampedTranscript with speaker info

* feat(auto-clipper): add Video Indexer configuration options

* feat(auto-clipper): implement Azure Video Indexer client

* feat(auto-clipper): integrate Video Indexer into transcription pipeline

* feat(auto-clipper): add speaker prefix to transcript output

* feat(auto-clipper): add CHAN station config with Video Indexer

* fix(auto-clipper): strip markdown code fences from LLM response

* feat(auto-clipper): update CHAN station config

* docs(auto-clipper): update README to reflect changes in transcription providers and configuration options

* feat(auto-clipper): add Azure Video Indexer configuration to deployment and overlays

* lint fix

* update readme

* docs(auto-clipper): enhance README with detailed API Key and ARM authentication instructions

* feat(auto-clipper): implement ARM authentication support for Azure Video Indexer

* feat(auto-clipper): add Azure Video Indexer secret keys to deployment and update README
* test case

* initial commit , pushing framework

* Added e2e test case for publish headline

* Updated documentation (README.md file)

* Handled user credentials with .env file

* Updated documentation

---------

Co-authored-by: deval jani <deval.jani@goa.ab.ca>
* updated folder-collection.yaml file in wokrflow

* updated on push folder-collection

* updated path

* updated folder-collection.yaml file in wokrflow

* updated on push folder-collection

* updated path

* Refactor logging in FolderCollectionManager to fix lint

* updated folder-collection-cicd.yml - removed CodeQL, disabled cd-dev, fixed pull_request paths

* folder-collection CI/CD: enable cd-test via GitHub Actions, comment out Tekton Pieplines

* fix: use --password-stdin for docker login in cd-dev and cd-test

* fix: add actions write permission and ZAP workspace chmod for OWASP scan

* fix: disable ZAP artifact upload

* fix: remove OWASP ZAP scan from folder-collection pipeline

* chore: trigger pipeline run for cd-test validation

* fix: remove unused actions:write permission

* fix: enable cd-dev and disable cd-test in folder-collection pipeline

* chore: trigger cd-dev piepline

* fix: update env variables and keep cd-test disabled

* fix: add deployment report block to cd-dev for health check visibility

* fix: filter running pod in deployment report health check

* fix: view access to dev namespace and timeout changed to 180 secs

* fix: update env variables

* fix: filter running pod in deployment report health check

* fix: use pod variable for recent logs in deployment report

* fix: add 30s wait before fetching logs in deployment report

* fix: suppress log fetch failure in deployment report

* fix: increase log wait time to 60s in deployment report

---------

Co-authored-by: Veerendra96-k <kveerendra6896@gmail.com>
Co-authored-by: Jacob Wang <jacob.wang@gov.bc.ca>
* test case

* initial commit , pushing framework

* Added e2e test case for publish headline

* Updated documentation (README.md file)

* Handled user credentials with .env file

* Updated documentation

* Resolved review comment by Aditya and automated share report flow

---------

Co-authored-by: deval jani <deval.jani@goa.ab.ca>
* React editor and subscriber pipelines

* ci: add `react-editor-subscriber` branch to trigger `react-editor` and `react-subscriber` workflows.

* added || github.ref == 'refs/heads/folder-collection' so CD-dev triggers

* Dockerfile

* Status badges

* badges

* badges

* Environment urls

* Job summary

---------

Co-authored-by: Rodrigo Barraza <265336200+rodrigo-barraza-gov@users.noreply.github.com>
* Automated Image upload and Unpublish e2e scenarios

* update gitignore

---------

Co-authored-by: Jacob Wang <jacob.wang@gov.bc.ca>
…ce (#2562)

* updated folder-collection.yaml file in wokrflow

* updated on push folder-collection

* updated path

* updated folder-collection.yaml file in wokrflow

* updated on push folder-collection

* updated path

* Refactor logging in FolderCollectionManager to fix lint

* updated folder-collection-cicd.yml - removed CodeQL, disabled cd-dev, fixed pull_request paths

* folder-collection CI/CD: enable cd-test via GitHub Actions, comment out Tekton Pieplines

* fix: use --password-stdin for docker login in cd-dev and cd-test

* fix: add actions write permission and ZAP workspace chmod for OWASP scan

* fix: disable ZAP artifact upload

* fix: remove OWASP ZAP scan from folder-collection pipeline

* chore: trigger pipeline run for cd-test validation

* fix: remove unused actions:write permission

* fix: enable cd-dev and disable cd-test in folder-collection pipeline

* chore: trigger cd-dev piepline

* fix: update env variables and keep cd-test disabled

* fix: add deployment report block to cd-dev for health check visibility

* fix: filter running pod in deployment report health check

* fix: view access to dev namespace and timeout changed to 180 secs

* fix: update env variables

* fix: filter running pod in deployment report health check

* fix: use pod variable for recent logs in deployment report

* fix: add 30s wait before fetching logs in deployment report

* fix: suppress log fetch failure in deployment report

* fix: increase log wait time to 60s in deployment report

* Add GitHub Actions CI/CD workflow for api-services

* fix:lint fix

* fix: Health check via port-forward since curl not in container

* fix: Increase Rollout Timeout and remove rollback step

* fix: Increase Rollout timeout to 600s and add continue-on-error

* fix: Enable cd-test and align deployment report for folder-collection

* fix: Enable cd-test for api-services

---------

Co-authored-by: Veerendra96-k <kveerendra6896@gmail.com>
Co-authored-by: Jacob Wang <jacob.wang@gov.bc.ca>
@JacobWang-bc JacobWang-bc merged commit 8534570 into master Mar 15, 2026
32 of 33 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants