Skip to content

Gitlab pipeline for End to End and parametric scenarios (WIP)#6651

Draft
nccatoni wants to merge 131 commits into
mainfrom
nccatoni/gitlab
Draft

Gitlab pipeline for End to End and parametric scenarios (WIP)#6651
nccatoni wants to merge 131 commits into
mainfrom
nccatoni/gitlab

Conversation

@nccatoni
Copy link
Copy Markdown
Collaborator

Motivation

Changes

Workflow

  1. ⚠️ Create your PR as draft ⚠️
  2. Work on you PR until the CI passes
  3. Mark it as ready for review
    • Test logic is modified? -> Get a review from RFC owner.
    • Framework is modified, or non obvious usage of it -> get a review from R&P team

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

Reviewer checklist

  • Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
  • A docker base image is modified?
    • the relevant build-XXX-image label is present
  • A scenario is added, removed or renamed?

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 31, 2026

CODEOWNERS have been resolved as:

docs/CI/gitlab-pipeline-merge.md                                        @DataDog/system-tests-core
utils/ci/gitlab/build_pipeline.py                                       @DataDog/system-tests-core
utils/ci/gitlab/docker/git.Dockerfile                                   @DataDog/system-tests-core
utils/ci/gitlab/docker/system-tests.Dockerfile                          @DataDog/system-tests-core
utils/ci/gitlab/main.yml                                                @DataDog/system-tests-core
utils/ci/gitlab/section.sh                                              @DataDog/system-tests-core
utils/ci/gitlab/ssi.yml                                                 @DataDog/system-tests-core
utils/ci/gitlab/system-tests.yml                                        @DataDog/system-tests-core
utils/ci/gitlab/templates.yml                                           @DataDog/system-tests-core
utils/scripts/ci_orchestrators/generate_wrapper_pipeline.py             @DataDog/system-tests-core
.gitlab-ci.yml                                                          @DataDog/system-tests-core
requirements.txt                                                        @DataDog/system-tests-core
utils/scripts/ci_orchestrators/gitlab_exporter.py                       @DataDog/system-tests-core
utils/scripts/ci_orchestrators/workflow_data.py                         @DataDog/system-tests-core
utils/scripts/compute-workflow-parameters.py                            @DataDog/system-tests-core
utils/scripts/compute_libraries_and_scenarios.py                        @DataDog/system-tests-core

@nccatoni nccatoni force-pushed the nccatoni/gitlab branch 6 times, most recently from 17e7dfc to 047676e Compare March 31, 2026 15:41
@datadog-datadog-prod-us1
Copy link
Copy Markdown

datadog-datadog-prod-us1 Bot commented Mar 31, 2026

Pipelines

Fix all issues with BitsAI

⚠️ Warnings

🚦 4 Pipeline jobs failed

Testing the test | Test the test   View in Datadog   GitHub Actions

🔧 Fix in code (Fix with Cursor). 1 failed test. Assertion Error: expected list elements differ: 'libraries=""' != 'scenarios="DEFAULT"' at tests/test_the_test/test_compute_libraries_and_scenarios.py:386

Testing the test | all-jobs-are-green   View in Datadog   GitHub Actions

🔧 Fix in code (Fix with Cursor). Multiple CI checks failed including test and lint checks.

Testing the test | lint / lint   View in Datadog   GitHub Actions

🔧 Fix in code (Fix with Cursor). Lint fails due to invalid syntax in argument parser. Missing closing parenthesis on line where '--skip-header' is defined.

View all 4 failed jobs.

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 82bf0c7 | Docs | Datadog PR Page | Give us feedback!

@nccatoni nccatoni force-pushed the nccatoni/gitlab branch 6 times, most recently from c7fe9a2 to ad45877 Compare April 1, 2026 09:45
@nccatoni nccatoni force-pushed the nccatoni/gitlab branch 2 times, most recently from 9384467 to ed748cf Compare April 1, 2026 10:46
nccatoni added 11 commits May 28, 2026 11:48
…o-end pipeline

The original .gitlab-ci.yml (consumed by tracer repos via one-pipeline) is
fully restored from origin/main. The new end-to-end pipeline is appended as
a separate YAML document with rules:  == 'push', so it
only runs on direct pushes to the system-tests repo and never on child
pipelines triggered by tracer repos (which get parent_pipeline).
…o-end pipeline

The original .gitlab-ci.yml (consumed by tracer repos via one-pipeline) is
fully restored from origin/main. The end-to-end pipeline jobs are appended
with rules: if: $CI_PIPELINE_SOURCE == 'push', so they only run on direct
pushes to the system-tests repo and never on child pipelines triggered by
tracer repos (which get parent_pipeline).
…o-end pipeline

The original .gitlab-ci.yml (consumed by tracer repos via one-pipeline) is
fully restored from origin/main. The end-to-end pipeline is included from
utils/ci/gitlab/main.yml with only_on_push: true, so all its jobs only run
on direct pushes to the system-tests repo and never on child pipelines
triggered by tracer repos (which get parent_pipeline).

build_ci_image is defined directly in .gitlab-ci.yml with push rules as it
is needed by resolve_ci_image from the included main.yml component.
…o-end pipeline

The original .gitlab-ci.yml (consumed by tracer repos via one-pipeline) is
fully restored from origin/main. The end-to-end pipeline is included from
utils/ci/gitlab/main.yml with only_on_push: true, so all its jobs only run
on direct pushes to the system-tests repo and never on child pipelines
triggered by tracer repos (which get parent_pipeline).

build_ci_image is defined directly in .gitlab-ci.yml with push rules as it
is needed by resolve_ci_image from the included main.yml component.
…o-end pipeline

The original .gitlab-ci.yml (consumed by tracer repos via one-pipeline) is
fully restored from origin/main. The end-to-end pipeline is included from
utils/ci/gitlab/main.yml. A SYSTEM_TESTS_E2E_ENABLED variable gates the e2e
jobs, and build_ci_image has a direct push rule, so the e2e pipeline only
runs on direct pushes to the system-tests repo and never on child pipelines
triggered by tracer repos (which get parent_pipeline).
…o-end pipeline

The original .gitlab-ci.yml (consumed by tracer repos via one-pipeline) is
fully restored from origin/main. The end-to-end pipeline is included from
utils/ci/gitlab/main.yml. Jobs in main.yml have rules gated on the
SYSTEM_TESTS_E2E_ENABLED variable (set by .gitlab-ci.yml on push), and
build_ci_image has a direct push rule — so the e2e pipeline only runs on
system-tests repo pushes. All artifact needs are optional to avoid
pipeline creation failures when jobs are excluded by rules.
@nccatoni nccatoni force-pushed the nccatoni/gitlab branch 6 times, most recently from 4d11a67 to ff8e7f2 Compare May 29, 2026 15:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant