filebeat.tests.system.test_registrar.Test test_rotating_file

[v1v]

Flaky Test

• Test Name: test_rotating_file
• Scope: filebeat.tests.system.test_registrar.Test
• File: filebeat/tests/system/test_registrar.py
• Location: filebeat/tests/system/test_registrar.py:279
• Buildkite Link: https://buildkite.com/organizations/elastic/analytics/suites/beats/tests/27a1995b-5f24-8948-a4ee-5ded6269370d
• Flaky Instances: 8
• Latest Occurrence: 2026-04-01T07:45:00.320Z

Details

{
  "id": "27a1995b-5f24-8948-a4ee-5ded6269370d",
  "web_url": "https://buildkite.com/organizations/elastic/analytics/suites/beats/tests/27a1995b-5f24-8948-a4ee-5ded6269370d",
  "scope": "filebeat.tests.system.test_registrar.Test",
  "name": "test_rotating_file",
  "location": "filebeat/tests/system/test_registrar.py:279",
  "file_name": "filebeat/tests/system/test_registrar.py",
  "instances": 8,
  "latest_occurrence_at": "2026-04-01T07:45:00.320Z",
  "most_recent_instance_at": "2026-04-01T07:45:00.320Z",
  "last_resolved_at": null,
  "ownership_team_ids": [],
  "failure_examples": [
    {
      "message": "{'backtrace': ['self = <test_registrar.Test testMethod=test_rotating_file>', '', \"    @unittest.skipIf(platform.system() == 'Darwin' or os.name == 'nt',\", \"                     'Flaky test: https://github.com/elastic/beats/issues/26378')\", '    def test_rotating_file(self):', '        \"\"\"', '        Checks that the registry is properly updated after a file is rotated', '        \"\"\"', '        self.render_config_template(', '            path=os.path.abspath(self.working_dir) + \"/log/*\",', '            close_inactive=\"1s\"', '        )', '    ', '        os.mkdir(self.working_dir + \"/log/\")', '        testfile_path = self.working_dir + \"/log/test.log\"', '    ', '        filebeat = self.start_beat()', '    ', \"        with open(testfile_path, 'w') as testfile:\", '            testfile.write(\"offset 9\\\\n\")', '    ', '        self.wait_until(lambda: self.output_has(lines=1),', '                        max_timeout=10)', '    ', '        testfilerenamed = self.working_dir + \"/log/test.1.log\"', '        os.rename(testfile_path, testfilerenamed)', '    ', \"        with open(testfile_path, 'w') as testfile:\", '            testfile.write(\"offset 10\\\\n\")', '    ', '        self.wait_until(lambda: self.output_has(lines=2),', '                        max_timeout=10)', '    ', '        # Wait until rotation is detected', '>       self.wait_until(', '            lambda: self.log_contains(', '                \"Updating state for renamed file\"),', '            max_timeout=10)', '', 'tests/system/test_registrar.py:312: ', '_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ', '', 'self = <test_registrar.Test testMethod=test_rotating_file>, cond = <function Test.test_rotating_file.<locals>.<lambda> at 0x7c609c835f70>, max_timeout = 10', \"poll_interval = 0.1, name = 'cond', err_msg = ''\", '', '    def wait_until(self, cond, max_timeout=20, poll_interval=0.1, name=\"cond\", err_msg=\"\"):', '        \"\"\"', '        TODO: this can probably be a \"wait_until_output_count\", among other things, since that could actually use `self`, and this can become an internal function', '        Waits until the cond function returns true,', '        or until the max_timeout is reached. Calls the cond', '        function every poll_interval seconds.', '    ', '        If the max_timeout is reached before cond() returns', '        true, an exception is raised.', '        \"\"\"', '        start = datetime.now()', '        while not cond():', '            if datetime.now() - start > timedelta(seconds=max_timeout):', '                print(\"Test has failed, here are the Beat logs\")', '                if self.output_lines() == 0:', '                    print(\"\\\\n\\\\nBeat had no output file\")', '                else:', '                    print(\"\\\\n\\\\nHere is the beat\\'s output file:\")', '                    for entry in self.read_output():', '                        print(entry)', '>               raise WaitTimeoutError(', '                    f\"Timeout waiting for condition \\'{name}\\'. Waited {max_timeout} seconds: {err_msg}\")', \"E               beat.beat.WaitTimeoutError: Timeout waiting for condition 'cond'. Waited 10 seconds:\", '', '../libbeat/tests/system/beat/beat.py:453: WaitTimeoutError'], 'expanded': [\"beat.beat.WaitTimeoutError: Timeout waiting for condition 'cond'. Waited 10 seconds:\"]}",
      "run_url": "https://api.buildkite.com/v2/analytics/organizations/elastic/suites/beats/runs/a1d07ab0-5cd2-8273-b75d-48e6b690371b",
      "run_time": "2026-04-01T07:32:08.595Z"
    }
  ]
}

Failure Examples

Example 1:
Run: https://api.buildkite.com/v2/analytics/organizations/elastic/suites/beats/runs/a1d07ab0-5cd2-8273-b75d-48e6b690371b
Time: 2026-04-01T07:32:08.595Z

{'backtrace': ['self = <test_registrar.Test testMethod=test_rotating_file>', '', "    @unittest.skipIf(platform.system() == 'Darwin' or os.name == 'nt',", "                     'Flaky test: https://github.com/elastic/beats/issues/26378')", '    def test_rotating_file(self):', '        """', '        Checks that the registry is properly updated after a file is rotated', '        """', '        self.render_config_template(', '            path=os.path.abspath(self.working_dir) + "/log/*",', '            close_inactive="1s"', '        )', '    ', '        os.mkdir(self.working_dir + "/log/")', '        testfile_path = self.working_dir + "/log/test.log"', '    ', '        filebeat = self.start_beat()', '    ', "        with open(testfile_path, 'w') as testfile:", '            testfile.write("offset 9\\n")', '    ', '        self.wait_until(lambda: self.output_has(lines=1),', '                        max_timeout=10)', '    ', '        testfilerenamed = self.working_dir + "/log/test.1.log"', '        os.rename(testfile_path, testfilerenamed)', '    ', "        with open(testfile_path, 'w') as testfile:", '            testfile.write("offset 10\\n")', '    ', '        self.wait_until(lambda: self.output_has(lines=2),', '                        max_timeout=10)', '    ', '        # Wait until rotation is detected', '>       self.wait_until(', '            lambda: self.log_contains(', '                "Updating state for renamed file"),', '            max_timeout=10)', '', 'tests/system/test_registrar.py:312: ', '_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ', '', 'self = <test_registrar.Test testMethod=test_rotating_file>, cond = <function Test.test_rotating_file.<locals>.<lambda> at 0x7c609c835f70>, max_timeout = 10', "poll_interval = 0.1, name = 'cond', err_msg = ''", '', '    def wait_until(self, cond, max_timeout=20, poll_interval=0.1, name="cond", err_msg=""):', '        """', '        TODO: this can probably be a "wait_until_output_count", among other things, since that could actually use `self`, and this can become an internal function', '        Waits until the cond function returns true,', '        or until the max_timeout is reached. Calls the cond', '        function every poll_interval seconds.', '    ', '        If the max_timeout is reached before cond() returns', '        true, an exception is raised.', '        """', '        start = datetime.now()', '        while not cond():', '            if datetime.now() - start > timedelta(seconds=max_timeout):', '                print("Test has failed, here are the Beat logs")', '                if self.output_lines() == 0:', '                    print("\\n\\nBeat had no output file")', '                else:', '                    print("\\n\\nHere is the beat\'s output file:")', '                    for entry in self.read_output():', '                        print(entry)', '>               raise WaitTimeoutError(', '                    f"Timeout waiting for condition \'{name}\'. Waited {max_timeout} seconds: {err_msg}")', "E               beat.beat.WaitTimeoutError: Timeout waiting for condition 'cond'. Waited 10 seconds:", '', '../libbeat/tests/system/beat/beat.py:453: WaitTimeoutError'], 'expanded': ["beat.beat.WaitTimeoutError: Timeout waiting for condition 'cond'. Waited 10 seconds:"]}

[github-actions]

3 related issues

• filebeat.tests.system.test_registrar.Test test_rotating_file #863 — same test scope, file location, and failure signature; it includes a timeout while waiting for renamed-file state update, which helps compare recurrence patterns.
• filebeat.tests.system.test_registrar.Test test_rotating_file #861 — same test scope and location with matching flaky behavior from the same analytics suite, useful as immediate historical context.
• [FLAKY TEST] filebeat.tests.system.test_registrar.Test test_rotating_file #857 — same test in the same scope; prior handling there can help assess whether this is a continuing recurrence.

Note

🔒 Integrity filtering filtered 1 item

Integrity filtering activated and filtered the following item during workflow execution.
This happens when a tool call accesses a resource that does not meet the required integrity or secrecy level of the workflow.

• issue:filebeat.tests.system.test_registrar.Test test_rotating_file #867 (issue_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".)

---

What is this? | From workflow: Observability Agentic Workflow Entrypoint

Give us feedback! React with 🚀 if perfect, 👍 if helpful, 👎 if not.

[github-actions]

This issue appears to be an automation-generated flaky-test report for an external test (elastic/beats), not a bug in oblt-actions; recommend routing to Beats ownership and treating repeated re-openings as expected behavior of current dedup logic.

Recommendation

Route #867 to Filebeat/Beats test owners and keep this issue only as tracking noise from flaky-report automation.

In parallel, consider a small follow-up in this repo to reduce churn: prefer updating/reopening prior matching issues instead of creating a new issue when the previous one is closed.

Findings

• This repo is actions infrastructure, not Filebeat test code:
  • README.md:5 says this repository contains GitHub Actions.
  • README.md:11 + .github/workflows/oblt-aw.yml:7-12 show issue/PR events are forwarded into centralized AW workflow.
• The flaky-report action is responsible for issue creation/update behavior:
  • buildkite/flaky-report/action.yml:3 describes creating/updating GitHub issues.
  • buildkite/flaky-report/action.yml:17-19 accepts github-repo (example shows external repos like elastic/beats).
  • .github/workflows/test-buildkite-flaky-report.yml:44-54 exercises this action against Buildkite suite beats.
• Duplicate/churn behavior is currently by design:
  • buildkite/flaky-report/buildkite_flaky_report.py:174-205 loads and matches existing issues by title/test name.
  • buildkite/flaky-report/buildkite_flaky_report.py:269-275 creates a new issue when no match exists or matched issue is CLOSED.
  • buildkite/flaky-report/buildkite_flaky_report.py:278-281 comments only when matched issue is open.
  • Tests validate this behavior in buildkite/flaky-report/buildkite_flaky_report_tests.py:354-369 and :373-388.
• Local repo search found no filebeat/tests/system/test_registrar.py or test_rotating_file source in this codebase.

Verification

I validated behavior with the existing unit tests:

python3 -m venv /tmp/gh-aw/agent/triage-venv
/tmp/gh-aw/agent/triage-venv/bin/pip install --quiet requests pytest
/tmp/gh-aw/agent/triage-venv/bin/pytest -q buildkite/flaky-report/buildkite_flaky_report_tests.py

Output:

...................................................... [100%]
54 passed in 0.16s

Detailed Action Plan

1. In this issue, explicitly mark ownership as external to oblt-actions and link to the failing test scope (filebeat.tests.system.test_registrar.Test test_rotating_file).
2. If desired, open a maintenance issue in this repo for churn reduction in buildkite/flaky-report/buildkite_flaky_report.py:
   • Change process_flaky_test (:264-281) to prefer reopen/comment semantics for previously closed matching issues rather than always creating a new issue.
   • Keep existing title normalization in _format_issue_title (:150-154) to preserve matching stability.
3. Add/adjust tests in buildkite_flaky_report_tests.py around closed-issue handling (:354-369) to assert the new intended policy.
4. Validate via existing workflow/tests (.github/workflows/test-buildkite-flaky-report.yml) and local pytest run.

Related Items

Type	Link	Relevance
File	buildkite/flaky-report/buildkite_flaky_report.py	Core dedup/create/comment logic
File	buildkite/flaky-report/buildkite_flaky_report_tests.py	Tests proving current closed/open behavior
Workflow	.github/workflows/test-buildkite-flaky-report.yml	Shows flaky-report action integration for beats suite
Issue	#863	Prior issue with same title/scope from automation run
Issue	#861	Prior issue with same title/scope from automation run
Issue	#854	Earlier occurrence of same flaky test report

Note

🔒 Integrity filtering filtered 4 items

Integrity filtering activated and filtered the following items during workflow execution.
This happens when a tool call accesses a resource that does not meet the required integrity or secrecy level of the workflow.

• issue:filebeat.tests.system.test_registrar.Test test_rotating_file #867 (issue_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".)
• issue:filebeat.tests.system.test_registrar.Test test_rotating_file #863 (issue_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".)
• issue:filebeat.tests.system.test_registrar.Test test_rotating_file #861 (issue_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".)
• issue:filebeat.tests.system.test_registrar.Test test_rotating_file #854 (issue_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".)

---

What is this? | From workflow: Observability Agentic Workflow Entrypoint

Give us feedback! React with 🚀 if perfect, 👍 if helpful, 👎 if not.