Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky test page should include retry runs #128735

Open
zou3519 opened this issue Jun 14, 2024 · 0 comments
Open

Flaky test page should include retry runs #128735

zou3519 opened this issue Jun 14, 2024 · 0 comments
Labels
module: infra Relates to CI infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module

Comments

@zou3519
Copy link
Contributor

zou3519 commented Jun 14, 2024

See https://hud.pytorch.org/flakytest?name=test_bmm_multithreaded&suite=TestTorch&limit=100

There are no test results from after 5/16. However, IIRC, CI is supposed to retry a failing test periodically. It would be cool if the retries are also listed on that page.

The context is that I am trying to fix a flaky test and staring at a log from when the test was first deemed to be flaky isn't helpful because it's commonly out of date. Also, I want to know the statistics of the test now: is it still flaky? Or is it consistently failing?

cc @pytorch/pytorch-dev-infra

@ezyang ezyang added the module: infra Relates to CI infrastructure label Jun 15, 2024
@mikaylagawarecki mikaylagawarecki added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Jun 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: infra Relates to CI infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
Status: No status
Development

No branches or pull requests

3 participants