DevOps & Cloud · CI cost and flaky tests
FlakeWatch
Faster CI, smaller bill.
Flaky tests, slow jobs and wasted minutes in GitHub Actions and GitLab CI, each with a cost attached and a fix you can paste.
$ cipulse acme/webshop --days 30
Health score 66/100 (C)
CI per month 140h 23m ≈ $136
Wasted / month 15h 34m ≈ $13.46 (11.1% of CI time)
Flaky failures 23 ≈ 5.8h dev time/mo
HIGH Cache dependencies between runs → saves $18.55/mo
HIGH Cancel outdated runs on new push → saves $9.79/mo
The problem
CI bills grow quietly. Re-runs hide flaky tests, outdated runs keep burning minutes, and nobody knows which job costs the most.
What it does
Detects flaky jobs that failed and passed on the same commit
Finds outdated runs that should have been cancelled, hung jobs and missing dependency caches
Puts a monthly cost on CI time, waste and developer time lost to flakes
Works with GitHub Actions and GitLab CI (GitLab.com or self-managed)
Weekly trends and an organisation-wide view across every repository
Recommendations with ready-to-paste workflow fixes
How it works
- Connect a GitHub or GitLab token with read access
- FlakeWatch reads 30 days of workflow runs and jobs
- Get a health score, the waste in money and the fixes ranked by savings
Works with
Runs in your CI
- uses: ./.github/actions/ci-pulse
with:
slack-webhook: <your Slack webhook secret> # optional
# outputs: health-score, grade, monthly-waste-usd
Your data
- Reads run history through a read-only token.
- Your code is never cloned or uploaded.
- Runs locally or as a scheduled job.
Who it's for
Questions
How is waste measured?
Re-runs, superseded runs, jobs that could be cached and slow steps are timed and priced at your runner rates.
Does it fix flaky tests?
It finds them, shows how often they fail and what they cost, and suggests the fix; your team decides.
Related
Often used with FlakeWatch
BlastRadar
Change impact analysisKnow what a change will touch. Before a release, see every service a change can affect and the line of code that links it. After the release, confirm those services are still healthy.
$300–600 (₹10,000–20,000 in India)View product → DevOps & CloudSLOStudio
SLOs and error budgetsReliability you can measure. Define each SLO in a few lines and get correct burn-rate alerts, an error budget everyone understands, and a release gate, on the monitoring you already run.
$1,500–3,000 (₹40,000–80,000 in India)View product → DevOps & CloudTestScope
Test impact selectionRun the tests that matter. Every pull request runs the tests its change can affect, each with a stated reason, and the full suite whenever a change is too broad to trust.
$1,000–2,500 (₹25,000–60,000 in India)View product →See FlakeWatch on your own data
A 30-minute call. We run the product on your export, repository or document and walk you through the results.