Skip to content

Incident detail

Delays and intermittent failures running Smarter Testing

Resolved incidentMinor1 affected service

Timeline window

to

Get alerted the next time CircleCI breaks

Free email alerts for the handful of vendors you cannot afford to miss. No card, live in about a minute. Paid plans add Slack, Teams, Discord, and webhook delivery across your whole stack, plus higher API quotas.

Timeline

Incident updates

Every update on the official status source, oldest to newest, exactly as it appeared there.

  1. Investigating

    Some Smarter Testing customers may not be able to run tests.

    We are also seeing delays updating the impact analysis data map, which may cause more tests to be selected by Smarter Testing.

  2. Identified

    Starting at 16:38 UTC, test jobs for customers using Smarter Testing should be back running. Dynamic Test Splitting may still not be working optimally for some customers.

  3. Identified

    Since 17:09 UTC, we have been seeing delays in updating test impact analysis data.

    Test selection may be less precise, which may cause more tests than necessary to run. Thank you for your patience while our engineers work to resolve this.

  4. Identified

    Since 17:38 UTC, some test jobs for customers using Smarter Testing have been failing.

    Thank you for your patience while our engineers work to resolve this.

  5. Identified

    Since 17:55 UTC, test jobs for customers using Smarter Testing have been running again.

    Dynamic Test Splitting is still not running optimally.

    Dynamic Parallelism is also not running optimally, so jobs that use it should be expected to fall back to using all nodes.

    Thank you for your patience while our engineers work to resolve this.

    We will provide another update by 18:30 UTC.

  6. Identified

    Since 17:55 UTC, test jobs for customers using Smarter Testing have been running again.

    Dynamic Test Splitting is still not running optimally.

    Dynamic Parallelism is also not running optimally, so jobs that use it should be expected to fall back to using all nodes.

    Thank you for your patience while our engineers work to resolve this.

    We will provide another update by 18:50 UTC

  7. Identified

    At 18:45 UTC, we will perform emergency maintenance, which is expected to take a few minutes. During this window, test jobs for customers using Smarter Testing may be delayed or fail.

    Thank you for your patience while our engineers work to resolve this.

    We will provide another update by 19:05 UTC.

  8. Monitoring

    The maintenance was successful. Smarter Testing functionality has been restored.

    We are monitoring to ensure performance remains stable.

  9. Resolved

    Smarter Testing functionality is restored.

    We appreciate your patience as we worked through this.

Keep exploring

More from CircleCI

Neighboring incidents on CircleCI's timeline and the rest of their record on OutageDeck.