Resolved incident

Elevated Latency on Query Execution (Retool Cloud)

Retool · Minor · Started

Duration
174h 53m
Severity
Minor
Status
Resolved

Summary

Minor · Resolved

Query performance is back to normal and the incident is resolved.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    Retool

    Some customers may experience slower than normal query load times. We're actively investigating and will provide updates as we learn more.

  2. Investigating

    Retool

    Some users may see improved query latency, but we are continuing to investigate.

  3. Monitoring

    Retool

    Some changes have been deployed, and we are monitoring the results

  4. Investigating

    Retool

    We are seeing intermittent spikes in query latency, as we saw earlier. A temporary mitigation is in place, and we're continuing to investigate the root cause. We'll share an update as soon as we have more information.

  5. Investigating

    Retool

    The temporary mitigation we applied earlier is still in place, and some users have reported significantly improved query latency. We're still investigating the root cause and will share another update as we learn more.

  6. Monitoring

    Retool

    A fix has been implemented and we are monitoring the results.

  7. Investigating

    Retool

    This morning we again saw high query latency. We were able to mitigate it temporarily, and our investigation into the root cause is ongoing. We'll share another update as we learn more.

  8. Investigating

    Retool

    Additional changes have been deployed as part of a more permanent fix, alongside the temporary fix already in place. We'll monitor through tomorrow morning's peak traffic to confirm their impact and will share another update then.

  9. Monitoring

    Retool

    A fix has been implemented and we are monitoring the results.

  10. Monitoring

    Retool

    We have not seen the same query latency issues since the fix was applied. We’re continuing to monitor closely and will share another update if anything changes.

  11. Resolved

    Retool

    Query performance is back to normal and the incident is resolved.