Database query timeout on groups APIOperational

Components

API

Locations

Google Compute Engine



November 6, 2024 12:59 UTC
[Resolved] After a period of monitoring, we have confirmed that the issue has been resolvedSee the GitLab incident issue for more details: gitlab.com/gitlab-com/gl-infra/production/-/issues/18820

November 6, 2024 12:50 UTC
[Monitoring] The fix has now successfully been deployed to Production and we will continue to monitor this situation. See the GitLab incident issue for more details: gitlab.com/gitlab-com/gl-infra/production/-/issues/18820

November 6, 2024 11:15 UTC
[Identified] Deployment of this fix is continuing, and more updates will follow shortly. Please see gitlab.com/gitlab-com/gl-infra/production/-/issues/18820 for more information.

November 6, 2024 09:28 UTC
[Identified] A fix has been identified, and will be deployed to production shortly. More updates will follow, but please see gitlab.com/gitlab-com/gl-infra/production/-/issues/18820 for more information.

November 6, 2024 08:36 UTC
[Investigating] Investigation of this issue is continuing, with no material updates to report. Please follow gitlab.com/gitlab-com/gl-infra/production/-/issues/18820 for more information.

November 6, 2024 08:12 UTC
[Investigating] No material updates to report. We are continuing to investigate potential causes of this issue. Please follow gitlab.com/gitlab-com/gl-infra/production/-/issues/18820 for more information.

November 6, 2024 07:44 UTC
[Investigating] No material updates to report. We are continuing to investigate potential causes of this issue. Please follow gitlab.com/gitlab-com/gl-infra/production/-/issues/18820 for more information.

November 6, 2024 07:20 UTC
[Investigating] We previously resolved this issue, but with the recent increase in traffic, we're noticing a spike in error rates for the Groups API. We're re-opening this incident for further investigation. Details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/18820

November 6, 2024 03:20 UTC
[Resolved] After a period of monitoring, we have confirmed that the issue has been resolved after the rollout of the feature flag. See the GitLab incident issue for more details: gitlab.com/gitlab-com/gl-infra/production/-/issues/18811

November 6, 2024 01:45 UTC
[Monitoring] A fix has successfully been deployed to Production. The corresponding Feature Flag is being rolled-out gradually. We will continue to monitor. See the GitLab incident issue for more details: gitlab.com/gitlab-com/gl-infra/production/-/issues/18811

November 5, 2024 23:47 UTC
[Identified] A fix is currently being rolled out to production. We are still waiting for the pipeline to complete. Once completed, we will continue to monitor.

November 5, 2024 22:46 UTC
[Identified] A fix is currently being rolled out to production. Once complete, the issue should be mitigated, and we will continue to monitor.

November 5, 2024 21:37 UTC
[Identified] A fix is currently being rolled out to production. Once complete, the issue should be mitigated, and we will continue to monitor.

November 5, 2024 19:56 UTC
[Identified] We have identified the issue and are in the process of Merging a fix! We will update you once that fix has merged.

November 5, 2024 18:39 UTC
[Identified] We have identified the issue and are in the process of Merging a fix! Please stand by for updates.

November 5, 2024 17:35 UTC
[Identified] We have identified the issue and are still working with our team to resolve it. The next update is in an hour. Please standby.

November 5, 2024 16:54 UTC
[Identified] We have identified the issue and are still working with our team to resolve it. Please stand by for updates.

November 5, 2024 16:01 UTC
[Identified] The root cause has been identified, and our engineers are working on a fix. Please stand by for further updates.

November 5, 2024 15:50 UTC
[Investigating] Investigation is continuing, we will provide another update in 15 minutes.

November 5, 2024 15:35 UTC
[Investigating] Our engineers continue to investigate the root cause, please stand by for further updates.

November 5, 2024 15:20 UTC
[Investigating] Our engineers are continuing their investigation. Please stand by for further updates.

November 5, 2024 15:04 UTC
[Investigating] Our engineers continue to investigate the root cause, please stand by for further updates.

November 5, 2024 14:49 UTC
[Investigating] Investigation is continuing, we will provide another update in 15 minutes.

November 5, 2024 14:33 UTC
[Investigating] We have identified an issue with the Groups API, when the min_access_level is included in the API Call. Investigation is proceeding, and we will post an update in 15 minutes.

Back to current status