Active Issue

Updated a few seconds ago

Back to current status

Status History

Filter: GitLab Customers Portal (Clear)



January 2025

Customers Portal is Down (customers.gitlab.com)

January 23, 2025 20:26 UTC

Incident Status

Partial Service Disruption


Components

GitLab Customers Portal


Locations

Google Compute Engine




January 23, 2025 20:26 UTC
[Resolved] After a period of monitoring, we have observed no further issues with the Customers Portal (customers.gitlab.com). This incident is now considered resolved. Details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/19163

January 23, 2025 19:43 UTC
[Monitoring] The login issue with the Customers Portal (customers.gitlab.com) has been resolved. We will continue to monitor the situation closely to ensure stability. More details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/19163

January 23, 2025 19:20 UTC
[Investigating] We are still investigating intermittent login issues with the Customers Portal (customers.gitlab.com). While we work on resolving this, please continue using the legacy login: customers.gitlab.com/customers/sign_in?legacy=true. More details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/19163

January 23, 2025 19:00 UTC
[Investigating] We are currently investigating an issue with logging into the Customers Portal (customers.gitlab.com). In the meantime, the legacy login remains functional: customers.gitlab.com/customers/sign_in?legacy=true. More details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/19163

Accessing gitlab.com results in 500 errors

January 6, 2025 16:42 UTC

Incident Status

Partial Service Disruption


Components

Website, API, Git Operations, Container Registry, GitLab Pages, CI/CD - Hosted runners on Linux, CI/CD - Hosted runners on Windows, CI/CD - Hosted runners on macOS, CI/CD - Hosted runners for GitLab community contributions, SAML SSO - GitLab SaaS, Background Processing, GitLab Customers Portal, Support Services, packages.gitlab.com, version.gitlab.com, forum.gitlab.com, docs.gitlab.com, Canary, Product Analytics - Configurator (Beta), Product Analytics - Collector (Beta), Product Analytics - Background processing (Beta), Product Analytics - Queries (Beta), GitLab Duo


Locations

Google Compute Engine, Digital Ocean, Zendesk, AWS




January 6, 2025 16:42 UTC
[Resolved] We've identified the cause of the errors and the errors have returned to normal. The incident is now resolved. More information on the incident can be found in this issue: gitlab.com/gitlab-com/gl-infra/production/-/issues/19079

January 6, 2025 15:57 UTC
[Monitoring] We've identified the cause of the errors, and the errors have returned to normal. The incident is now mitigated, but we're continuing to monitor for any further impact. More information on the incident can be found in this issue: gitlab.com/gitlab-com/gl-infra/production/-/issues/19079

January 6, 2025 15:27 UTC
[Monitoring] We're continuing to monitor for further errors related to the incident. We see further decreases in the errors.

January 6, 2025 15:17 UTC
[Monitoring] We saw elevated 500 errors on gitlab.com which have then decreased. We're continuing to monitor for further errors

November 2024

Customers Portal is down (customers.gitlab.com)

November 28, 2024 10:39 UTC

Incident Status

Service Disruption


Components

GitLab Customers Portal


Locations

Google Compute Engine




November 28, 2024 10:39 UTC
[Resolved] Functionality has been restored to the Customer Portal (customers.gitlab.com). The billing pages in GitLab.com are also available.

November 28, 2024 09:39 UTC
[Investigating] The Customers Portal is currently in maintenance mode and unavailable due to a 3rd-party API outage. The billing pages in GitLab.com may be affected.

September 2024

Customers Portal is down (customers.gitlab.com)

September 4, 2024 20:07 UTC

Incident Status

Service Disruption


Components

GitLab Customers Portal


Locations

Google Compute Engine




September 4, 2024 20:07 UTC
[Resolved] Functionality has been restored to the customer portal (customers.gitlab.com).

September 4, 2024 19:46 UTC
[Monitoring] A fix has been implemented and we are monitoring the results.

September 4, 2024 19:04 UTC
[Investigating] The Customers Portal (customers.gitlab.com) is in maintenance mode due to a 3rd-party API being down. The billing pages in GitLab.com may be affected.

GitLab.com Connectivity Issues

September 3, 2024 05:34 UTC

Incident Status

Service Disruption


Components

Website, API, Git Operations, Container Registry, GitLab Pages, CI/CD - Hosted runners on Linux, CI/CD - Hosted runners on Windows, CI/CD - Hosted runners on macOS, CI/CD - Hosted runners for GitLab community contributions, SAML SSO - GitLab SaaS, Background Processing, GitLab Customers Portal, Support Services, packages.gitlab.com, version.gitlab.com, forum.gitlab.com, docs.gitlab.com, Canary, Product Analytics - Configurator (Beta), Product Analytics - Collector (Beta), Product Analytics - Background processing (Beta), Product Analytics - Queries (Beta), GitLab Duo


Locations

Google Compute Engine, Digital Ocean, Zendesk, AWS




September 3, 2024 05:34 UTC
[Resolved] All GitLab services have been restored. We are actively monitoring the system, and everything appears normal at this time. For more details, please follow the issue at: gitlab.com/gitlab-com/gl-infra/production/-/issues/18490

September 3, 2024 05:19 UTC
[Monitoring] We've identified and addressed the root cause of the issue. All GitLab services have been restored, and we are actively monitoring the system. Follow the issue for more details : gitlab.com/gitlab-com/gl-infra/production/-/issues/18490

September 3, 2024 05:09 UTC
[Investigating] GitLab.com is currently experiencing connectivity issues due to a high error rate. Our infrastructure team is investigating. Issue: gitlab.com/gitlab-com/gl-infra/production/-/issues/18490

August 2024

Some requests timing out

August 23, 2024 03:59 UTC

Incident Status

Operational


Components

Website, API, Git Operations, Container Registry, GitLab Pages, CI/CD - Hosted runners on Linux, CI/CD - Hosted runners on Windows, CI/CD - Hosted runners on macOS, CI/CD - Hosted runners for GitLab community contributions, SAML SSO - GitLab SaaS, Background Processing, GitLab Customers Portal, Support Services, packages.gitlab.com, version.gitlab.com, forum.gitlab.com, docs.gitlab.com, Canary, Product Analytics - Configurator (Beta), Product Analytics - Collector (Beta), Product Analytics - Background processing (Beta), Product Analytics - Queries (Beta), GitLab Duo


Locations

Google Compute Engine, Digital Ocean, Zendesk, AWS




August 23, 2024 03:59 UTC
[Resolved] The issue has been resolved and all functionality on GitLab.com is nominal. Please see gitlab.com/gitlab-com/gl-infra/production/-/issues/18435 for more details.

August 23, 2024 01:53 UTC
[Monitoring] The issue has been identified and the incident resolved. We will continue monitoring for a while.

August 23, 2024 01:27 UTC
[Identified] We have identified an underlying cause and are working to mitigate it. See gitlab.com/gitlab-com/gl-infra/production/-/issues/18435 for more details.

August 23, 2024 00:34 UTC
[Investigating] We have noticed that there are delays in web UI updates for example, MRs not showing up after submission, We are continuing to investigate - please see gitlab.com/gitlab-com/gl-infra/production/-/issues/18435 for more details.

August 23, 2024 00:27 UTC
[Investigating] Some requests are slow or timing out due to DB saturation. We are investigating. Please see [this issue](gitlab.com/gitlab-com/gl-infra/production/-/issues/18435) for further details.

July 2024

Customers Portal Maintenance Mode

July 31, 2024 20:47 UTC

Customers Portal Maintenance ModePartial Service Disruption

Incident Status

Partial Service Disruption


Components

GitLab Customers Portal


Locations

Google Compute Engine




July 31, 2024 20:47 UTC
[Resolved] This incident has been resolved and the customer portal is now operational. More information can be found in gitlab.com/gitlab-com/gl-infra/production/-/issues/18351

July 31, 2024 20:28 UTC
[Monitoring] The Customers Portal is now accessible and operating normally. We are monitoring for the next fifteen minutes to ensure that no further issues are observed before we resolve this incident. Details in gitlab.com/gitlab-com/gl-infra/production/-/issues/18351

July 31, 2024 20:11 UTC
[Identified] The Customers Portal (customers.gitlab.com) is currently in maintenance mode due to a 3rd party API experiencing issues at the moment. For more information see gitlab.com/gitlab-com/gl-infra/production/-/issues/18351

GitLab.com is unavailable

July 11, 2024 18:28 UTC

GitLab.com is unavailableService Disruption

Incident Status

Service Disruption


Components

Website, API, Git Operations, Container Registry, GitLab Pages, CI/CD - Hosted runners on Linux, CI/CD - Hosted runners on Windows, CI/CD - Hosted runners on macOS, CI/CD - Hosted runners for GitLab community contributions, SAML SSO - GitLab SaaS, Background Processing, GitLab Customers Portal, Support Services, packages.gitlab.com, version.gitlab.com, forum.gitlab.com, docs.gitlab.com, Canary, Product Analytics - Configurator (Beta), Product Analytics - Collector (Beta), Product Analytics - Background processing (Beta), Product Analytics - Queries (Beta), GitLab Duo


Locations

Google Compute Engine, Digital Ocean, Zendesk, AWS




July 11, 2024 18:28 UTC
[Resolved] This incident is now resolved and no further errors are being seen on GitLab.com. Our investigation points to a disk performance issue. You can see further details and corrective actions in gitlab.com/gitlab-com/gl-infra/production/-/issues/18269.

July 11, 2024 15:51 UTC
[Investigating] Our investigations are ongoing. We will post our next update when we have more information. Please follow the incident issue for updates here: gitlab.com/gitlab-com/gl-infra/production/-/issues/18269

July 11, 2024 15:28 UTC
[Investigating] No material updates to report. We're continuing to investigate the issue. Please follow the incident issue for updates here: gitlab.com/gitlab-com/gl-infra/production/-/issues/18269

July 11, 2024 15:00 UTC
[Investigating] We are seeing improved service availability and investigations continue for this problem. Please follow the incident issue for updates here: gitlab.com/gitlab-com/gl-infra/production/-/issues/18269

July 11, 2024 14:43 UTC
[Investigating] We are seeing improved service availability and investigations continue for this problem. We are planning to make the incident issue publicly available as soon as possible.

July 11, 2024 14:29 UTC
[Investigating] We are investigating a problem with gitlab.com being unavailable for some users. Our investigations continue and we will post further status updates shortly.

July 11, 2024 14:18 UTC
[Investigating] We are investigating a problem with gitlab.com being unavailable for some users. We will post further status updates shortly.

April 2024

Customers Portal maintenance mode

April 1, 2024 10:49 UTC

Customers Portal maintenance modePartial Service Disruption

Incident Status

Partial Service Disruption


Components

GitLab Customers Portal


Locations

Google Compute Engine




April 1, 2024 10:49 UTC
[Resolved] This incident has been resolved and the customer portal is now operational. More information can be found in gitlab.com/gitlab-com/gl-infra/production/-/issues/17767.

April 1, 2024 10:39 UTC
[Identified] The Customers Portal (customers.gitlab.com) is currently in maintenance mode due to a 3rd party API having issues at the moment. For more information see gitlab.com/gitlab-com/gl-infra/production/-/issues/17767

October 2023

Customers Portal in maintenance

October 23, 2023 15:13 UTC

Incident Status

Degraded Performance


Components

GitLab Customers Portal


Locations

Google Compute Engine




October 23, 2023 15:13 UTC
[Resolved] The incident with the payment provider has been resolved, but monitoring will continue. More details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/17015

October 23, 2023 14:46 UTC
[Monitoring] The payment provider is back online. Our engineers are still monitoring. Details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/17015

October 23, 2023 14:23 UTC
[Identified] We are currently experiencing issues with our Payment Provider. Due to a 3rd-party API being down, sign-ups on GitLab.com may be impacted too. More details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/17015

October 23, 2023 14:05 UTC
[Identified] The Customers Portal (customers.gitlab.com) is in maintenance mode while a 3rd-party API is down. More details in: gitlab.com/gitlab-com/gl-infra/production/-/issues/17015

September 2023

Customer Portal Maintenance

September 17, 2023 18:13 UTC

Customer Portal MaintenancePlanned Maintenance

Description

The customers portal (customers.gitlab.com) will be in maintenance mode due to a 3rd-party scheduled maintenance on 17th September 2023. Maintenance will be begin on 2:00 AM and end at 5:00 AM UTC.


Components

GitLab Customers Portal


Locations

Google Compute Engine


Schedule

September 17, 2023 02:00 - September 17, 2023 05:00 UTC



September 17, 2023 18:13 UTC
[Update] The scheduled maintenance has been completed by our 3rd party vendor as of 9:13 AM UTC.

September 17, 2023 18:12 UTC
[Update] This maintenance has been completed by our 3rd party vendor.

August 2023

Customer Portal Maintenance

August 21, 2023 12:15 UTC

Customer Portal MaintenancePlanned Maintenance

Description

The customers portal (customers.gitlab.com) will be in maintenance mode due to a 3rd-party scheduled maintenance on 20th August 2023. Maintenance will be begin on 2:00 AM and end at 5:00 AM UTC.


Components

GitLab Customers Portal


Locations

Google Compute Engine


Schedule

August 20, 2023 02:00 - August 20, 2023 05:00 UTC



August 21, 2023 12:15 UTC
[Update] The maintenance to our Customer Portal has been cancelled as it was not necessary at this point. We will post a new maintenance entry, should a maintenance be needed in the future.

Queries to Zuora failing on CustomersDot

August 3, 2023 06:08 UTC

Incident Status

Degraded Performance


Components

GitLab Customers Portal


Locations

Google Compute Engine




August 3, 2023 06:08 UTC
[Resolved] We have completed monitoring the incident, the Customer Portal is no longer showing any errors and is fully operational. Further updates have been added to gitlab.com/gitlab-com/gl-infra/production/-/issues/16115

August 3, 2023 05:37 UTC
[Monitoring] We're continuing to monitor the situation, an update will be provided in 30 minutes.

August 3, 2023 04:28 UTC
[Monitoring] The incident appears to relate to a Zuora API change - We have deployed a fix and the Customer Portal is now online. We're currently monitoring to ensure the issue is resolved.

August 3, 2023 04:13 UTC
[Investigating] There is no new update at the moment, we're continuing to investigate this issue. See more details at gitlab.com/gitlab-com/gl-infra/production/-/issues/16115

August 3, 2023 03:20 UTC
[Investigating] We are still investigating this issue and looking to deploy a fix.

August 3, 2023 02:21 UTC
[Investigating] We are still working on deploying a fix.

August 3, 2023 01:53 UTC
[Investigating] We have identified the issue and are working on a fix.

August 3, 2023 01:33 UTC
[Investigating] We are currently seeing Queries to Zuora failing on CustomersDot. We are investigating if Customers cannot make purchases because of this.

June 2023

customer.gitlab.com is down

June 30, 2023 05:49 UTC

customer.gitlab.com is downService Disruption

Incident Status

Service Disruption


Components

GitLab Customers Portal


Locations

Google Compute Engine




June 30, 2023 05:49 UTC
[Resolved] The incident seems to caused by multiple sync requests for a few namespaces with unusual name. We have blocked a few users during our investigation. The customer portal is back online. We'll post more update in the incident issue. gitlab.com/gitlab-com/gl-infra/production/-/issues/15966

June 30, 2023 05:15 UTC
[Investigating] There's no new update at the moment. We're still investigating the incident. See more details at gitlab.com/gitlab-com/gl-infra/production/-/issues/15966

June 30, 2023 04:46 UTC
[Investigating] customer.gitlab.com is down. As a result, GitLab.com billing page is also unavailable. We see a large number of request from a single IP. The situation has not recovered after blocking the IP. We're investigating this further. See more details at gitlab.com/gitlab-com/gl-infra/production/-/issues/15966

Slow requests on GitLab.com

June 7, 2023 13:32 UTC

Slow requests on GitLab.comPartial Service Disruption

Incident Status

Partial Service Disruption


Components

Website, API, Git Operations, Container Registry, GitLab Pages, CI/CD - Hosted runners on Linux, CI/CD - Hosted runners on Windows, CI/CD - Hosted runners for GitLab community contributions, SAML SSO - GitLab SaaS, Background Processing, GitLab Customers Portal, Support Services, packages.gitlab.com, version.gitlab.com, forum.gitlab.com, docs.gitlab.com, Canary


Locations

Google Compute Engine, Digital Ocean, Zendesk, AWS




June 7, 2023 13:32 UTC
[Resolved] We have identified the root cause, have seen recovery and are therefore resolving this incident. More information in: gitlab.com/gitlab-com/gl-infra/production/-/issues/14839

June 7, 2023 13:21 UTC
[Investigating] Customers are experiencing slow requests on GitLab.com. More information in: gitlab.com/gitlab-com/gl-infra/production/-/issues/14839

May 2023

Hardware upgrade for the GitLab.com datastore

May 27, 2023 04:06 UTC

Description

In 2 weeks, as part of a planned maintenance window, we will perform a hardware upgrade for the GitLab.com datastore. Users may experience temporary 50X errors for a brief period during this window. See gitlab.com/gitlab-com/gl-infra/production/-/issues/10694


Components

Website, API, Git Operations, Container Registry, GitLab Pages, CI/CD - Hosted runners on Linux, CI/CD - Hosted runners on Windows, CI/CD - Hosted runners for GitLab community contributions, SAML SSO - GitLab SaaS, Background Processing, GitLab Customers Portal, Support Services, packages.gitlab.com, version.gitlab.com, forum.gitlab.com, docs.gitlab.com, Canary


Locations

Google Compute Engine, Digital Ocean, Zendesk, AWS


Schedule

May 27, 2023 03:00 - May 27, 2023 04:00 UTC



May 27, 2023 04:06 UTC
[Update] GitLab.com's database layer maintenance is complete now, and we're fully back up and running. We'll be monitoring the platform to ensure all systems are functioning correctly. Thank you for your patience.

May 27, 2023 03:41 UTC
[Update] The database switchover is now complete, we expect all SQL statements to be routed to the new nodes. The site is back up and we're continuing to verify that all systems are functioning correctly. Thank you for your patience.

May 27, 2023 03:00 UTC
[Update] The database maintenance is starting now. The database Primary node switchover should happen at any moment in the next hour and during the switchover users might see 50X errors for a very brief span of time. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 27, 2023 01:51 UTC
[Update] We will be conducting a maintenance database activity in an hour, from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 26, 2023 02:27 UTC
[Update] We will be conducting a maintenance database activity Tomorrow, 2023-05-27, from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 24, 2023 02:14 UTC
[Update] Correction: We will be conducting a maintenance database activity this Saturday, 2023-05-27. from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 24, 2023 02:05 UTC
[Update] We will be conducting a maintenance database activity this Saturday, 2023-05-20, from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 20, 2023 03:58 UTC
[Update] The maintenance is rescheduled to next Saturday, 2023-05-27, from 03:00 to 04:00 UTC. There is currently a long database migration running to fix an incident (gitlab.com/gitlab-com/gl-infra/production/-/issues/14468) that we can't risk to interrupt. We apologise for any inconvenience.

May 20, 2023 03:07 UTC
[Update] The scheduled maintenance will be not be starting at 03:00 UTC, and has been delayed. More details soon to follow.

May 20, 2023 02:00 UTC
[Update] We will be conducting a maintenance database activity in an hour, from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 20, 2023 01:00 UTC
[Update] We will be conducting a maintenance database activity in 2 hours, from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 19, 2023 02:00 UTC
[Update] We will be conducting a maintenance database activity tomorrow, 2023-05-20, from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 17, 2023 02:00 UTC
[Update] We will be conducting a maintenance database activity this Saturday, 2023-05-20, from 03:00 to 04:00 UTC. Users might see 50X errors for a very brief span of time during this window. For details see gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

May 12, 2023 02:00 UTC
[Update] Next week, as part of a planned maintenance window on 2023-05-20 from 03:00 to 04:00 UTC, We will perform a hardware upgrade for the GitLab.com datastore. Users may experience temporary 50X errors for a brief period during this window. See gitlab.com/gitlab-com/gl-infra/production/-/issues/10694

customers.gitlab.com is unavailable

May 16, 2023 07:18 UTC

Incident Status

Service Disruption


Components

GitLab Customers Portal


Locations

Google Compute Engine




May 16, 2023 07:18 UTC
[Resolved] This incident has been marked as resolved. We are still investigating the root cause of the issue. Details: gitlab.com/gitlab-com/gl-infra/production/-/issues/14367

May 16, 2023 06:08 UTC
[Monitoring] We are no longer seeing errors from customers.gitlab.com. We are still investigating the cause of the issue. We will post further updates as more information is available in the next couple of hours. Details:gitlab.com/gitlab-com/gl-infra/production/-/issues/14367

May 16, 2023 05:16 UTC
[Monitoring] Access to customers.gitlab.com is restored. While the service has been restored, our team is continuing to investigate the root cause of the issue. We will move this to monitoring state for now. Details: gitlab.com/gitlab-com/gl-infra/production/-/issues/14367

May 16, 2023 04:57 UTC
[Investigating] We are currently experiencing an issue on customers.gitlab.com. This endpoint is currently not available, and our team is currently looking into this. Kindly refer to this link for more details: gitlab.com/gitlab-com/gl-infra/production/-/issues/14367

March 2023

Migrate CustomersDot to managed Redis

March 28, 2023 12:57 UTC

Description

To avoid scaling issues we are moving Redis to a managed service. During the maintenance window downtime is to be expected.


Components

GitLab Customers Portal


Locations

Google Compute Engine


Schedule

March 28, 2023 12:00 - March 28, 2023 12:20 UTC



March 28, 2023 12:57 UTC
[Update] The migration has been executed successfully

March 28, 2023 12:56 UTC
[Update] The migration has started at the scheduled time.

January 2023

New Users are unable to purchase Gitlab.com Subscriptions

January 31, 2023 05:04 UTC

Incident Status

Partial Service Disruption


Components

Website, GitLab Customers Portal


Locations

Google Compute Engine




January 31, 2023 05:04 UTC
[Resolved] The fix has been deployed and verified on GitLab.com. More information can be found in gitlab.com/gitlab-com/gl-infra/production/-/issues/8325

January 31, 2023 04:59 UTC
[Resolved] The fix has been deployed and verified on GitLab.com. More information can be found in gitlab.com/gitlab-com/gl-infra/production/-/issues/8325

January 31, 2023 00:21 UTC
[Monitoring] We are monitoring the status of the merge to fix the issue. We expect the fix to be deployed within six hours. Logging into the Customers Portal at customers.gitlab.com before attempting to purchase a subscription on Gitlab.com will work around the issue. Further details are available on gitlab.com/gitlab-com/gl-infra/production/-/issues/8325.

January 30, 2023 22:36 UTC
[Monitoring] We have identified the merge request that caused this issue; we have reverted that merge request and expect that it will be deployed within eight hours. Logging into the Customers Portal at customers.gitlab.com before attempting to purchase a subscription on Gitlab.com will work around the issue. Further details are available on gitlab.com/gitlab-com/gl-infra/production/-/issues/8325.

January 30, 2023 22:01 UTC
[Identified] We believe we have identified a merge request that caused this issue. We are working on deploying a fix. More details are available in gitlab.com/gitlab-com/gl-infra/production/-/issues/8325

High Error Rate on Select GitLab.com

January 5, 2023 11:24 UTC

Incident Status

Service Disruption


Components

Website, API, Git Operations, Container Registry, GitLab Pages, CI/CD - Hosted runners on Linux, CI/CD - Hosted runners on Windows, CI/CD - Hosted runners for GitLab community contributions, SAML SSO - GitLab SaaS, Background Processing, GitLab Customers Portal, Support Services, packages.gitlab.com, version.gitlab.com, forum.gitlab.com, Canary


Locations

Google Compute Engine, Digital Ocean, Zendesk, AWS




January 5, 2023 11:24 UTC
[Resolved] Our Engineers identified the root cause and addressed it with a fix. The incident is now mitigated and users are expected to work with MRs without encountering any errors. For details, check gitlab.com/gitlab-com/gl-infra/production/-/issues/8201

January 5, 2023 09:18 UTC
[Monitoring] Services continue to recover and customers reported successful logins though SAML. However, some users are still facing errors with MRs. Please check the issue for the workaround: gitlab.com/gitlab-com/gl-infra/production/-/issues/8201#note_1228554821

January 5, 2023 08:45 UTC
[Monitoring] The error rates are decreasing, but users might still experience errors when authenticating through SAML and working with MRs. Investigation is still ongoing. For details, check gitlab.com/gitlab-com/gl-infra/production/-/issues/8201

January 5, 2023 08:24 UTC
[Monitoring] We are seeing the error rate decreasing and the services recovering. Our Engineers will keep monitoring the systems. For more details, please check gitlab.com/gitlab-com/gl-infra/production/-/issues/8201

January 5, 2023 08:07 UTC
[Investigating] We are currently seeing a high rate of errors on GitLab.com. Our infrastructure team is currently investigating. More information can be found here: gitlab.com/gitlab-com/gl-infra/production/-/issues/8201





Back to current status