Slowness on all sites

• Product changes
• ProductCatalog needs to update Elastic
• Elastic has to recalculate pricing
• Pricing on these REALLY big products takes too long
• ProductCatalog had some bad code (I wrote) that causes multiple stacking calls to Pricing that never get to complete
• PricingAPI consumes all of the CPU processing these big products' pricing
• PricingAPIs are on the same servers as all of our other internal APIs

Recommended to add additional servers to mix

We've now resolved the incident. Thanks for your patience.

Summary:

We are currently experiencing slowness on all sites.

Impact

• Incident Started: 6:52am
• Affecting Customers: Yes
• Affecting CEC: Yes
• Other department affected: Unknown
• Ongoing Impact: Configurator page is taking longer times to calculate prices, sometimes timing out

Detail:

[History] Core is working with infrastructure to triage the issue

ETA:

Unknown ETA

Slack:

#GCC-ProdSupport

Please standby for further updates, and we'll be in touch as soon as we know more.