Summary
The middleware service is experiencing a high error rate and latency due to resource exhaustion caused by high CPU and memory usage, resulting in a high number of 504 Gateway Timeout errors. This issue is causing significant disruptions to the service, and immediate action is required to mitigate the impact.
Root Cause
The probable cause of the incident is a memory leak or optimization opportunity, which is causing the middleware service to experience resource exhaustion. The error logs indicate a consistent 504 Gateway Timeout error, with high CPU and memory usage metrics across multiple log entries, suggesting a systemic issue with resource utilization.
Recommended Action
- Implement horizontal scaling to increase the number of instances and distribute the workload
- Investigate potential memory leaks or optimization opportunities to reduce resource utilization
- Monitor the service for any further issues or errors after implementing the recommended actions
Priority
P1
Summary
The middleware service is experiencing a high error rate and latency due to resource exhaustion caused by high CPU and memory usage, resulting in a high number of 504 Gateway Timeout errors. This issue is causing significant disruptions to the service, and immediate action is required to mitigate the impact.
Root Cause
The probable cause of the incident is a memory leak or optimization opportunity, which is causing the middleware service to experience resource exhaustion. The error logs indicate a consistent 504 Gateway Timeout error, with high CPU and memory usage metrics across multiple log entries, suggesting a systemic issue with resource utilization.
Recommended Action
Priority
P1