Performance Issues – Root Cause Identified, Improvements in Progress

Resolved
Resolved

After a full week of monitoring, we can confirm that performance has remained stable across all environments.

We continue to work closely with Microsoft to explore long-term solutions and will provide further updates as new information becomes available.

Thank you for your patience and trust.

Recovering

We would like to provide you with an update on the performance issues reported earlier.

Based on feedback from Microsoft, their Product Group team worked late into the night to implement improvements, including splitting clusters and reducing the number of active tenants to lower memory load. As a result, Microsoft expects the issues to be resolved, and no new degradations should occur.

From our side, we have been closely monitoring the situation. So far, we have not received any new performance-related reports, and telemetry data indicates stable system behavior throughout the day.

We sincerely appreciate your patience and trust as we continue to work alongside Microsoft to ensure long-term stability. We will remain vigilant and provide further updates as needed.

Identified

Over the last period, we have observed intermittent performance degradations affecting different groups of customers. These issues were escalated to Microsoft, and temporary resolutions were achieved by restarting service nodes.

Microsoft has now provided a preliminary root cause analysis, indicating that high number of Boltrics Applications versions registered in system nodes have led to increased memory pressure, impacting performance. Microsoft have already applied several fixes and are rolling out further improvements to enhance stability.

To help mitigate the impact, we will explore any potential short-term improvements and continue working closely with Microsoft toward a lasting resolution. Ensuring a stable and reliable system for our customers remains our top priority, and we will keep you informed as we progress.

Thank you again for your patience and understanding.

Began at:

Affected components
  • Environments
    • Microsoft Cloud