Performance Issue Identified | November 29, 2022
CivicPlus monitoring has detected a possible performance issue that may be affecting your CivicPlus solution. CivicPlus Systems Engineers are investigating this alert and a timeline to resolution and next steps will be provided as soon as available.
Comments
2 comments
-
Official comment
CivicPlus Incident Report: Service Disruption on 11/29/2022
Incident Description
On November 29, 2022 at 1:52pm CST CivicPlus monitoring services alerted engineering staff of a system outage for CivicPlus Authentication (single sign-on service). CivicPlus System Engineers immediately identified the root cause of the issue and initiated steps to resolve the outage. As a result of their effort, the CivicPlus Authentication resumed service at 1:55pm CST.Cause
CivicPlus Engineers attempted to deploy code changes to the CivicPlus Authentication Service via a continuous integration pipeline. A change in database configuration was not included prior to the deployment causing a system outage.Resolution
CivicPlus engineers deployed database changes at which point the CivicPlus Authentication service proceeded to return to normal expected functionality.Preventative Measures
CivicPlus Engineers have made adjustments to our deployment process flow to ensure database changes are deployed prior to any related changes to underling system code.We believe this change will adequately address the root cause of this incident and no further updates for this incident are planned.
-
CivicPlus Systems Engineers have applied a fix and have restored service to your CivicPlus Solution. An incident report will be posted here within 24 business hours.
0
Please sign in to leave a comment.
Available Templates
No Change Update
CivicPlus Systems Engineers continue to work on resolving this issue as quickly as possible. An update will be added to this post when it is available.Timeline Identified
CivicPlus Systems Engineers have identified the issue and expect to have a resolution deployed by ESTIMATED TIMELINE (if not a specific date, include business hours / business days clarification).Fix Implemented
CivicPlus Systems Engineers have applied a fix and have restored service to your CivicPlus Solution. An incident report will be posted here within 24 business hours.