Skip to main content

Performance Issue Identified | November 29, 2022

Comments

2 comments

  • Official comment
    Adam Elliott

    CivicPlus Incident Report: Service Disruption on 11/29/2022 

    Incident Description
    On November 29, 2022 at 1:52pm CST CivicPlus monitoring services alerted engineering staff of a system outage for CivicPlus Authentication (single sign-on service). CivicPlus System Engineers immediately identified the root cause of the issue and initiated steps to resolve the outage. As a result of their effort, the CivicPlus Authentication resumed service at 1:55pm CST.

    Cause
    CivicPlus Engineers attempted to deploy code changes to the CivicPlus Authentication Service via a continuous integration pipeline. A change in database configuration was not included prior to the deployment causing a system outage.

    Resolution
    CivicPlus engineers deployed database changes at which point the CivicPlus Authentication service proceeded to return to normal expected functionality.

    Preventative Measures
    CivicPlus Engineers have made adjustments to our deployment process flow to ensure database changes are deployed prior to any related changes to underling system code.

    We believe this change will adequately address the root cause of this incident and no further updates for this incident are planned.

  • Adam Elliott

    CivicPlus Systems Engineers have applied a fix and have restored service to your CivicPlus Solution. An incident report will be posted here within 24 business hours.

    0

Available Templates

No Change Update

CivicPlus Systems Engineers continue to work on resolving this issue as quickly as possible. An update will be added to this post when it is available.

Timeline Identified

CivicPlus Systems Engineers have identified the issue and expect to have a resolution deployed by ESTIMATED TIMELINE (if not a specific date, include business hours / business days clarification).

Fix Implemented

CivicPlus Systems Engineers have applied a fix and have restored service to your CivicPlus Solution. An incident report will be posted here within 24 business hours.

Please sign in to leave a comment.