This page contains all current information on the status of this incident.
Incident Details | |
---|---|
Incident Status | closed |
Services Impacted |
Smarthub
Payment Gateway Mosaic Messenger iVUE Connect Service iVUE Connect Operations iVUE Connect Financials Cloud Portal Call to Order ASP AppSuite |
Impact Level | Service Outage |
Start Time | 2025-05-20 09:45 CDT |
End Time | 2025-05-20 13:05 CDT |
Description | We are investigating an issue with all NISC cloud services. |
NISC Community post | Click here for more details |
Incident Updates | |
---|---|
Time | Detail |
2025-05-20 10:07:47 CDT | We have identified an issue at our Mandan datacenter and are actively working toward a resolution. |
2025-05-20 10:23:18 CDT | NISC experienced a power issue in one of our datacenters. The impacts were primarily iVUE ASP and the Payment gateway but the surge of failed requests did back up calls to applications in other datacenters and AWS. Services are recovering now. iVUE ASP members will take longer to recover. Updates will be posted here. |
2025-05-20 10:30:03 CDT | The NISC payment gateway is taking payments again as of 10:09am CT. It stopped taking payments around 9:51am CT. Services continue to recover. Updates will be posted here. |
2025-05-20 10:40:20 CDT | iVUE ASP systems continue to come online. It takes time to get them all healthy again. Most other services have recovered. Updates will be posted here. |
2025-05-20 11:06:27 CDT | Some ASP members have recovered but some are still coming online or having other issues from the fall out. The NISC team continues work on ASP recovery. Updates will be posted here. |
2025-05-20 11:26:24 CDT | For some clarity, the power issues happened between 9:50am and 10:10am central time in one datacenter. The main impacts were to the NISC payment gateway which was back online at 10:09am and to NISC iVUE ASP sites. Some of the iVUE ASP sites were recovered by 10:17am but there are some that are up but having issues that the NISC team is following up on. There was a brief period of time where services in other datacenters were impacted with backed up calls as a result but they recovered quickly after the power issues were resolved. Updates on the ASP sites will be posted here. |
2025-05-20 12:06:38 CDT | The NISC team is working through a list of hosted iVUE ASP sites now to get them back up and running. Their systems are running but some came up out of order with database or other timing issues. The team is working on automation to speed up the recovery. Updates will be posted here. |
2025-05-20 13:04:24 CDT | The large majority of hosted iVUE ASP sites are recovered. If you are running iVUE ASP and are still having issues, please contact tech support. We continue to monitor and will leave this incicdent open for now. |
2025-05-20 13:38:29 CDT | Hosted iVUE ASP sites continue to look good overall. We are closing this incident. If you are running iVUE ASP and are still having issues, please contact tech support. |