2026-02-04 07:15:00 CST - We are currently experiencing issues with DNS/Connectivity in the ASP environment that may be causing impact on iVUE systems in the ASP environment. We are investigating and will provide updates as soon as we have more info.
2026-02-04 08:37:45 CST - We are investigating increased load in our ASP environment. We see the load stabilized at 8:10 CST.
2026-02-04 09:20:59 CST - We performed updates to our infrastructure around 9am CST. We have seen improvement with DNS/Connectivity in the ASP environment. We are continuing to monitor.
2026-02-04 09:38:21 CST - UDP flood protection in NISC’s private datacenter began impacting ASP 1.0 environments this morning, resulting in DNS-related service disruption. ASP members hosted in AWS were not directly affected.
However, the high volume of ASP 1.0 members experiencing DNS issues caused Cloud Portal and SmartHub requests to queue, leading to intermittent performance impacts for all members using cloud-based applications.
The most significant Cloud Portal response time spikes occurred from 8:01–8:05 a.m. CT and again from 9:01–9:05 a.m. CT, with elevated response times observed between those intervals.
These incidents will remain open while monitoring continues.
2026-02-04 10:05:53 CST - We are seeing increased load again at 10:01am CST. We are investigating.
2026-02-04 11:08:15 CST - Cloud portal has been spiking load at 8:01CT, 9:01CT, and 10:01CT for four min each time. A new round of spikes started at 10:52am CT and are persisting. These cloud portal load spikes have impacts to iVUE connect and other applications. The NISC team is working the problem and will post updates here.
2026-02-04 11:27:42 CST - Cloud applications including cloud portal and ivue connnect continue to be impacted by high load spikes. The team is making ajustments that are slowly improving load but impacts remain. The NISC team continues to work the problem and updates will be posted here.
2026-02-04 11:34:02 CST - Cloud poral load at normal levels as of 11:29am CT. Overall things are improving but some services will could take a bit to fully recover. The NISC team continues to work the issue and will post updates here.
2026-02-04 11:51:10 CST - Cloud portal and iVUE connect continues to look healthy as of 11:29am CT. The NISC team continues to monitor. Updates will be posted here.
2026-02-04 12:09:10 CST - The NISC team has made several adjustments to manage the hourly load spike just after the top of the hour. The spike happened again at 12:01pm CT and is recovering. There were impacts to cloud portal and iVUE connect service. The NISC team continues to work the issue. Updates will be posted here.
2026-02-04 12:44:19 CST - Cloud portal and other cloud services continue to look healthy after the load spike that ended around 12:06pm CT. The team has made additional changes to isolate calls, gain visibility, and scale. We will monitor at 1:00pm CT for load spikes. Updates will be posted here.
2026-02-04 13:09:01 CST - Monitoring shows the hourly load spike has happened again at 1:01pm CT and is recovering after 4-5 min like last hour. There were impacts to cloud applications during this time. The team has more than doubled cloud portal resources, isolated API calls, and made other changes for visibility. The team continues to work the issue and updates will be posted here.
2026-02-04 14:06:38 CST - Monitoring shows the hourly load spike has happened again at 2:01pm CT and is recovering after 4-5 min like last hour. There were impacts to cloud applications during this time. The team has some follow up items before 3pm CT. The team continues to work the issue and updates will be posted here.