Research Storage and Compute Outage
Investigating - Users reported issues in utilizing RIS storage and compute resources (including but not limited to Open OnDemand, SSH, and SMB storage). We are working diligently to restore services as quickly as possible.
May 09, 2024 - 08:23 CDT
Service Degradation - High Severity: Avaya One X Agent
Update - WashU IT and BJC technical teams continue to troubleshoot Avaya issues with the vendor.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
May 07, 2024 - 16:31 CDT
Update - WashU IT and BJC technical teams are investigating issues with the Avaya One X Agent. We believe the current fix has mitigated user impact at least temporarily. We are monitoring the environment and will evaluate additional corrective actions next week.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 18, 2024 - 18:03 CDT
Update - The change over the weekend does not appear to have improved performance.

An additional change was performed this morning.

Teams will be performing additional testing to evaluate the effectiveness of the change.
Apr 15, 2024 - 11:45 CDT
Investigating - WashU IT and BJC technical teams are investigating issues with the Avaya One X Agent. Technical teams implemented a possible fix but found that the issue was not resolved. An additional change is being scheduled for Sunday 4/14; the next update will come on Monday 4/15 once the change has been evaluated for effectiveness.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 11, 2024 - 16:56 CDT
Identified - WashU IT and BJC technical teams are investigating issues with the Avaya One X Agent. Technical teams have identified a potential fix and are working to validate it with the vendors.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 10, 2024 - 18:06 CDT
Update - WashU IT and BJC technical teams are investigating issues with the Avaya One X Agent. Technical teams have continued to work with the Avaya vendor to test and troubleshoot the issue but have not yet been able to identify root cause. Our next step will be to escalate our support case with Cisco for help analyzing firewall and network configuration, and we will continue to work with Avaya as they continue their analysis of the data we have provided them today.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 09, 2024 - 18:01 CDT
Update - WashU IT and BJC technical teams are investigating issues with the Avaya One X Agent. After some technical discussion, additional troubleshooting is needed before we can continue working on a resolution. Technical teams will reconvene the call on Tuesday morning at 9am.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 08, 2024 - 17:06 CDT
Investigating - WashU IT and BJC technical teams are investigating issues with the Avaya One X Agent. An upgrade was performed in February and appeared stable initially. Since then, an increasing number of remote users on WashU VPN have been reporting issues with audio dropping and similar issues affecting their Avaya service.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 08, 2024 - 14:53 CDT

About This Site

WashU IT's Service Dashboard gives you real-time updates on system performance issues. If you require assistance, please call our Service Desk at 314-933-3333.

Administrative & Enterprise Systems Operational
Alumni and Development Information System (ADIS) Operational
Research Management System (RMS) Operational
Student Information System (SIS) Operational
Vended Applications ? Operational
Cognos Reporting Operational
Marketplace Operational
Vended Applications ? Operational
Workday ? Operational
SUBS Awards ? Operational
Bear Bucks ? Operational
Back-end Processing (AutoSys) ? Operational
Confluence Operational
Archibus Operational
Mulesoft ? Operational
Clinical Operational
EPIC Operational
Vended Applications Operational
Clinical Websites Operational
Credit Card Systems ? Operational
Communications & Collaboration Operational
Email Operational
Office 365 Operational
Microsoft Teams Operational
Maestro mass communication system Operational
Zoom Operational
Box File Storage System ? Operational
WUSTL Connect ? Operational
Computing and Printing Operational
E-Fax Operational
PaperCut Printing Operational
WashU Cloud Storage Operational
Azure Hosted Infrastructure Operational
WashU IT Services / Cloud Computing ? Operational
Desktop Computing ? Operational
File Services Operational
IT Infrastructure Components ? Operational
JAMF Apple Device Management System ? Operational
IT Management Operational
Software Licensing Operational
ServiceNow ? Operational
Network & Connectivity Operational
Internet Operational
Internet 2 Operational
Phone Operational
VPN Operational
WiFi Operational
Washington University Research Network (WURN) Operational
Vendor Services (Spectrum, AT&T, etc.) ? Operational
Network Services ? Operational
Research Partial Outage
Research Compute Partial Outage
Storage Partial Outage
Security Operational
Identity Management System (IDM Wustl Key) Operational
Spam Filter Operational
Duo Two-Factor Authentication ? Operational
Digital Guardian Operational
Teaching & Learning Operational
Canvas Operational
Learn@Work Operational
Kaltura ? Operational
Curriculum Management Applications ? Operational
EMS (Event Management System) ? Operational
University Websites Operational
WashU IT Hosted Websites Operational
Externally Hosted Websites Operational
BJC Devices and Services Degraded Performance
BJC Network Connectivity ? Operational
BJC Clinical Applications Operational
BJC Pharmacy POS Machines ? Operational
BJC Phone System Degraded Performance
BJC Handheld Supply Scanners (ATPAR) ? Operational
BJC Administrative Systems ? Operational
BJC Enterprise Client Virtualization (ECV) Operational
Cloud Services Operational
Google Operational
Engineering School Operational
Vendor Service ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
May 12, 2024

No incidents reported today.

May 11, 2024

No incidents reported.

May 10, 2024

No incidents reported.

May 9, 2024

Unresolved incident: Research Storage and Compute Outage.

May 8, 2024
Vendor Service Advisory - ServiceNow Discovery
Resolved - WashU IT has determined that the impact of this issue is at a low point and that the Major Incident is resolved. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
May 8, 17:00 CDT
Update - WashU has provided the vendor with additional information.

The vendor is analyzing this information to determine next-steps.

There is no ETA at this time.
Apr 15, 11:38 CDT
Investigating - WashU IT is aware of an issue affecting the automatic discovery processes within ServiceNow following a recent upgrade.

This issue affects a small number of users and is not business-critical.

The vendor is aware of the issue and working to resolve it.
Apr 9, 11:29 CDT
Service Outage - Low Severity: Eduroam Wifi Network @ Siteman South County
Resolved - WashU IT Engineers have resolved the issue affecting the Eduroam wireless network at the Siteman South County location. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
May 8, 12:55 CDT
Investigating - WashU IT is investigating reports that users at Siteman South County are unable to connect properly to the Eduroam wireless network. Other wireless networks are not affected.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
May 8, 12:17 CDT
May 7, 2024
Service Outage - High Severity: Microsoft Teams
Resolved - WashU IT Engineers have monitored Microsoft Teams for an extended period and have not observed any additional issues related to the previous outage. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident
May 7, 16:28 CDT
Monitoring - Teams are continuing to monitoring the service which appears to have recovered for most users.

If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
Apr 25, 12:37 CDT
Update - WashU IT is investigating reports of Microsoft Teams slow performance or users being unable to login. Microsoft determined that the issue we are reporting is unrelated to the other issues they were investigating. Technical teams have continued to troubleshoot with the vendor throughout the day.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 24, 18:48 CDT
Update - WashU IT is investigating reports of Microsoft Teams slow performance or users being unable to login. Microsoft has posted a notification that they are receiving increased user reports of Teams issues and are investigating a possible service outage.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 24, 11:08 CDT
Update - WashU IT is investigating reports of Microsoft Teams slow performance or users being unable to login. Technical teams continue to work directly with Microsoft to understand the root cause of the issues and find a workaround.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 23, 17:28 CDT
Update - WashU IT is investigating reports of Microsoft Teams slow performance or users being unable to login. Microsoft is escalating our support case after jointly troubleshooting several affected computers.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 23, 14:35 CDT
Update - WashU IT is investigating reports of Microsoft Teams slow performance or users being unable to login. We are working with Microsoft to troubleshoot the issue, but currently they do not have a root cause identified.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 23, 12:06 CDT
Investigating - WashU IT is investigating reports of Microsoft Teams slow performance or users being unable to login. Initial indications are that this may be an issue on the vendor's service rather than a WashU issue.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 23, 09:35 CDT
May 6, 2024

No incidents reported.

May 5, 2024
WUSM-Secure WiFi on the WUSM/BJC Campus
Completed - The scheduled maintenance has been completed.
May 5, 15:00 CDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 4, 08:00 CDT
Update - BJC IT and WashU IT will perform maintenance on network appliances which support WUSM-Secure WiFi on the WUSM/BJC campus on May 4 and 5.

WUSM Secure WiFi will be unavailable on the Medical School / BJC Campus today, May 4, between 12:00pm and 7:00pm. Please use the Eduroam or Guest wireless network during this downtime.

You may also experience intermittent disruptions during the maintenance window, today, May 4, at 11:00am through tomorrow, May 5, at 3:00pm.
May 3, 13:19 CDT
Scheduled - BJC IT and WashU IT will perform maintenance on network appliances which support WUSM-Secure WiFi on the WUSM/BJC campus on May 4 and 5.

WUSM Secure WiFi will be unavailable on the Medical School / BJC Campus today, May 4, between 12:00pm and 7:00pm.  Please use the Eduroam or Guest wireless network during this downtime.

You may also experience intermittent disruptions during the maintenance window, today, May 4, at 11:00am through tomorrow, May 5, at 3:00pm.
May 2, 16:04 CDT
May 4, 2024
May 3, 2024
VPN Maintenance
Completed - The scheduled maintenance has been completed.
May 3, 00:00 CDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 2, 23:00 CDT
Scheduled - We will perform maintenance on the WashU VPN tonight, May 2, between 11:00pm and Midnight.

VPN sessions may be interrupted during the maintenance window, requiring you to reconnect to VPN using Cisco Secure Client.

Have questions? Email ithelp@wustl.edu, referencing CHG0051454
May 2, 16:00 CDT
May 2, 2024
May 1, 2024
Service Outage - High Severity: Workday Unavailable
Resolved - WashU IT Engineers have resolved the issue affecting Workday. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
May 1, 17:14 CDT
Monitoring - WashU IT is investigating an issue with Workday being unavailable or experiencing performance issues. A support ticket has been opened with the vendor. At this time Workday appears to have recovered to normal operations, but technical teams are monitoring the environment.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
May 1, 16:59 CDT
Apr 30, 2024

No incidents reported.

Apr 29, 2024

No incidents reported.

Apr 28, 2024
Service Outage - High Severity: Intermittent Wifi and VPN Authentication
Resolved - Services remain healthy, this incident is now resolved.

WashU will continue working with the vendor to understand root-cause.
Apr 28, 15:51 CDT
Update - All services have been restored.

Teams are continuing to monitor service health and working with the vendor to determine root-cause.
Apr 19, 13:43 CDT
Monitoring - WashU IT has introduced a possible fix for wireless and VPN issues.

Teams are continuing to monitoring the service. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
Apr 17, 08:00 CDT
Update - WashU IT is investigating sporadic reports of users being unable to connect to VPN and Wifi. Existing connections do not appear to be affected. The environment currently appears stable, but technical teams will monitor and take action if issues reoccur overnight. Additional troubleshooting and investigation will resume on Wednesday morning.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 16, 22:47 CDT
Update - WashU IT is investigating sporadic reports of users being unable to connect to VPN and Wifi. Existing connections do not appear to be affected. Technical teams have observed indications that an issue is still occurring intermittently; troubleshooting continues, and a support case was opened with the vendor for additional assistance.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 16, 19:46 CDT
Update - WashU IT is investigating sporadic reports of users being unable to connect to VPN and Wifi. Existing connections do not appear to be affected. Technical teams are troubleshooting and have a support case open with the vendor.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 16, 18:23 CDT
Investigating - WashU IT is investigating reports of users being unable to connect to VPN and Wifi. Existing connections do not appear to be affected.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Apr 16, 17:02 CDT
← Incident History Powered by Atlassian Statuspage