Network and Services Status Page
Investigating - A network switch at the Research Institute of Aging is reloading intermittently.

Some users may be experiencing an interruption to wired and wireless network service.

IST is investigating.

Nov 20, 2024 - 14:35 EST
Investigating - A number of wall-mount, hospitality style, access points are not providing wired network service.

IST is investigating.

Oct 10, 2024 - 09:42 EDT
Monitoring - At 1700h git.uwaterloo.ca will be upgraded to 17.3.3 as part of system maintenance. This will result in one or more short downtimes, although the system should be back in service before the window is up.
Sep 17, 2024 - 16:12 EDT
Investigating - When performing an OS upgrading on mailman (lists) last night we found a hidden unsupported dependency.
No email has been lost, but it's queueing up.
We'll be stopping the service, collecting the spooled emails, reverting to the old OS, and dropping the mail back in the queue for processing.
This may take a few hours.

Sep 06, 2024 - 07:43 EDT
Investigating - IST is investigating reports for wireless problems in MC and STC.

On some APs, users are able to connect on the 2.4GHz frequency band, but not the 5GHz band. Users are experiencing poor performance due to overloaded 2.4GHz radios.

Jun 12, 2024 - 09:45 EDT

About This Site

Welcome to the University of Waterloo Network and Services Status Page. Information about the operational status of services, service degradation, and scheduled maintenance can be found on this page.

To receive an email when the operational status of a service changes, select “Subscribe to updates” at the top of the page.

All notifications about service changes will be sent from noreply@statuspage.io.

Network Major Outage
90 days ago
96.14 % uptime
Today
DNS Operational
90 days ago
100.0 % uptime
Today
DHCP Operational
90 days ago
100.0 % uptime
Today
IPAM Operational
90 days ago
95.62 % uptime
Today
Netmon Operational
90 days ago
100.0 % uptime
Today
VPN Operational
90 days ago
100.0 % uptime
Today
Internet Major Outage
90 days ago
62.78 % uptime
Today
Wireless Network Operational
90 days ago
97.3 % uptime
Today
Wired Network Major Outage
90 days ago
90.29 % uptime
Today
Application Load Balancing Operational
90 days ago
100.0 % uptime
Today
Data Center Operational
90 days ago
100.0 % uptime
Today
Border Firewall Operational
90 days ago
100.0 % uptime
Today
Data Center Firewall Operational
90 days ago
100.0 % uptime
Today
Network Authentication Services Operational
90 days ago
100.0 % uptime
Today
ISP Operational
90 days ago
100.0 % uptime
Today
SAS Operational
90 days ago
99.76 % uptime
Today
CRAC Operational
90 days ago
100.0 % uptime
Today
UPS Operational
90 days ago
100.0 % uptime
Today
Virtual Infrastructure Operational
90 days ago
99.96 % uptime
Today
Storage Operational
90 days ago
100.0 % uptime
Today
Datacentre Operational
90 days ago
100.0 % uptime
Today
mailservices Operational
90 days ago
98.62 % uptime
Today
Physical Security Operational
90 days ago
100.0 % uptime
Today
Access Control Operational
90 days ago
100.0 % uptime
Today
Video Management Server Operational
90 days ago
100.0 % uptime
Today
Other Systems Operational
90 days ago
99.99 % uptime
Today
Avaya Operational
90 days ago
100.0 % uptime
Today
Printing Operational
90 days ago
100.0 % uptime
Today
Zoom Operational
90 days ago
100.0 % uptime
Today
Webex Operational
90 days ago
100.0 % uptime
Today
Other Operational
90 days ago
99.96 % uptime
Today
Enterprise Systems Operational
90 days ago
100.0 % uptime
Today
Emergency Notifications - Regroup Operational
90 days ago
100.0 % uptime
Today
Atlassian Products Operational
90 days ago
100.0 % uptime
Today
Jira Service Management Operational
90 days ago
100.0 % uptime
Today
Jira Software Operational
90 days ago
100.0 % uptime
Today
Confluence Operational
90 days ago
100.0 % uptime
Today
Microsoft Products Operational
90 days ago
99.77 % uptime
Today
Microsoft 365 Operational
90 days ago
100.0 % uptime
Today
MS SQL Cluster Operational
90 days ago
98.62 % uptime
Today
SKYPE Operational
90 days ago
100.0 % uptime
Today
SCCM Operational
90 days ago
100.0 % uptime
Today
Sharepoint Operational
90 days ago
100.0 % uptime
Today
Exchange Operational
90 days ago
100.0 % uptime
Today
Identity Management Systems Operational
90 days ago
99.85 % uptime
Today
ADFS Operational
90 days ago
99.71 % uptime
Today
NEXUS Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.
Scheduled Maintenance
Router migration in MKV - Outage Nov 22, 2024 06:00-07:00 EST
IST network services is going to migrate the HP residential router in MKV to the new distribution router on Friday morning, Nov. 22nd, between 7:00 am and 8:00 am.
The operation will cause a brief interruption to the wire and wireless services in MKV.

Posted on Nov 20, 2024 - 10:10 EST
Quest will be unavailable for scheduled maintenance on Saturday, November 23, 2024, from 4:45 a.m. to 12 p.m. ET
Posted on Nov 14, 2024 - 16:02 EST
Quest will be unavailable for scheduled maintenance on Saturday, November 24, 2024, from 6:45 a.m. to 2:30 p.m. ET
Posted on Nov 14, 2024 - 16:04 EST
Past Incidents
Nov 20, 2024

Unresolved incident: RIA network outage - Outage.

Nov 19, 2024
Resolved - Issue was caused by failed UPS.
Nov 19, 09:27 EST
Investigating - The network is down at the IHB building.
IST network services is investigating.

Nov 19, 07:25 EST
Nov 18, 2024

No incidents reported.

Nov 17, 2024

No incidents reported.

Nov 16, 2024

No incidents reported.

Nov 15, 2024

No incidents reported.

Nov 14, 2024
Resolved - The vendor has identified and mediated the issue causing the 429 rate-limiting error.

If you continue to experience issues please contact IST Atlassian support (https://uwaterloo.atlassian.net/servicedesk/customer/portal/2/group/1616/create/1540).

Recipients: isthd, ist-staff, admin-support, faccus, ctsc, ucist

Nov 14, 14:32 EST
Update - Atlassian released a fix on the evening of Wednesday, November 6, 2024. IST has received reports of users continuing to receive the error on Thursday, November 7, 2024, after the fix was released.

Atlassian has requested that we provide the HAR files from a user actively experiencing this issue. If you can assist you can retrieve these files following the instructions in 'Generating HAR files and analyzing web requests'(https://confluence.atlassian.com/kb/generating-har-files-and-analyzing-web-requests-720420612.html) and submit them to the Atlassian support team(https://uwaterloo.atlassian.net/servicedesk/customer/portal/2/group/1616/create/1540).

Recipients: isthd, ist-staff, admin-support, faccus, ctsc, ucist

Nov 8, 10:00 EST
Investigating - What is happening? IST is aware that some users are receiving an error with the code 429 when accessing Confluence.

IST is investigating the issue with the vendor, and more information will be shared when available.

What should I do? Users should wait a few minutes and try refreshing the page. Some users may need to refresh the page multiple times to load successfully.

Questions or concerns? Please contact the Atlassian support team(https://uwaterloo.atlassian.net/servicedesk/customer/portal/2/group/1616/create/1540).

Recipients: isthd, ist-staff, admin-support, faccus, ctsc, ucist

Nov 7, 11:40 EST
Nov 13, 2024
Completed - The scheduled maintenance has been completed.
Nov 13, 23:30 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 13, 21:31 EST
Scheduled - Host updates will be applied to each cluster node

The instances that will be effected are:

sqlgeneralprod
admindb
diacampussql
idmproddb
worksreportdb

Note: Window for updates has been extended an extra hour more than usual to allow for specific updates to complete. This behaviour was shown during the dev cluster patching event and will be accommodated for in this notice.

Nov 4, 14:59 EST
Nov 12, 2024
Completed - The scheduled maintenance has been completed.
Nov 12, 07:01 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 12, 06:47 EST
Scheduled - IST network services is going to migrate the HP residential router in V1 to the new distribution router on Tuesday morning, Nov. 12th, between 7:00 am and 8:00 am.
The operation will cause a brief interruption to the wire and wireless service in V1.

Nov 8, 10:40 EST
Completed - The scheduled maintenance has been completed.
Nov 12, 07:00 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 12, 06:00 EST
Scheduled - IST Network Services will be performing maintenance on two datacenter switches (cr-pod2-bb2-a/cr-pod2-bb2-b) to add support for jumbo frames for some newly attached storage appliances. This maintenance will happen between 7am - 8am on Tuesday, Nov, 12th.

No impact to services is anticipated during this maintenance.

Nov 4, 13:13 EST
Nov 11, 2024

No incidents reported.

Nov 10, 2024
Completed - The scheduled maintenance has been completed.
Nov 10, 14:00 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 10, 07:00 EST
Scheduled - Quest will be unavailable for scheduled maintenance on Sunday, November 10, 2024 from 8 a.m. to 3 p.m. ET
Nov 1, 09:08 EDT
Nov 9, 2024

No incidents reported.

Nov 8, 2024
Completed - The scheduled maintenance has been completed.
Nov 8, 14:00 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 21, 07:01 EDT
Scheduled - Redundant fibre for east campus (1,2,3,4,5) and ec2 data centre is being migrated over the next three weeks due to construction. Services will operate, redundancy will be lost while the new fibre is being spliced.
Oct 18, 07:11 EDT
Completed - The scheduled maintenance has been completed.
Nov 8, 07:00 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 8, 06:01 EST
Scheduled - Friday November 8th at 7:00 AM, maintenance will be performed on a network router in DC.

The device mc-cs2 will be reloaded in order to fix an IPv6 routing bug.

There will be a partial outage for some locations in DC while the device reboots.

Nov 6, 13:05 EST
Completed - The scheduled maintenance has been completed.
Nov 8, 06:30 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 8, 06:01 EST
Scheduled - ICT protege will be unavailable while the server reboots after a software update during this service window.
This will affect updates via the doorsmanager software as well.

Nov 7, 09:18 EST
Nov 7, 2024
Resolved - IST Network Services will be migrating the FCR-CS-RT Cisco Nexus equipment to the new distribution switch on the morning of Thurs, Nov, 7th between 7am - 8am.

There will be a brief outage of layer3 traffic expected during this task.

Nov 7, 08:03 EST
Investigating - IST Network Services will be migrating the FCR-CS-RT Cisco Nexus equipment to the new distribution switch on the morning of Thurs, Nov, 7th between 7am - 8am.

There will be a brief outage of layer3 traffic expected during this task.

Nov 4, 13:17 EST
Nov 6, 2024
Completed - The scheduled maintenance has been completed.
Nov 6, 07:00 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 6, 06:01 EST
Scheduled - IST network services is going to perform a system reloading of one of the switches on 3rd floor in DC on Nov. 6th between 7:00 am and 8:00 am.
The operation is to fix the remote management issue to the switch.

Nov 4, 15:06 EST