Short circuit
Electrical work can create the potential for electrical hazards, accidents and associated power outages. In this case study, an electrical contractor was expanding on a newly installed 15,000V (15kV) distribution system. A dedicated electrical-service space was being constructed in a critical, process-based facility in British Columbia. The contractor was in the process of running a 15kV feeder circuit to connect an existing load to the new distribution system and new medium voltage cables had been run in anticipation of an upcoming shutdown to make the final connections. Prior to the shutdown, the contractor was performing some final checks within the 15kV switchgear and accidently energized the 15kV circuit. The new MV cables, which were left unterminated and coiled together, became energized and created a three-phase bolted fault. The accidental energization resulted in a short-circuit event of about 10,000A and was near the maximum fault level stipulated by the local utility. Multiple medium voltage circuit breakers tripped as a result of the fault, including a main breaker in the service entrance switchgear for the site. The facility’s standby generators came online, due to the tripped circuit breakers and powered the facility for a number of hours, until the a procedure to properly isolate the circuit was implemented and utility power was restored. Fortunately, no injuries occurred and a subsequent assessment revealed that no damage to equipment or cables occurred, with the exception of the cable ends, which were cut back several inches.
Failed transformer
Facilities often rely on service groups to perform routine electrical tests, circuit switching and isolation requests. The exact switching procedure is typically left up to the service group and they are responsible for operating distribution equipment. In this case study, a service contractor was manually switching between utility power and standby generator power via a set of 480V circuit breakers. The system was placed into manual operation, utility power breakers were opened, standby generation was brought online and generator breakers were closed to provide power to the switchboard. When it came time to return to utility power, the utility power breaker was inadvertently closed, while the standby generators were still powering the switchboard. The switchboard did not have any synch-check protection, paralleling equipment or interlocks. The individual generator breakers tripped open several seconds after the unintended paralleling condition was created. Unfortunately, large magnitude currents had circulated within the distribution system, before the generator breakers tripped. These large magnitude currents created significant magnetic forces, which damaged bus work in a dry-type transformer that was close coupled to the switchboard. The bus work was bent outwards and insulating paper covering a portion of the bus was dislodged, creating a condition where uninsulated bus was bent into contact with the grounded steel frame, supporting the core and coil assembly. The resulting line to ground fault melted the entire bus connection, until the phase to ground fault was eliminated and the bus connection was no longer in contact with the steel frame. Fortunately, proper safety procedures had been followed and no one was injured in this incident. The switchboard was supplied with power from a redundant transformer and the damaged transformer was permanently removed from service. The facility subsequently shifted downstream loads to other distribution within the building, to further offload the remaining transformer.
Latent installation defects
Electrical failures can also occur unexpectedly within a distribution system, without any precipitating factors such as electrical work or switching operations. A variety of recent cases come to mind, with causes that include latent installation defects, utility supply issues and failures related to aging electrical infrastructure. A critical facility, in the Greater Toronto Area, experienced a localized extended power outage for several weeks, when a dry-type transformer unexpectedly failed. The dry-type transformer provided essential power to both occupied areas in the building and critical process-based loads. The transformer had been recently upgraded to a new energy-efficient model and the replacement core and coil assembly had been site installed, due to space limitations and access requirements for a newly manufactured unit. The failure analysis confirmed that low-voltage control wiring for power metering had been installed in close proximity to uninsulated 5kV buswork and a flashover had occurred due to the insulation rating of the wiring and insufficient physical clearance. Operations were shut down in the affected area until a refurbished transformer was sourced and installed.
In another example, an Ontario- based electric utility experienced an outage to one phase in a distribution circuit, when parallel fuses for one of the phases in a disconnect switch unexpectedly blew. The utility replaced the blown fuses and restored power within several hours. However, by this time the facility had determined that several 30 hp motors, critical to the central plant’s chilled water and condenser water system, had burned out due to the single-phasing condition and inadequate motor overload protection. Mechanical services were interrupted for 15 hours while motors were replaced. In yet another example, an underground 5kV distribution cable, in an institutional campus, unexpectedly failed after approximately 25 years in service. Temporary generators were brought in for a week, until a portion of the failed cable could be removed and re-fed with replacement cable. While the cable had not yet reached statistical end-of-life conditions, it was determined that the early failure was attributed to physical damage, which had reduced the cable’s anticipated life expectancy.
Modes of failure
How can an operations manager plan for an unexpected electrical outage in their facility? To start, a well-structured preventative maintenance program and an infrastructure review can help diagnose potential risks. Is equipment being maintained and are recommended diagnostic tests being performed? Equipment should be reviewed for age and reliability. Consideration should be given for redundancy in the power distribution system and how the failure of a particular component could affect continued operation. Taking meter readings on a frequent basis will confirm if there has been any load growth and how load is segmented throughout a distribution system. If metering is unavailable, consideration should be given for installing permanent metering or taking readings with a portable meter. Operational data can be used to expand on a facility’s electrical single-line diagram and performing a detailed review can determine options for supporting load in emergency situations. Emergency scenarios should include how critical loads are supported during an extended utility outage, how load can be supported during equipment failures (transformers, switchboards, panels and main feeders), points in a distribution system for connecting a temporary generator and options for interlocked tie connections. Abbreviated single line diagrams for modes of failure and electrical load data can be used to create a standard operating procedure (SOP), in the event of an unexpected power outage. A well-developed SOP will include detailed, step-by-step operations to help diagnose an electrical outage, isolate faulted equipment if applicable and restore power using alternative means, if available. Photographs of equipment should be included and operating switches, buttons and HMI screens should be identified. Having a guide readily available will increase response times and decrease downtime.
Plan ahead
To complement the effectiveness of standard operating procedures, any work performed on a power distribution system should be subject to a detailed method of procedure (MOP). A typical MOP will outline a step-by-step procedure for work being performed and includes information on demarcation of work (who is doing what?), the duration of tasks, a back-out plan to deal with the unexpected occurrences and a list of emergency contacts. A dry-run of switching operations and load transfers should be performed in advance of a planned shutdown, especially when a number of complex switching operations and load transfers are involved. Operations staff should actively participate in the process, as this will further develop familiarity with a power distribution system and mitigate risk when electrical work is being performed. Consideration should also be given to providing regular training sessions on electrical systems for operators. Training should focus on the topology and equipment in the distribution system, facility procedures (SOPs and MOPs), preventative maintenance requirements and general troubleshooting practices. Having well-trained operations staff will not only ensure that a facility’s first responders can effectively deal with issues when they arise but also ensure outside contractors follow an approved procedure before commencing work.
Unexpected electrical outages in a facility can be caused by a variety of factors, including electrical work, routine switching operations, issues with the incoming utility supply, or aging infrastructure. A proactive approach to managing an electrical power distribution system and maintaining emergency preparedness should include: a well-developed preventative maintenance program; the creation of SOPs to identify an approved response to emergency scenarios and to troubleshoot issues; MOPs for all electrical work, including preventative maintenance and isolation procedures; and having regular training sessions for operations staff. Undertaking a detailed needs assessment will help a facility review procedures currently in place, identify any shortcomings with existing practices and provide opportunities for improvement. Creating documentation for SOPs, MOPs and training will typically involve a detailed review of existing systems, creating a site-specific set of procedures, and drawing upon industry standards and best operational practices. By investing in a plan for emergency preparedness, operations managers can equip their staff with the knowledge to deal with the next electrical outage, thereby increasing response times, decreasing downtime and ensuring their facility remains operational.
