Thursday, June 3, 2010

25 Standard Deviation Moves

A Reuters Breakingviews commentary in today’s New York Times makes some interesting arguments about the consequences of the BP oil spill on the energy industry. The commentary draws parallels between BP and the financial implosion that led to Lehman Brothers bankruptcy. ". . . flawed risk management, systemic hazard, and regulatory incompetence" are cited as the common causes, and business models that did not take account of the possibility for "25 standard deviation moves". These factors will inevitably lead to government intervention and industry consolidation as the estimated $27 billion in claims (a current estimate for the BP spill) is ". . . a liability no investor will be comfortable taking, . . ."

While much of this commentary makes sense, we think it is missing a big part of the picture by not focusing on the essential need for much more rigorous safety management. By all reports, the safety performance of BP is a significant outlier in the oil industry; maybe not 25 sigma but 2 or 3 sigma at least. We have posted previously about BP and its safety deficiencies and its apparent inability to learn from past mistakes. There has also been ample analysis of the events leading up to the spill to suggest that a greater commitment to safety could, and likely would, have avoided the blowout. Safety commitment and safety culture provide context, direction and constraints for risk calculations. The potential consequences of a deep sea accident will remain very large, but the probability of the event can and should be brought much lower. Simply configuring energy companies with vastly deep pockets seems unlikely to be a sufficient remedy. For one, money damages are at best an imperfect response to such a disaster. More important, a repeat of this type of event would likely result in a ban on deep sea drilling regardless of the financial resources of the driller.

In the nuclear industry the potentially large consequences of an incident have, so far, been assumed by the government. In this respect there is something of a parallel to the financial crisis where the government stepped in to bail out the "too large to fail" entities. Aside from the obvious lessons of the BP spill, nuclear industry participants have to ensure that their safety commitment is both reality and public perception, or there may be some collateral damage as policy makers think about how high risk industry, including nuclear, liabilities are being apportioned.

Tuesday, June 1, 2010

Underestimating Risk and Cost

Good article in today's New York Times Magazine Preview about economic decision making in general and the oil industry in particular. In summary, when an event is difficult to imagine (e.g., the current BP disaster), people tend to underestimate the probability of it occurring; when it's easier to imagine (e.g., a domestic terrorist attack after 9/11), people tend to overestimate the probability. Now add government caps on liability and decision-making can get really skewed, with unreasonable estimates of both event-related probabilities and costs.

The relevance of this decision-making model to the nuclear industry is obvious but we want to focus on something the article didn't mention: the role of safety culture. Nuclear safety culture guides planning for and reacting to unexpected, negative events. On the planning side, culture can encourage making dispassionate, fact-based decisions regarding unfavorable event probabilities and potential consequences. However, if such an event occurs, then affected personnel will respond consistent with their training and cultural expectations.

Wednesday, May 26, 2010

Oil and Nuclear – Again

We saw an essay on Clean Skies that suggests the oil industry could learn from the nuclear industry, in particular, that the oil industry should adopt international standards of practice similar to the nuclear industry’s response to Chernobyl. We totally agree. The one point we would add is that the single most important thing the oil industry could learn from nuclear is the significance of establishing and maintaining an adequate safety culture. Safety culture is the sine qua non of safe, profitable operations in any high-hazard business.

And safety culture has to be real. Beleaguered executives proclaiming that safety is number are simply not convincing when equipment and methods haven’t been tested (or don’t work), and profit has obviously been driving decision-making.

We want to remind the nuclear industry that they are one significant incident away from an even worse political and public relation disaster. As we have said before, the oil industry is not as tightly interwoven in the public mind as nuclear; to date, BP is being vilified in Washington and in the press, but the damage to other companies has been incidental, a temporary stop in issuing drilling permits. The nuclear industry would not get off so relatively easy if an incident of similar magnitude were to occur in their bailiwick.


Monday, May 17, 2010

How Do We Know? Dave Collins, Millstone, Dominion and the NRC

This week the issues being raised by former Dominion engineer David Collins* regarding safety culture at Millstone are receiving increased attention. It appears David is raising two general issues: (1) Is Dominion's safety culture being eroded due to cost and competitive pressures and (2) is the NRC being effective in its regulatory oversight of safety culture?

So far the responses of the various players are along standard lines. Dominion contends it is simply harvesting cost efficiencies in its organization without compromising safety and specific problems are isolated events. The NRC has referred the issues to its Office of Investigation thus limiting transparency. INPO will not comment on its confidential assessments of nuclear owners.

What is one to make of this? First we have no special insights into the bases for the issues being raised by Collins. We have interacted with him in the past on safety culture issues and he is clearly a dedicated and knowledgeable individual with a strong commitment to nuclear safety culture. Thus we would be inclined to give his allegations serious consideration.

On the broader issues we see both opportunities and risks. We have emphasized cost and competitive pressures as a key to understanding how safety culture must balance multiple priorities to assure safety. What we do not see at the moment is how Dominion, the NRC or INPO would be able to determine whether, or to what extent, such pressures might be impacting decisions within Dominion. We doubt whether current approaches to assessing safety culture can be determinative; e.g., safety culture surveys, NRC performance indicators, or INPO assessments. In addition a plant-centric focus is unlikely to reveal systemic interactions or top-down signals that may result in decisional pressure at the plant levels. Recall that a significant exogenous pressure cited in the space shuttle Challenger accident was Congressional political pressure.

So while we understand the nature of the processes underway to evaluate Collins’ issues, it would be helpful if any or all the organizations could explain their methods for assessing these type of issues and the objective evidence to be used in making findings. The risk at this point is that the industry and NRC appear to be more focused on negating the allegations than in taking a hard look at their possible merits, including how exactly to evaluate them.

* Follow the link below for an overview of Collins' issues and other parties' responses.

Monday, May 10, 2010

EUCG Recognizes Safety Culture's Importance

Today's EUCG* press release on their Spring meeting highlights their discussions on, among other topics, safety culture and safety performance. One quote from an EUCG executive caught our attention: "Data are emerging that a company's safety performance correlates strongly with other performance measures such as profitability, customer satisfaction and service reliability."

We are happy to see other organizations recognize the importance of safety culture but their realization of positive correlation among performance measures is hardly new. For example, back in the 1990s we saw that the best nuclear industry plants were top quartile performers in production, cost AND safety. We recommended to our clients that it was reasonable, even essential, for them to aspire to top-level performance in all three dimensions.

* EUCG used to be (and perhaps still is) the Electric Utility Cost Group. Initially, they focused on sharing various cost performance data among their members, now it appears they are also collecting and sharing other data.

Friday, May 7, 2010

Why Nuclear is Better than Oil

Today's New York Times has an article whose title says it all, "Regulator Deferred to Oil Industry on Offshore Rig Safety." It turns out the the Minerals Management Service, an Interior Department agency, is charged both with regulating the oil industry and with collecting royalties from it. The article goes to to say that the trend in other parts of the world is to separate these functions.

We wring our hands on this blog about creeping complacency, normalization of deviance, and failure to sufficiently acknowledge conflicting goals in nuclear plant operations. But we don't have to bang the drum about getting a dedicated safety regulator; the NRC was created in 1974 specifically to separate the government's promotional and regulatory roles in the nuclear industry.

Monday, May 3, 2010

Testing Positive - the NRC on Safety Culture

We have been spending some time with the NRC’s draft statement of policy on safety culture published in the Federal Register on November 6, 2009.*

The initial Commission policy statement on safety culture in 1989 simply referred to “safety culture”. The current statement initially refers to the need for a “strong” safety culture (“It is the Commission’s policy that a strong safety culture is an essential element for individuals . . . .”) but then settles on “positive” safety culture as the fundamental expectation of the policy (“licensees . . . should foster a positive safety culture in their organizations and among individuals . . . .”) (p. 57526) The NRC provides its definition of “safety culture” in the draft policy but does not specifically define “strong” or “positive” safety culture. The NRC states that “certain organizational characteristics and personnel attitudes and behaviors are present in a positive safety culture.” (p. 57528) It also notes that “The INSAG definition emphasizes that in a positive safety culture, the goal of maintaining nuclear safety receives the highest priority in the organization’s and individuals’ decision-making and actions when faced with a conflict with other organizational or individual goals.” (p. 57527)

We found the use of the term “positive” potentially ambiguous and decided to explore its possible meaning(s) as applicable to safety culture and what might be the NRC’s intent in using it to describe safety culture.

First of all we note the use of “positive” in this context is as an adjective. Complicating matters a bit from the start is that there are eight definitions of the adjective, positive. A few are readily dismissed such as where positive refers to the charge of electricity associated with a proton or having higher electric potential. But many remain. The definitions of positive that could be applicable to nuclear safety culture include:

  • prescribed, or formally laid down and imposed;
  • unconditioned or independent of changing circumstances;
  • real, not fictitious and being effective in a social circumstance;
  • contributing toward or characterized by increase or progression;
  • favorable, having a good effect.

Consulting with Black’s Law Dictionary, the term positive is defined as:

“Laid down, enacted, or prescribed. Direct, absolute, explicit.” Sounds close to the first definition above.So what did the NRC intend by the usage of positive to modify “safety culture”? The short answer is we don’t know. The various definitions imply several possible interpretations. Perhaps the more straightforward is the “prescribed” definition. It would require licensees have an explicit and prescribed policy for safety culture at its facilities, and the policy would need to address elements of safety culture as laid out in the policy statement. This interpretation might also imply that the safety culture is unconditioned and independent of changing circumstances; i.e., enduring. The other possibility is that the NRC intends the “favorable” and “increasing and progressing” safety culture. This meaning has more of a dynamic implication and is similar to continuous improvement. The NRC’s alternate use of the term “strong” in the introduction to the policy doesn’t help much either. Strong can mean the “power to resist or endure” so it could be consistent with the first definition that safety culture should be enduring. But it also implies “resistant to change” which could be good or bad, depending on the current state of safety culture and any need to change (improve) it.

Where does this leave us? As a minimum it would appear necessary that the NRC amplify its use of these modifiers of safety culture and the specific meanings that are intended. Better yet, the NRC could not use these terms and simply rely on an old regulatory standby such as “adequate” safety culture.

* Draft Safety Culture Policy Statement: Request for Public Comments NRC-2009-0485-0001

Saturday, May 1, 2010

Why is Nuclear Different?

We saw a very interesting observation in a recent World Nuclear News item describing updates to World Association of Nuclear Operators’ structure. The WANO managing director said “Any CEO must ensure their own facilities are safe but also ensure every other facility is safe. [emphasis added] It's part of their commitment to investors to do everything they can to ensure absolute safety and the one CEO that doesn't believe in this concept will risk the investment of every other.” As WNN succinctly put it, “These company heads are hostages of one another when it comes to nuclear safety.”

I think it's true that nuclear operators are joined at the wallet, but why? In most industries, a problem at one competitor creates opportunities for others. Why is the nuclear industry so tightly coupled and at constant risk of contagion? Is it the mystery and associated fears, suspicion and, in some cases, local visibility that attends nuclear?


Coal mining and oil exploration exist in sharp contrast to nuclear. "Everyone knows" coal mining is dirty and dangerous but bad things only happen, with no wide-ranging effects, to unfortunate folks in remote locations. Oil exploration is somewhat more visible: people will be upset for awhile over the recent blow-out in the Gulf of Mexico, offshore drilling will be put on a temporary hold, but things will eventually settle down. In the meantime, critics will use BP as a punching bag (again) but there will be no negative spillover to, say, Chevron.