Showing posts with label Vit Plant. Show all posts
Showing posts with label Vit Plant. Show all posts

Thursday, May 3, 2018

Nuclear Safety Culture and the Hanford Waste Treatment Plant: the Saga Continues

WTP at Hanford
In April 2018 the U.S. Government Accountability Office (GAO) released a report* on shortcomings in the quality assurance (QA) program at the Department of Energy’s (DOE) Waste Treatment Plant (WTP aka the Vit Plant) in Hanford, Washington.  QA problems exist at both Bechtel, the prime contractor since 2000, and the DOE’s Office of River Protection (ORP), the on-site overseer of the WTP project.

The report describes DOE actions to identify and address QA problems at the WTP, and examines the extent to which (a) DOE has ensured that all QA problems have been identified and will not recur and (b) ORP’s organizational structure provides sufficient independence to effectively oversee Bechtel’s QA program.

Why do we care about QA?  The GAO investigation did not target culture and there is only one specific mention of culture in the report.**  However, the entire report reflects the weak nuclear safety culture (NSC) at Hanford.

There is a lot of history here (GAO has been ragging DOE about the need for effective oversight at DOE facilities since 2008) but let’s begin with ORP’s 2012 stop work order to address WTP’s most significant technical challenges. Then, in 2013, ORP’s QA division issued two Priority One findings with respect to Bechtel’s QA program, viz., both the program and Bechtel’s Corrective Action Program to address QA problems were “not fully effective.” (p. 3)  This was followed by a DOE Office of Enforcement investigation which, in turn, led to a 2015 Consent Order and Bechtel Management Improvement Program (MIP).  The Order specified all corrective actions had to be implemented by April 20, 2016.  Currently, 13 of 52 total corrective measures have not been completed and some of the ones where Bechtel claimed completion are not yet completed.  In addition, “. . . in some areas where [Bechtel] has stated that corrective measures are now in place, ORP continues to encounter quality assurance problems similar to those it encountered in the past.” (p. 25)

Why doesn’t ORP stop work again?  Because ORP senior managers plan to evaluate the extent of Bechtel’s implementation of MIP corrective measures over the next year and have allowed work to continue because they believe Bechtel’s QA is “generally adequate.” (p. 22)  We’ll reveal the real reason later.

The shortcomings are not limited to Bechtel.  “ORP’s actions have not ensured that all quality assurance problems have been identified at the WTP, and some previously identified problems are recurring.” (p. 16)  “When and where problems have recurred, ORP has not always required [Bechtel] to determine the extent to which the problems may affect all parts of the WTP.” (p. 25)  Why not?  Here’s a hint: ORP’s “Quality Assurance Division is not fully separate and independent from the upper management of the WTP project, which manages cost and schedule performance.” (p. 22)

Our Perspective

An article*** in the local Hanford newspaper summarizes the report’s contents.  However, the problems described are not new news.  Technical, quality and culture problems have swirled around the WTP for years.  In 2011 we started reporting on WTP issues and the sluggish responses from both DOE and Bechtel.  Click on the Vit Plant label to see our previous posts.

Goal conflict (cost and schedule vs. QA and a strong NSC) has always been the overarching issue at the WTP.  Through fiscal year 2017, DOE spent $11 billion on WTP construction.  It will cost approximately $16.8 billion to complete the first phase of the WTP, which transfers low-level radioactive waste to the low-level vitrification facility.  No one knows how much it will cost to complete the WTP or when it will be functioning.

GAO gives their subjects an opportunity to respond to GAO’s reports and recommendations.  The DOE response is an unsurprising continuation of their traditional rope-a-dope strategy: concur with GAO recommendations, rationalize or minimize the current extent of condition, exaggerate current corrective actions, promise to investigate identified issues and do better in the future, wait for GAO’s attention to turn elsewhere, then continue with business as usual.  What DOE needs to do is issue a stop order for the money train—that would get the attention of everyone, especially Bechtel and ORP managers.

How does your QA department stack up?  Does it add value by identifying and helping to solve real problems?  Is it a distracting irritant, enamored of its own authority and administrivia?  Or is it simply impotent?


*  U.S. Government Accountability Office, “Hanford Waste Treatment Plant: DOE Needs to Take Further Actions to Address Weaknesses in Its Quality Assurance Program,” GAO-18-241 (April, 2018).

**  “One [ORP] quality assurance expert specified that ORP’s culture does not encourage staff to identify quality assurance problems or ineffective corrective measures. This expert said that people who discover problems are not rewarded; rather, their findings are met with resistance, which has created a culture where quality assurance staff are hesitant to identify quality assurance problems or problems with corrective measures.” (p. 24)  This quote exposes the core NSC issue at the WTP.

***  A. Cary, “Feds bash Hanford nuclear waste plant troubles, question DOE priorities,” Tri-City Herald (April 24, 2018).  Retrieved May 1, 2018.

Monday, October 30, 2017

Nuclear Safety Culture Under Assault: DNFSB Chairman Proposes Eliminating the Board


DNFSB headquarters
The Center for Public Integrity (CPI) recently published a report* that disclosed a private letter** from Sean Sullivan, the Chairman of the Defense Nuclear Facilities Safety Board (DNFSB) to the Director of the Office of Management and Budget in which the chairman proposed abolishing or downsizing the DNFSB.  The CPI is highly critical of the chairman’s proposals; support for their position includes a list of the safety improvements in the Department of Energy (DOE) complex that have resulted from DNFSB recommendations and the safety challenges that DOE facilities continue to face.

The CPI also cites a 2014 National Nuclear Security Administration (NNSA, the DOE sub-organization that oversees the nuclear weapons facilities) internal report that describes NNSA’s own safety culture weaknesses, e.g., lack of a questioning attitude toward contractor management’s performance claims, with respect to its oversight of the Los Alamos National Laboratory.

The CPI believes the chairman is responding to pressure from the private contractors who actually manage DOE facilities to reduce outside interference in, and oversight of, contractor activities.  That’s certainly plausible.  The contractors get paid regardless of their level of performance, and very little of that pay is tied to safety performance.  DNFSB recommendations and reports can be thorns in the sides of contractor management.

The Sullivan Letter

The primary proposal in the Sullivan letter is to abolish the DNFSB because the DOE has developed its own “robust regulatory structure” and oversight capabilities via the Office of Enterprise Assessments.  That’s a hollow rationale; the CPI report discusses the insufficiency of DOE’s own assessments.  If outright elimination is not politically doable then DNFSB personnel could be transferred to DOE, sustaining the appearance of independent oversight, and then be slowly absorbed into the larger DOE organization.  That is not a path to increased public confidence and looks like being assimilated by the Borg.***  The savings that could be realized from abolishing the DNFSB is estimated at $31 million, a number lost in the decimal dust of DOE’s $30+ billion budget.

Sullivan mentions but opposes transferring the DNFSB’s oversight responsibilities to the Nuclear Regulatory Commission.  Why?  Because the NRC is not only independent, it has enforcement powers which would be inappropriate for defense nuclear facilities and might compromise national security.  That’s a red herring but we’ll let it go; we don’t think oversight of defense facilities really meshes with the NRC’s mission.

His secondary proposal is to downsize the DNFSB workforce, especially its management structure, and transfer most of the survivors to specific defense facilities.  While we think DNFSB needs more resources, not fewer, it would be better if more DNFSB personnel were located in the field, keeping track of and reporting on DOE and contractor activities.

Our Perspective

Safetymatters first became interested in the DNFSB when we saw the growing mess at the Waste Treatment Plant (WTP, aka the Vit Plant) in Hanford, WA.  It was the DNFSB who forced the DOE and its WTP contractors to confront and remediate serious nuclear safety culture (NSC) problems.  We have published multiple reports on the resultant foot-dragging by DOE in its responses to DNFSB Recommendation 2011-1 which addressed safety conscious work environment (SCWE) problems at Hanford and other DOE facilities.  Click on the DOE label to see our offerings on WTP, other DOE facilities and the overall DOE complex.
 
We have reported on the NSC problems at the Waste Isolation Pilot Plant (WIPP) in New Mexico.  The DNFSB has played an important role in attempting to get DOE and the WIPP contractor to strengthen their safety practices.  Click the WIPP label to see our WIPP-related posts. 

We have also covered a report on the DNFSB’s own organizational issues, including board members’ meddling in day-to-day activities, weak leadership and too-frequent organizational changes.  See our Feb. 6, 2015 post for details.

DNFSB’s internal issues notwithstanding, the board plays an indispensible role in strengthening NSC and safety practices throughout the DOE complex.  They should be given greater authority (which won’t happen), stronger leadership and additional resources.

Bottom line: Sullivan’s proposal is just plain nuts.  He’s a Republican appointee so maybe he’s simply offering homage to his ultimate overlord.
  

*  P. Malone and R.J. Smith, “GOP chair of nuclear safety agency secretly urges Trump to abolish it,” The Center for Public Integrity (Oct. 19, 2017).  Retrieved Oct. 26, 2017.

**  S. Sullivan (DNFSB) to J.M Mulvaney (Management and Budget), no subject specified but described as an “initial high-level draft of [an] Agency Reform Plan” (June 29, 2019).  Available from the CPI in html and pdf format.  Retrieved Oct. 26, 2017.

***  The Borg is an alien group entity in Star Trek that forcibly assimilates other beings.  See Wikipedia for more information.

Tuesday, February 16, 2016

DOE Inspector General Piles On: Bechtel CAP and DOE Oversight Deficient at the Vit Plant

The Department of Energy (DOE) Inspector General (IG) recently released an audit report* on deficiencies in Bechtel’s Corrective Action Program (CAP) at the Hanford Waste Treatment Plant (WTP aka the Vit Plant) where Bechtel is the prime contractor.  The report also described deficiencies in the DOE Office of River Protection’s (ORP) oversight of Bechtel.

With one exception, this IG report is not about safety culture (SC) per se, but it does discuss two key artifacts that reflect the strength of a SC: the effectiveness of the CAP and the size of backlogs.**

The audit found that the Bechtel CAP “was not fully effective in managing and resolving issues.”  Specifically, some required issues were not managed and tracked in the CAP, corrective actions were not implemented in a timely manner (Bechtel did not make any of its timeliness goals) and Bechtel failed to follow through on implementing or sustaining prior CAP improvement initiatives. (pp. 1-2, 5)

The findings were not news to the ORP.  In fact, they are consistent with ORP’s 2013 audit of Bechtel’s Quality Assurance program.  At that time ORP directed Bechtel to make CAP improvements but as of the current IG audit, such improvements had not been fully implemented. (p. 2) 

CAP backlogs are also a problem.  Backlogs of condition reports increased from 2013 to 2014, as did the age of corrective actions. (pp. 4-5)

The audit report does have one direct tie to SC, noting that Bechtel identified weaknesses in its SC in 2014, including concerns about management not valuing a rigorous CAP. (p. 6)

And the auditors didn’t let ORP off the hook, stating DOE “did not ensure that all technical issues and issues identified through self-assessments were entered into the [CAP].  Finally, [DOE] did not ensure that previous Bechtel initiatives to address [DOE] implementation problems were fully implemented or sustained.” (p. 6)

The report closed with three straightforward “fix-it” recommendations with which ORP management concurred.  In their concurrence letter, ORP reviews the actions taken to date and concludes “Bechtel has strengthened the WTP Project’s nuclear safety and quality culture.” (p. 11)

Our Perspective

The report does not inspire confidence that Bechtel can upgrade its CAP (while trying to move ahead with Vit Plant design and construction) or ORP will ride herd on them to ensure it happens.  In fact, the report is consistent with a bevy of earlier assessments and evaluations, many of which we have reviewed on Safetymatters.  (Click on the Vit Plant label for more details.)  ORP’s assertion that Bechtel has strengthened its culture is possibly true, but they began from an unacceptably low starting point.

Early in my career I was hired as a Quality Control manager for a telecom manufacturer.  The company had major problems with its flagship product and I was soon named to a task force to investigate them.  On my way to our initial meeting, I met up with a more senior employee and told him how I looked forward to our task force identifying and fixing the product’s problems.  He turned to me and said “The first three didn’t.”  Welcome to the world.


*  U.S. DOE Inspector General, “Audit Report - Corrective Action Program at the Waste Treatment and Immobilization Plant,” OAI-M-16-06 (Feb. 2016).

**  As we have discussed elsewhere, two other key artifacts are decision-making and compensation.  From the WTP history we have reviewed for Safetymatters, it appears Bechtel (and by extension, DOE) decision-making does not effectively address either the tough technical challenges or programmatic issues at the WTP.  The Bechtel contract now includes some modest incentive compensation for SC performance.  We discussed that program on Dec. 29, 2014.

Thursday, September 10, 2015

DNFSB Hearing on Safety Culture Progress at the Waste Treatment and Immobilization Plant (WTP)

The WTP aka the Vit Plant
On August 26, 2015 the Defense Nuclear Facilities Safety Board (DNFSB) held a hearing in the Hanford area to receive testimony from senior DOE officials representing DOE Headquarters, the Office of River Protection (ORP) and the WTP project regarding the current status of DOE efforts to improve safety culture (SC) at the WTP.  A senior DNFSB staff member also testified on DOE’s SC improvement efforts.

There is a video of the meeting but no transcript is yet available.* 

The panel of DOE managers enumerated the work that has been undertaken to improve SC at the WTP.**  Based on their written submittals, it is predictable and not especially interesting material.  Selected excerpts follow:

G. Podonsky (DOE HQ) – “. . . positive turn in the safety culture.  However, much work remains . . . . As our assessments of safety culture indicate, management often has a more positive outlook on the state of the safety culture than do the workers.”

K. Smith (ORP Mgr) – This is mostly a laundry list of actions, initiatives and putative progress.  “. . . ORP’s safety culture today . . .  is improving and headed in the right direction. . . . But there are areas that still need work . . .”

W.F. Hamel Jr. (Federal Project Director WTP) – This focuses on more specific, project-level actions.  “We believe we have made significant strides. . . . sustaining a healthy safety culture requires persistence and consistency at all levels of the organization . . .”  He gave a shout out to Bechtel for progress in improving their SC and the Safety Conscious Work Environment (SCWE).

After the panel completed their presentation, the DNFSB staff member responsible for overseeing WTP (and other DOE) SC efforts had ten minutes to provide the staff perspective on DOE’s efforts.  He summarized the SC assessments that have taken place at the WTP and other facilities in the DOE complex.***  His testimony had more “howevers” than a Consumer Reports review of a mediocre automobile.  For example, DOE’s original plan was developed prior to the 2012 SC assessment and did not include the latter’s findings.  DOE modified their plan for Hanford but it was not applied to other DOE facilities.  The DOE themes did not address the root causes the DNFSB identified in their 2011 Recommendation.  He was also critical of the DOE’s extent of condition review.

He was asked one question by the meeting chair: “Is the bad (i.e., not supportive of SC) management behavior identified in 2011 still occurring?”  The answer was “It’s mixed. Some yes and some no.”  The chair was clearly not happy with that answer after four years of effort.

Our Perspective

The DOE bureaucrats identified a passel of SC-related improvement activities and claim progress is being made but there is still work to accomplish.  The testimony of the DNFSB staffer was less optimistic.  A statement contributed for the record by an anonymous “concerned engineer” includes examples that look like they came straight from the bad old days.****  We have reviewed most the DOE/WTP assessments, action plans and progress reviews on Safetymatters; click on the DOE or WTP label to see related posts.  Call us harsh, but we don’t believe there will be any substantive changes in the way business is conducted at Hanford until the bad stuff starts leaching into the Columbia River.

On a slightly brighter note, the DNFSB is back to full strength with five members, including a new chairman.  From looking at the press releases, it appears they have added folks with federal/military backgrounds and middling technical exposure.  The new chair is a career technical functionary whose last stint was at the White House.  It’s hard to get All-Stars for a toothless agency.  What they can contribute to oversight of DOE remains to be seen.  We wish them well.


*  The video is here.  Testimony and statements are available here but most are scanned copies which means quotes have to be retyped and may not totally accurate.  For an overview of the meeting see A. Cary, "National board hears safety culture is improving at Hanford vit plant," Tri-City Herald (Aug. 26, 2015).

**  Statement for the Record and Additional Information of G. Podonsky, Office of Enterprise Assessments (Aug. 26, 2015).  Testimony of K. Smith, Manager, Office of River Protection (Aug. 26, 2015).  Testimony of W.F. Hamel Jr., Federal Project Director, Waste Treatment and Immobilization Plant (Aug. 26, 2015).

***  Testimony of D.B. Bullen, Group Lead, Nuclear Programs and Analysis, DNFSB.  The question and answer are not verbatim but paraphrased from the exchange between Bullen and the chair that occurs from about 1:52 to 1:55 in the video.

****  Statement from concerned engineer (Aug. 26, 2015).

Friday, July 3, 2015

New Safety Culture Assessment at the Hanford Waste Treatment Plant

Hanford WTP
The Department of Energy (DOE) recently released the latest safety culture (SC) assessment report* for the Hanford Waste Treatment Plant (WTP or “vit plant”) project.  The 2015 report follows similar SC assessments conducted in 2011 and 2014, all of which were inspired by the Defense Nuclear Facilities Safety Board’s scathing 2011 report on SC at the WTP.  This post provides a brief overview of the report’s findings then focuses on the critical success factors for a healthy SC.

Assessment Overview

The 2011, 2014 and 2015 assessments used the same methodology, with multiple data collection methods, including interviews, Behavioral Anchored Rating Scales (BARS)** and a SC survey.  Following are selected highlights from the 2015 report.

DOE’s Office of River Protection (ORP) has management responsibility for the WTP project.  In general, ORP personnel feel more positive about the organization’s SC than they did during the 2014 assessment.  Feelings of confusion about ORP’s more collaborative relationship with Bechtel (the prime contractor) have lessened.  ORP management is perceived to be more open to constructive criticism.  Concerns remain with lack of transparency, trust issues and the effectiveness of the problem resolution process.

Bechtel personnel were more positive than in either previous SC assessment.  Bechtel has undertaken many SC-related initiatives including the promotion of a shared mental model of the project by senior Bechtel managers.  In 2014, Bechtel Corporate’s role in project decision making was perceived to skew against SC concerns.  The creation of a new Bechtel nuclear business unit has highlighted the special needs of nuclear work. (pp. 2, 39)  On the negative side, craft workers remain somewhat suspicious and wary of soft retributions, e.g., being blamed for their own industrial mishaps or having their promotion or layoff chances affected by reporting safety issues.

See this newspaper article*** for additional details on the report’s findings. 

Critical Success Factors for a Healthy SC

We always look at the following areas for evidence of SC strength or weakness: management’s decision making process, recognition and handling of goal conflicts, the corrective action program and financial incentives.

Decision Making

Both ORP and Bechtel interviewees complained of a lack of basis or rationale for different types of decisions. (pp. 9, 16)  Some ORP and Bechtel interviewees did note that efforts to clarify decision making are in process. (pp. 13, 32)  Although the need to explain the basis for decisions was recognized, there was no discussion of the decision making process itself.  This is especially disappointing because decision making is one of the possible behaviors that can be included in a BARS analysis, but was not chosen for this assessment.

Goal Conflicts

Conflicts among cost, schedule and safety goals did not rise to the level of a reportable problem.  ORP interviewees reported that cost and schedule do not conflict with safety in their individual work. (p. 6)  Most Bechtel interviewees do not perceive schedule pressures to be the determining factor while completing various tasks. (p. 23)  Overall, this is satisfactory performance.

Corrective Action Program

We believe how well an organization recognizes and permanently resolves its problems is important.  Problem Identification and Resolution was one of the traits evaluated in the assessment.  ORP interviewees said that current safety concerns are being addressed.  The historical lack of management feedback on problem resolution is still a disincentive for reporting problems. (pp. 8-9)  Some Bechtel interviewees said “issue resolution with management engagement was the single most positive improvement in problem resolution, . . .” (p. 24)  This performance is minimally acceptable but needs ongoing attention.

Financial Incentives

DOE’s contract with Bechtel now includes incentives for Bechtel if it self-identifies problems (rather than waiting for DOE or some other party to identify them).  ORP believes the incentives are a positive influence on contractor performance. (p. 8)  Bechtel interviewees also believe the new contract has had a positive impact on the project.  However, Bechtel has a goal to reduce legacy issues and some believe the contract’s emphasis on new issues distracts from addressing legacy problems. (pp. 24-25)  The assessment had no discussion of either ORP or Bechtel senior management financial incentives.  The new contract conditions are good; ignoring senior management incentives is unacceptable.

Safety Conscious Work Environment (SCWE)

We usually don’t pay much attention to SCWE at nuclear power plants because it is part of the larger cultural milieu.  But SCWE has been a long-standing issue at various DOE facilities, as well as the impetus for the series of WTP SC assessments, so we’ll look at a few highlights from the SC survey data.

For ORP, mean responses to five of the six SCWE questions were higher (better) in 2015 vs 2014, and 2014 vs 2011.  However, for one question “Concerns raised are addressed” the mean is lower (worse) in 2015 vs 2014, and significantly lower in 2015 vs 2011.  This may indicate an issue with problem resolution. (p. B-2) 

For Bechtel, mean responses to all six SCWE questions were significantly higher (better) in 2015 vs 2014.  However, the 2011 data were not included so we cannot make any inference about possible longer-term trends. (p. B-5)  What is shown is good news because it appears people feel freer to raise safety concerns.  Interestingly, Bechtel’s mean 2015 responses were 5-13% higher (better) than ORP’s for all questions.

Both ORP and Bechtel are showing acceptable performance but continued improvement efforts are warranted.

Our Perspective

The Executive Summary and Conclusions suggest ORP and especially Bechtel have turned the corner since 2014. (pp. v, 37)  This is arguably true for SCWE but we’d say the jury is still out on improvement in the broader SC, based on our look at the BARS data.

For ORP, the BARS data mean scores are higher for 4 (out of 10) behaviors in 2015 vs 2014, but only higher for 1 behavior in 2015 vs 2011. (p. B-1)  The least charitable interpretation is ORP’s view of itself has not yet re-achieved 2011 levels.  For Bechtel the BARS data shows a bit brighter picture.  Mean scores are higher for 6 (out of 10) behaviors in 2015 vs 2014, and higher for 4 behaviors for 2015 vs 2011. (p. B-4)

The format of the report is probably intended to be reader-friendly but it mixes qualitative interview data and selected quantitative data from BARS and the survey.  The use of modifiers like “many” and “some” creates a sense of relative frequency or importance but no real specificity.  It’s impossible to say how much (if any) cherry picking of the interview data occurred.****

We also wonder about the evaluation team’s level of independence and optimism.  This is the first time DOE has performed a WTP SC assessment without the extensive use of outside consultants.  Put bluntly, how independent was the team’s effort given DOE Headquarters’ desire to see improvements at WTP?  And it’s not just HQ; DOE is under the gun from Congress, the DNFSB, the Government Accountability Office, and environmental activists and regulators to clean up their act at Hanford.

We want to see a stronger SC at Hanford but we’ll go with Ronald Reagan on this report: “Trust, but verify.”


*  DOE Office of Enterprise Assessments, “Follow-up Assessment of Safety Culture at the Hanford Site Waste Treatment and Immobilization Plant” (June, 2015).  We have followed the WTP saga for years; please click on the Vit Plant label to see our related posts.

**  Behavioral Anchored Rating Scales (BARS) quantitatively summarize interviewees’ perceptions of their organization using specific examples of good, moderate, and poor performance.   There are 17 possible organizational behaviors in a BARS analysis, but only 10 were used in this assessment:  Attention to Safety, Coordination of Work, Formalization, Interdepartmental Communication, Organizational Learning, Performance Quality, Problem Identification and Resolution, Resource Allocation, Roles and Responsibilities and Time Urgency. (p. C-2)

***  A. Cary, “DOE: Hanford vit plant safety culture shows improvement,” Tri-City Herald (June 26, 2015).

****  The report also includes multiple references to the two organizations’ behavioral norms that were inferred from the survey data.  It’s not exactly consultant mumbo-jumbo but it’s too complicated to attempt to explain in this space.

Monday, December 29, 2014

Financial Incentives to Promote Safety Culture at the Vit Plant


The Vit Plant

We have reported on safety culture (SC) issues at the Hanford Waste Treatment Plant (WTP, or “vit plant”) for years.  Some of these issues arose in the Department of Energy (DOE) organization at Hanford; other issues became evident at Bechtel, DOE’s prime contractor at Hanford.  But this post focuses on a bit of good news: recent Bechtel contracts have included financial incentives for good performance related to establishing and maintaining a strong SC.*

The incentives are very small potatoes in the overall scheme of things.  The WTP is an $11 billion plus project (so far); the semi-annual SC incentives have been in the $1-5 million range.  But it is the correct signal for the government to be sending to a contractor.  It’s also interesting how the incentives have been fiddled with during their brief existence, as shown in the following table.  To keep things simple, the table excludes incentive program components that are not related to SC, e.g., cost performance incentives.  Note that the dollar amounts shown are the maximum Bechtel can earn; published payouts to date have been less than the maximums.

From July 1, 2012 to June 30, 2013 the contract included a project management incentive (PMI) component.  Nuclear Safety and Quality Culture items (the Corrective Action Program, Employee Concerns Program, Differing Professional Opinion process, Safety Conscious Work Environment (SCWE) and Integrated Safety Management Systems) were 20-30% of the PMI.

Starting July 1, 2013 and continuing to the present a section was added to the incentive plan covering Self-Analysis/Assessment/Discovery/Action.  This basically means Bechtel will be rewarded for identifying and fixing its problems before outsiders tell them to.  The contract does not characterize this activity as part of SC but we do; fixing problems is an essential artifact of a strong SC.  In addition, the attributes under this section, including transparency and organizational learning, are also attributes of a strong SC.  Another new section on Environmental, Safety and Health is mostly about industrial safety but includes promoting a robust NSQC embracing INPO principles, including a SCWE.  The section on the Quality Assurance program includes supporting an effective CAP and, starting July 1, 2014, maintaining a robust quality culture.

Start
End
Project Management Incentive (PMI)
Nuclear Safety and Quality Culture (NSQC)

7/1/2012
12/31/2012
$3,150,000
$945,000
30% of PMI: NSQC inc. CAP, ECP, DPO, SCWE (25%), Integrated Safety Management Systems (5%)
1/1/2013
6/30/2013
$3,780,000
$756,000
20% of PMI: NSQC inc. CAP, ECP, DPO, SCWE (15%), Integrated Safety Management Systems (5%)


Self-Analysis/ Assessment/ Discovery/Action
Environmental, Safety & Health
QA Program
7/1/2013
12/31/2013
$3,500,000
$1,000,000
$800,000
1/1/2014
6/30/2014
$3,500,000
$1,000,000
$800,000
7/1/2014
12/31/2014
$1,260,000
$1,260,000
$1,260,000

Our Perspective

For starters, let’s give credit where credit is due: Huzzah to DOE and Bechtel.  For a long time, we have been saying that organizational reward systems should include SC components.  Safety slogans and empty mantras are just that—empty.  If a government agency, or a nuclear plant owner, or a board of directors, or any other overseer truly values SC then they should put some money where their mouths are.

Enough cheering, let’s put our reality hat back on.  Could Bechtel (or any other contractor) game the incentive system to get rewarded without actually creating a strong SC?  Possibly.  Who would you bet on: government bureaucrats or a clever, financially motivated contractor?  But an official incentive plan like the one described above is a good start.

Now that DOE has figured out how to design a contract that aims to motivate a contractor to strengthen its SC, let’s turn the spotlight back on DOE itself.  How does DOE do on transparency, extent of condition and other SC attributes?  Not so good.  Over the last few years we have been reporting on the DOE effort to evaluate SC at other (i.e., non-WTP) sites to determine if WTP SC issues exist elsewhere.  We saw foot-dragging, an unorganized SC assessment program and deliberate opacity in the resultant reports.  DOE can and should do better.


*  The WTP Performance Evaluation and Measurement Plans used in this post are available here.  For prior related posts click on the Vit Plant label below.

Monday, October 20, 2014

DNFSB Hearings on Safety Culture, Round Three


DNFSB Headquarters

On October 7, 2014 the Defense Nuclear Facilities Safety Board (DNFSB) held its third and final hearing* on safety culture (SC) at Department of Energy (DOE) nuclear facilities.  The original focus was on the Hanford Waste Treatment Plant (WTP) but this hearing also discussed the Waste Isolation Pilot Plant (WIPP), the Pantex plant and other facilities.  There were three presenters: DOE Secretary Moniz and two of his top lieutenants.  A newspaper article** published the same day reported key points made during the hearing and you should read that article along with this post.  This post focuses on items not included in the newspaper article, including the tone of the hearing and other nuances.  The presenters used no slides and the hearing transcript has not yet been released.  The only current record of the hearing is a DNFSB video.

Secretary Moniz

Moniz has been Secretary for about a year-and-a-half.  In his view, the keys to improving SC are training, consistent senior management attention, and procurement modifications, i.e., DOE’s intent to revise RFP and contracting processes to include SC expectations.  He also said fostering the consideration of SC in all decisions, including resource allocation, is important.  Board member Sullivan asked about the SC issues at Pantex and Moniz provided a generic answer about improving self-assessments and sharing lessons learned but ultimately punted to the next presenter, Ms. Creedon.

Principal Deputy Administrator Creedon, National Nuclear Security Administration (NNSA)

Creedon has been in her position for two months.  She believes NNSA employees get the job done in spite of bureaucracy but they need greater trust in senior management who, in turn, must work harder to engage the workforce.  Returning to the Pantex*** issues, Sullivan asked why the recommendations of the plant’s outside technical advisors had been ignored for years.  Creedon said she would work to improve communications up and down the organization.  In a separate exchange, she provided an example of positive reinforcement where NNSA employees can receive cash awards ($500) for good work. 

Creedon’s  prior position was in the Department of Defense.  To the extent she has the warfighter mentality (“Anything, anywhere, anytime…at any cost”)**** then balancing mission and safety may not be natural for her.  Her response to a question on this topic was not encouraging; she claimed the motto du jour for NNSA (“Mission First, People Always”) adequately addresses safety's prioity but it obviously doesn’t even mention safety.

Acting Assistant Secretary for Environmental Management Whitney

Whitney is also new in his job but not to DOE, coming from DOE Oak Ridge.  He laid out his goals of establishing trust, a questioning attitude and mutual respect.  He was asked about a SC assessment finding that DOE senior managers don’t feel responsible for safety, rather it belongs to the site leads or one of the EM mission support units.  Whitney said that was unacceptable and described the intent to add SC factors to senior management evaluations.  He also repeated the plan to upgrade the WTP contractor evaluation to include SC factors.  He noted that most employees stay at one site for their entire career, making it hard to transfer SC from site to site.

Our Perspective

The overall tone of the hearing was collegial.  The Board expressed support and encouragement for the presenters, all of whom are relatively new in their jobs.  The presenters all stayed on message and reinforced each other.  For example, for WTP one message is “We know there are still significant SC issues at WTP but we have the right team in place and are taking action and making progress.  Changing a decades-old culture takes time.”  Whitney received more of a (polite) grilling probably because the WTP and the WIPP are under his purview.

We are totally supportive of DOE’s stated intent to add SC factors to contracts and senior management evaluations.  When players have skin in the game, the chances of seeing desired behavioral changes are greatly increased.  We are equally supportive of Secretary Moniz’ desire to create a culture that incorporates safety considerations in all decisions.

DOE is trying to make its employees more conscious of safety’s importance; two thousand mangers have gone through SC training and there’s more to come.  Now we’re starting to worry about the drumbeat of SC creating a Weltanschauung where a strong SC is sine quo non for good outcomes and a weak SC is always present when bad outcomes occur.  Organizational reality is more complicated.  An organization with a mediocre SC can achieve satisfactory results if other effective controls and incentives are in place; an organization with a strong SC can still make poor decisions.  And luck can run good or bad for anyone.


*  DNFSB Oct. 7, 2014 Safety Culture Public Meeting and Hearing.  We posted on the first hearing on June 9, 2014 and the second hearing on Sept. 4, 2014.

**  A. Cary, “Moniz says safety culture at Hanford vit plant led to problems,” Tri-City Herald (Oct. 7, 2014).

***  NNSA's responsibilities include Pantex which has recognized SC issues.

****  See the third footnote in our Sept. 4, 2014 post.