Archive

NAP-21, Transformational Governance and Oversight

The purpose of this Policy is to identify the principles, responsibilities, processes, and requirements that the National Nuclear Security Administration will utilize to transform and improve Federal governance and oversight of our Management and Operating (M&O) Contractors. The information in this document is to be used as the foundation for Governance transformation and the basis for how NNSA conducts business.
NAP-21.pdf2.22MB
Version history and related documents
Document text

Text extracted from the attached file. Refer to the original document for the authoritative version.

Section 1

AVAILABLE ONLINE AT: INITIATED BY: http://hq.na.gov Office of the Administrator NNSA POLICY LETTER Approved: 2-28-2011 TRANSFORMATIONAL GOVERNANCE AND OVERSIGHT NATIONAL NUCLEAR SECURITY ADMINISTRATION Office of the Administrator NAP-21 NAP-21 i 2-28-2011 TRANSFORMATIONAL GOVERNANCE AND OVERSIGHT 1. PURPOSE. The purpose of this Policy is to identify the principles, responsibilities, processes, and requirements that the National Nuclear Security Administration will utilize to transform and improve Federal governance and oversight of our Management and Operating (M&O) Contractors. The information in this document is to be used as the foundation for Governance transformation and the basis for how NNSA conducts business. 2. CANCELLATIONS. None. 3. APPLICABILITY. a. This NNSA Policy (NAP) applies to all NNSA Federal personnel and to NNSA Management and Operating Contractors. Contracting Officers are responsible for including this policy in M&O contracts. b. Office of the Deputy Administrator for Naval Reactors. In accordance with the responsibilities and authorities assigned by Executive Order 12344, codified at 50 USC sections 2406, 2511 and to ensure consistency throughout the joint Navy/DOE Naval Nuclear Propulsion Program, the Deputy Administrator for Naval Reactors (Director) will implement and oversee requirements and practices pertaining to this Directive for activities under the Director's cognizance, as deemed appropriate. 4. REQUIREMENTS. This Policy is a living document that centralizes the various documents that encompass the effort to transform the NNSA and its relationship with the NNSA M&O Contractors. This transformation is being accomplished consistent with existing DOE Directives/ Policies such as 226.1A, 450.4-1, etc. Future chapters will be added as necessary. When all of the activities in the Governance Reform Plan are complete, this NAP will institutionalize all that encompasses NNSA Transformational Governance and Oversight. a. Chapter One, Overview, provides a brief background on the initiation of NNSA governance transformation. b. Chapter Two, NNSA Operating Principles, is based on the Department of Energy Management Principles and documents the NNSA Operating Principles that were approved by the Administrator in February 2010. These Principles form the foundation for all of the other initiatives in this document. c. Chapter Three, Definitions, contains definitions of terms related to transformational governance and oversight and supplementary information pursuant to the February 5, 2010, NNSA Operating Principles. d. Chapter Four, Description of Governance, provides a description of the ii NAP-21 2-28-2011 objectives, critical factors, and definitions associated with governance in the NNSA. These concepts significantly figure in attaining the necessary Federal and Contractor partnership that will improve safety, performance, and drive efficiencies across the Enterprise. e. Chapter Five, Organizational Roles and Responsibilities, expands and follows the NNSA Operating Principles and supersedes the Administrator‟s October 12, 2007 memorandum entitled, Functional Accountability. It establishes policy on the general division of responsibilities between NNSA organizational levels, and provides selected detailed responsibilities to frame the intended relationship. While the division of roles and responsibilities for all line,

Section 2

program, and functional areas are expected to be consistent with the roles and responsibilities contained in this document, it is recognized that in some situations the HQ/field division of responsibilities could vary to some degree between NNSA elements due to applicable statutory and regulatory requirements. More detailed assignment of HQ and field roles and responsibilities within specific line, program, and functional areas will be established during the development and promulgation of a comprehensive NNSA Functions, Roles, and Authorities (FRA) document. f. Chapter Six, Framework for a Contractor Assurance System (CAS) identifies the common expectations/characteristics that should be found in CAS systems across NNSA Sites. A critical element of the partnership with the M&O Contractors is their ability to manage innovatively and deliver program results in an efficient, safe, secure, legally compliant, and environmentally sound manner. Thus, it is important for the NNSA Enterprise to have a clear understanding of the expectations/attributes of a well functioning CAS. g. Chapter Seven, Requirements Analysis Process, identifies that good requirements (necessary, verifiable, attainable, clear, consistent, and complete) enable management to effectively and efficiently set and manage expectations, establish common understandings, discover and test assumptions, and create a basis for risk management and system verification and validation. Additional information will be added to this section at a future date. h. Chapter Eight, Validating Line Oversight and Contractor Assurance Systems (LOCAS), contains a description of the elements associated with the validation and affirmation of LO and CAS Functionality and Effectiveness. LO and CAS are fundamental elements of NNSA‟s management strategy for assuring effective contractor performance in meeting mission objectives and other requirements. i. Chapter Nine, Integrated Oversight and Assessment Schedule, describes an integrated assessment planning model for use in identifying the set of NNSA assessments to be conducted across the Nuclear Security Enterprise. This model supports a risk informed assessment identification process and an integrated Site-plan that includes HQ led assessments. Also included in this chapter are a set of Assessment Identification, Planning, and Performance Principles to assure that if an assessment is necessary the basic tools are in place to assure that its value is maximized, and to provide both the assessing and assessed organization a guide to assuring such an outcome. j. Chapter Ten, Performance Evaluation Plan (PEP) and Metrics will be developed to define a new orientation for the performance criteria by which NNSA will appraise the M&O Contractors' performance. The PEP will evaluate and promote the Governance and Oversight framework based on mission focus, risk, trust, and accountability. It will be written to implement the collective principles communicated in this document and to reinforce the changes envisioned within the Governance Transformation efforts. 5. RESPONSIBILITIES. See Chapter 111. 6. CONTACT. Ofice of the Principal Deputy Administrator (202-586-5555). BY ORDER OF THE ADMINISTRATOR: THOMAS P. D'AGOSTINO Administrator iv NAP-21 2-28-2011 Table of Contents Message from the Administrator ........................................................................................................ vi

Section 3

Chapter One - Overview .....................................................................................................................I-1 Goal of Governance Transformation ...................................................................................................... I-1 Chapter Two - NNSA Operating Principles ................................................................................... II-1 Chapter Three - Definitions............................................................................................................ III-1 Chapter Four - Description of Governance ................................................................................... IV-1 Objective/Critical Factors for Governance ........................................................................................... IV-1 Governance Definition/Attributes ........................................................................................................ IV-1 Governance Implementation ............................................................................................................... IV-2 Chapter Five - Organizational Roles and Responsibilities ............................................................ V-1 NNSA Headquarters ........................................................................................................................... V-1 NNSA Site Offices ............................................................................................................................. V-4 NNSA Service Center (SC) ................................................................................................................. V-6 M&O Contractors (National Laboratories, NNSS, and Plants) ................................................................ V-8 Chapter Six - Framework for a Contractor Assurance System (CAS) ....................................... VI-1 Purpose ............................................................................................................................................. VI-1 Features of a Fully Functional CAS ..................................................................................................... VI-1 Evidence of Progress .......................................................................................................................... VI-2 Relationship of CAS to Corporate Governance ..................................................................................... VI-3 Relationship of CAS to Federal Line Oversight .................................................................................... VI-3 Chapter Seven - Requirements Analysis Process ........................................................................ VII-1 Chapter Eight - Validating Line Oversight and Contractor Assurance Systems (LOCAS) ..VIII-1 Overview ........................................................................................................................................ VIII-1 Affirmation Process Scope ............................................................................................................... VIII-2 Key Process Roles and Responsibilities ............................................................................................. VIII-2 LOCAS Affirmation Review Process ................................................................................................ VIII-4 Format of LOCAS Affirmation Report .............................................................................................. VIII-8

Section 4

Chapter Nine - Integrated Oversight and Assessments ................................................................ IX-1 Introduction ...................................................................................................................................... IX-1 Description ....................................................................................................................................... IX-1 Model Execution Process Flow ........................................................................................................... IX-4 Organizational Assurance Functions and Interfaces .............................................................................. IX-6 Assessment Identification Principles ................................................................................................. IX-10 Assessment Planning Principles ........................................................................................................ IX-11 Assessment Performance Principles .................................................................................................. IX-11 Chapter Ten –Performance Evaluation Plan and Metrics ............................................................ X-1 Attachment 1 - Advancing the NNSA’s Managerial and Cost Effectiveness ................................ 1-1 Attachment 2 - NNSA Operating Principles .................................................................................... 2-1 NAP-21 v 2-28-2011 Attachment 3 - NNSA Enterprise Re-engineering Reform Initiative - LOCAS ........................... 3-1 Attachment 4 - LOCAS Affirmation Objectives and Criteria ....................................................... 4-1 Evaluating Contractor Assurance Systems ............................................................................................ 4-1 Evaluating Site Office Line Oversight Programs ................................................................................. 4-11 vi NAP-21 2-28-2011 Message from the Administrator President Obama challenged our Government to fundamentally change the way we do business, be more efficient, and deliver quality results for the American taxpayer. As the National Nuclear Security Administration (NNSA) responds to the President's challenge, and through the Secretary of Energy's leadership in Government transformation, we are uniquely poised through our history of contract, business, and human capital initiatives to deliver on the President's challenge and set the course for the future of NNSA in the decades to come. As we celebrated the NNSA‟s 10 th Anniversary, we saw the release of a Nuclear Posture Review that adopts a 21 st Century approach to nuclear security, the signing of the new Strategic Arms Reduction Treaty, the completion of a historic global Nuclear Security Summit and the release of the President‟s Fiscal Year 2011 and 2012 Budgets which makes critical investments in the physical, technological, scientific and human capital required to manage our nuclear deterrent and implement the full range of nuclear security missions. All of these actions reflect the Administration‟s commitment to ensuring national, as well as nuclear security, and for NNSA to implement the President‟s nuclear security agenda. This is a monumental moment for the NNSA, and our current work has significant impact on our mission for decades to come. We are taking an important step towards ending Cold War

Section 5

thinking and adopting a 21 st Century approach to nuclear weapons and nuclear security issues. In order to effectively utilize our limited budgetary resources to implement the President‟s agenda, our focus will continue to be the management transformation activities that maximize our ability to complete our mission safely and securely and ensures we are effective and efficient stewards of the taxpayer‟s money. Thus, it is one of my highest priorities to champion NNSA‟s enterprise reengineering and governance transformation initiative, which has set the stage for transformational governance and oversight. In April 2009, I established the Enterprise Reengineering Team (ERT) to identify Enterprise- wide transformation initiatives that will change the way NNSA does business. With your help, we received over 100 recommendations from across the Enterprise. Based on these recommendations and at the request of the ERT, in July 2009, I assigned senior leaders to implement improvements in three major areas: (1) the way we govern our Contractors and ourselves, (2) facilitate business system improvements, and (3) improve upon how we capture our financial data. To oversee and approve recommended changes to how we operate in these three areas, I established and chaired a Governance Board. These efforts have culminated in transformational governance and oversight. My vision is to streamline NNSA business operations and reduce operations costs to maximize mission accomplishment. The NNSA of the future will be a smaller and less expensive Enterprise that leverages scientific and technical capabilities of the workforce to meet our nuclear security mission safely and securely. This will be achieved: 1) through common understanding of how we govern and perform; and, 2) by leveraging upon strong Federal and Contractor Assurance Systems that improve performance and accountability, reduce costs, and utilize validated industry standards for non-nuclear activities where possible. vii In February 201 0, I issued the NNSA Operating Principles that were developed from the Department Management Principles. These Principles are the core to NNSA's management transformation initiative and guide our priorities, decision-making process, collaboration, and partnership with entities that perform our work. They are the fundamental principles of how we execute our responsibilities. They are the foundation of all the governance transformation initiatives. Our governance transformation is based on a supporting partnership with our Contractors for mission success. The contract is the governance framework that supports accomplishment of the mission. A critical element of the partnership is the ability of our Contractors to manage imovatively and deliver program results in a safe, efficient, secure, legally compliant, and environmentally sound manner. They will do this through fully hctioning, transparent, Contractor Assurance Systems. These systems significantly .figure in attaining the necessary partnership that will improve performance, efficiencies, and accountability across the Enterprise.

Section 6

We will continually improve upon performance-based oversight by using a graded approach consistent with associated risks and Contractor's demonstrated performance. While doing that, we will maintain our responsibility to exercise independence in oversight to sustain a strong self-regulatory posture where applicable and appropriate. Rigor and implementation of independent oversight for nuclear and high hazard activities will continue to be maintained and enhanced as we balance requirements, risks, and resources. Achieving that balance will not trade program accomplishment for the safety of our workers, the public, protection of the environment or security. Our processes ensure that safety and security are treated as essential elements that are integral to our mission, not separate considerations. I expect the information in this document to be used as the foundation for Governance transformation and the basis for how NNSA conducts business. , Thomas P. D'Agostino Administrator NAP-21 I-1 2-28-2011 Chapter One - Overview U.S. national security demands that the NNSA Enterprise maintain technological superiority and a nuclear capability second to none. To accomplish this, the NNSA must remain the preeminent scientific, engineering, and manufacturing Enterprise that delivers a safe, secure, and reliable nuclear deterrent capability. This requires that safety, security, efficiency, and productivity all be balanced and maintained in a diligent manner. Given the complexity and hazards of our work, it is understandable that the systems and processes established to ensure these objectives can become unwieldy or overly complex over time. To maximize the overall national security benefits provided by NNSA, it is necessary to revise our systems and processes to improve productivity and reduce the cost of executing the NNSA mission while increasing overall safety and security expectations and performance. This does not imply that NNSA is “backing off” on safety or security, or emphasizing science and production to the detriment of safety or security. Rigor and implementation of independent oversight for nuclear and high hazard activities will continue to be maintained and enhanced. However, this transformation is necessary in order for NNSA to make risk informed decisions and allocate appropriate resources to higher risk safety and security oversight. It is essential to reform the governance strategy to ensure that there is proper focus on the NNSA mission and that the NNSA‟s oversight/governance is executed to enable this mission. Goal of Governance Transformation The ultimate goal of the NNSA Reengineering and Governance Transformation Initiative is to streamline how NNSA does business and to reduce the cost of operations and increase productivity to maximize mission accomplishment. Upon completion of the Governance Transformation Initiative, the expected results include: Definition of governance and NNSA‟s Operating Principles Clear roles, responsibilities and accountability Strong Contractor Assurance Systems Appropriate alignment of programmatic and operational risks to safely accomplish mission Balanced Federal requirements and oversight Individual and contractual performance accountability Definition and use of key performance metrics NAP-21 II-1 2-28-2011 Chapter Two - NNSA Operating Principles The Deputy Secretary of Energy issued the following Department Management Principles in

Section 7

December 2009: 1. Our mission is vital and urgent. 2. Science and technology lie at the heart of our mission. 3. We will treat our people as our greatest asset. 4. We will pursue our mission in a manner that is safe, secure, legally and ethically sound, and fiscally responsible. 5. We will manage risk in fulfilling our mission. 6. We will apply validated standards and rigorous peer review. 7. We will succeed only through teamwork and continuous improvement. The NNSA Operating Principles were developed to implement the DOE Management Principles and build upon NNSA's management transformation initiatives. The Administrator issued the NNSA Operating Principles in February 2010. These Principles reaffirm that NNSA activities are of a highly performing, highly reliable Enterprise that consistently accomplishes its mission goals. The Principles guide the priorities, decision-making process, collaboration, and partnership with entities that perform NNSA work. The following Principles are fundamental direction of how NNSA executes its responsibilities: Our mission is vital and urgent — we constantly focus on mission outcomes. US nuclear security is the fundamental mission of the NNSA and its laboratories, plants, and test site. Mission managers bear responsibility for achieving mission outcomes. Support managers provide technical assistance and support to enable mission delivery. Our activities reflect a mission-focused, high performing, high reliability enterprise consistently delivering on its commitments and addressing national needs. We constantly strive to drive innovation and reduce barriers to effectively and collaboratively accomplish our mission. Science and technology lie at the heart of our mission. The NNSA and its laboratories, plants, and test site are resources to organizations in the US Government with national security missions. We manage our laboratories, production, and other facilities in a manner that sustains and leverages their formidable technical capabilities in response to the ever-expanding challenges to our Nation's security. The NNSA national laboratories' mission is to provide premier science and technology support for the US national security mission. II-2 NAP-21 2-28-2011 We succeed only through teamwork, innovation, and continuous improvement. The long-term strategic future of the Nuclear Security Enterprise is a shared responsibility of Federal and Contractor staff and leadership and requires a strong partnership and trust. Individual and contract performance evaluations reflect contributions to mission outcomes. We treat our people as our greatest asset. All functions within NNSA are periodically evaluated in relation to mission enablement. We pursue our mission in a manner that is safe, secure, legally and ethically sound, and fiscally and environmentally responsible. The Administrator is ultimately responsible for ensuring the quality of the product/outcome; security of operations; the safety and health of employees and the public; and the protection of the environment. Mission and functional managers at the Federal and Contractor level bear full responsibility for achieving assigned objectives in a manner that is safe, environmentally responsible, secure, legally and ethically sound, and fiscally responsible. We manage risk across program objectives and operational performance to fulfill our mission.

Section 8

Decision-makers balance programmatic and operational risks to accomplish mission requirements and meet national security needs. Authorities are aligned to accountability and are assigned to decision-makers that are closest to the work. Certain critical decisions are made at the highest levels of NNSA due to a unique risk or as driven by law, Federal regulations, or to balance risks and resources across the Nuclear Security Enterprise (NSE). We apply validated standards and rely on rigorous peer reviews. Wherever possible and warranted, NNSA executes work in accordance with validated standards; where these standards do not apply or are inadequate, work processes are developed. Contractors are expected to employ best management practices. We constantly strive to reduce or eliminate requirements for transactional oversight where not required by statute or the Federal Acquisition Regulations. NAP-21 III-1 2-28-2011 Chapter Three - Definitions The following are definitions and supplementary Information Pursuant to the February 5, 2010, NNSA Operating Principles ACCOUNTABILITY: The state of being liable for explanation to a senior authority or more senior NNSA official for the exercise of authority. Ultimate accountability is to the Secretary, who may delegate authority or share responsibility for specified actions. The person receiving an authority is accountable to the delegator for the proper and diligent exercise of that authority. AUTHORITY: The permission afforded by law, regulation, directive, or written delegation from an authorized NNSA official enabling an NNSA employee, and/or M&O Contractor, to perform a function or reach and implement a decision. AUTHORIZING OFFICIAL: The authorizing official is the official who has the responsibility to grant or withhold permission for an activity. It is normally the line manager responsible and accountable for its completion, as well as closest to the work process. In most cases, this will be the Site Office Manager. However, certain (critical few) decisions must be made at the highest levels of NNSA due to a unique risk (safety, security, political, etc.) or as driven by law, rules, contract terms and conditions; or to balance risks and resources across the NSE. For example, the Administrator (or as delegated to the Principal Deputy Administrator) serves as the Central Technical Authority, as well as the final determining official for certain Differing Professional Opinions. BUSINESS MANAGEMENT SUPPORT SERVICES: Professional services in the areas of financial management (including budget, accounting, and strategic planning); human resources management, personal property management, procurement management, facility and real property management, and project management. CENTERS OF EXCELLENCE (COE): Single function business or technical services organization with required delegations that serve to supply expertise within DOE or NNSA. (e.g., Los Alamos National Laboratory as NNSA Electrical Safety COE). COGNIZANT SECURITY AUTHORITY (CSA): DOE and NNSA Federal employees who have been granted the authority to commit security resources or establish the allocation of security personnel or approve security implementation plans and procedures in the accomplishment of specific work activities. For NNSA operations and activities, statutory CSA flows from the Secretary, to the Administrator, to the Chief, Defense Nuclear Security,

Section 9

who may further delegate this authority to Site Office Managers (SOMs). Contractor specific requirements will be delegated by SOMs to the contractor. DELEGATION: Written permission, granted by a responsible authority to another NNSA employee, to perform a specific function on behalf of that responsible authority, usually containing guidance on the manner in which the authority is to be used. By delegation, III-2 NAP-21 2-28-2011 the responsible authority cannot diminish his or her responsibility for the consequences of the exercise of the authority. DESIGNATED APPROVING AUTHORITY (DAA): The DAA is a Federal employee who has the authority to grant formal accreditation to operate, withdraw accreditation, suspend operations, grant Interim Approval to Operate (IATOs), Interim Approval to Test (IATTs) or grant variances when circumstances warrant. The approval is a written, dated statement of accreditation that sets forth clearly any conditions or restrictions to system operation. The DAA is the only individual who accepts all inherently governmental risks for systems under their cognizance. The DAA can delegate any of the following responsibilities to a DAA Representative, except the signatory authority to grant accreditations, Approval to Operate (ATOs), IATOs, IATTs or waivers. DAAs are responsible and accountable for the security of the information and systems that the DAA accredits or approves for operation. The DAA is responsible to the applicable field element manager. The Administrator will delegate a DAA for all NNSA Enterprise information systems or major applications. This DAA authority may be assigned to other NNSA DAAs. All delegations and assignments are documented. The DAA ensures development and coordination of corrective action plans involving NNSA Enterprise systems in response to issues identified by other Federal agencies or DOE Office of Independent Oversight, peer reviews, and self-assessments. The enterprise DAA has the same responsibilities as the element DAAs, for systems under their cognizance. DOE/NNSA CONTRACTING OFFICER: Federal Acquisition Regulations (FAR) Part 2.101 and DOE O 541.1B state that there are three types of COs as set forth below: Contracting Officer (CO): A person with the authority to enter into, administer, and/or terminate contracts and make related determinations and findings. The term includes certain authorized representatives of the CO acting within the limits of their authority as delegated by the CO. (Note: a CO with the authority to perform all the functions listed above is known as a Procurement Contracting Officer (PCO). Administrative Contracting Officer (ACO): A CO who administers contracts. Termination Contracting Officer (TCO): A CO who is settling terminated contracts. (NNSA has no TCOs, only COs and ACOs). In accordance with DOE O 541.1B, Appointment of Contracting Officers and Contracting Officer Representatives, COs are appointed by the Head of the Contracting Activity, using Standard Form 1402, Certificate of Appointment. A CO's authority is specified on the face of their Certificate of Appointment (i.e., warrant) and may include the following: NAP-21 III-3 2-28-2011 The warrant states the type of instruments they are authorized to sign (e.g., procurement contracts, interagency agreements, sales, financial assistance instruments, etc.). The language on the warrant might also include a dollar limitation. If a dollar amount

Section 10

is not specified, it is presumed unlimited. In the case of an ACO, the warrant states, "Administration Only" and is specifically limited to certain actions as delegated by the Procuring Contracting Officer (PCO). For M&O contracts, the PCO is typically the Service Center (SC) CO who awards the contract. The PCO may delegate administrative authority to Site Office ACOs. . In addition, the PCO may delegate other authorities as deemed appropriate. A PCO may perform any and all functions including those delegated to an ACO. Site Office ACOs administer the M&O contracts for the SOM and report to the SOM directly or through an intermediate supervisor. Site Office ACOs may obligate Government funds, but only within the limits of their authority. The Site Office ACO is responsible for issuing the Work Authorization (WA), or amending it, as directed by the SOM so long as the WA (or amendment) is consistent with the contract scope, other contracts provisions, applicable laws and regulations, and adequate funding exists for the work. The Site Office ACO is responsible for implementing the Performance Evaluation Plan (PEP), and changes thereto, as long as the PEP (or changes) is consistent with the contract and applicable regulations and statutes. All COs are responsible for providing their independent, professional judgment in carrying out the above listed functions. A CO may not be coerced. Doing so may legally invalidate a contractual decision. In instances where the SOM believes that a CO‟s judgment is arbitrary, the SOM should raise the issue to the PCO first, the Head of Contracting Activity second or, lastly, the Senior Procurement Executive. DOE/NNSA CONTRACTING OFFICER REPRESENTATIVE (COR): Per DOE O 541.1B, a Government employee formally designated in writing to act as an authorized representative of a CO for specified functions that do not include actions that could change the scope, price, terms or conditions of a contract (e.g., technical performance direction). Under limited conditions, non-Government personnel may be appointed CORs on an as-needed basis that does not allow the performance of inherently governmental functions. DOE/NNSA OVERSIGHT: Per DOE P 226.1A, encompasses activities performed by DOE organizations to determine whether Federal and Contractor programs and management systems, including assurance and oversight systems are performing effectively and/or complying with DOE requirements. Oversight programs include operational awareness activities, on-site reviews, assessments, self-assessments, performance evaluations, and other III-4 NAP-21 2-28-2011 activities that involve evaluation of Contractor organizations and Federal organizations that manage or operate DOE sites, facilities, or operations. FEE DETERMINING OFFICIAL (FDO): The individual who makes the final determination regarding the amount of the award fee earned by the Contractor during the performance evaluation period. Line managers, program managers and functional managers provide input as requested to aid the FDO in making fee determinations. FIELD OFFICE: A field element with a single programmatic mission that is of limited duration. A Field Office may or may not have laboratories associated with the office, may have varying levels of independent authorities similar to those of an operations office (a DOE office having broad enduring field responsibilities), and may rely upon other offices for support. The

Section 11

main contact for internal and external customers related to program execution. The Field Office looks to the cognizant Deputy Administrator for programmatic direction. The Field Office category would include NNSA‟s overseas offices, currently managed by NNSA Federal officials in Moscow (Russia), Beijing (China), Vienna (Austria), Kyiv (Ukraine), Tokyo (Japan), Sofia (Bulgaria), Astana (Kazakhstan), and Islamabad (Pakistan). FRA (FUNCTIONS, RESPONSIBILITIES, AND AUTHORITIES) DOCUMENT: The FRA document defines NNSA management functions, responsibilities, and authorities and associated delegations to ensure that work is performed safely and efficiently. In the case of safety, this is as described in DOE M 411.1-1C, Safety Management Functions, Responsibilities, and Authorities Manual, in order to hold Federal personnel accountable for their assigned safety duties. NNSA‟s mission requires a delicate balance between safety and security. While the FRA document meets DOE requirements to define essential management safety functions, it also provides the functions, responsibilities, and authorities for nuclear security and other major organizations within NNSA that impact the ability to work safely. FUNCTIONAL ACCOUNTABLE EXECUTIVES (FAE): Federal executives who serve as the senior HQ (or in the case of the NNSA CFO, SC) Federal functional managers and who play a contributory role in how certain positions/employees that do not normally report to them, in a supervisory/management chain, are staffed, compensated, and developed, and how the employees perform their functions. For NNSA, FAEs include the Associate Administrator for Defense Nuclear Security (physical, and cyber with CIO), Associate Administrator for External Affairs (congressional, public and intergovernmental affairs), Associate Administrator for Acquisition and Project Management (Senior Procurement Executive and construction/projects), Associate Administrator for Management and Budget (budget, human resources, and administration), Associate Administrator for Safety and Health (nuclear safety and ES&H), Chief Information Officer (IT, and cyber with Defense Nuclear Security), General Counsel (legal) and Chief of Defense Nuclear Safety (CDNS). FUNCTIONAL MANAGER (FM): Federal and Contractor functional managers are mission- enablers and provide technical assistance or subject matter expertise and resources to enable mission delivery in support of line and program managers to implement delegated responsibilities. Working with SOMs, SC managers and their functional counterparts, are responsible with line and program managers for achieving assigned objectives in a manner that NAP-21 III-5 2-28-2011 is safe, environmentally responsible, secure, legally and ethically sound and fiscally responsible. HEAD OF THE CONTRACTING ACTIVITY: The agency head may establish contracting activities and delegate broad authority to manage the agency‟s contracting functions to heads of such contracting activities. Contracts may be entered into and signed on behalf of the Government only by contracting officers. HIGH-HAZARD ACTIVITY: An activity associated with material, energy source, or operation that, unless controlled, could cause serious injury or death to workers or the public, or serious damage to the environment. HQ STAFF: Staff provides the resources and services necessary for the Administrator to establish policy, issuing approvals required by DOE directives, etc. HQ staff is generally

Section 12

comprised of line managers, program managers, and functional managers. HQ staff interface with other governmental customers and stakeholders, develop and defend corporate budgets, assist field elements in evaluating Contractor performance, evaluate field oversight programs and conduct for-cause reviews in collaboration with field elements. INHERENTLY GOVERNMENTAL: The 1998 Federal Activities Inventory Reform Act (FAIR Act) classifies an activity as inherently governmental when it is so intimately related to the public interest that it must be performed by Federal employees. LINE MANAGEMENT: Line managers have both program and functional management responsibilities. There is an unbroken chain of line management which extends from the Secretary of Energy through the Under Secretary (NNSA Administrator), who sets program policy and plans and develops assigned programs, to the field element managers (who are responsible for execution of these programs). Work objectives and directions are communicated to the contractor through the contract. (For NNSA this chain goes from the NNSA Administrator/Principal Deputy Administrator through the statutory line management Assistant Deputy or Associate Administrators (NA-10, NA-20, and Defense Nuclear Security), to the Site Office Manager. MANAGEMENT AND OPERATING (M&O) CONTRACTOR: Those private sector entities conducting work pursuant to a management and operating contract. This includes Laboratories, the Nevada National Security Site (NNSS), and Plants. MISSION: NNSA is responsible for the management and security of the nation‟s nuclear weapons, nuclear nonproliferation, and naval reactor programs. It also responds to nuclear and radiological emergencies in the United States and abroad. Additionally, NNSA Federal Agents provide safe and secure transportation of nuclear weapons and components and special nuclear materials along with other missions supporting the national security. NNSA‟s mission is accomplished through achieving its various programmatic goals in an efficient, safe, secure, legally compliant, and environmentally sound manner. Mission encompasses all of these elements while ensuring site stewardship for long-term mission viability. III-6 NAP-21 2-28-2011 NUCLEAR ACTIVITIES: Activities or operations that involve, or will involve, radioactive and/or fissionable materials in such form and quantity that a nuclear or a nuclear explosive hazard potentially exists to workers, the public or the environment. The term „Nuclear Activities‟ does not include activities involving only incidental use and generation of radioactive materials or radiation such as check and calibration sources, use of radioactive sources in research and experimental and analytical laboratory activities, electron microscopes, and X-ray machines. NNSA SERVICE CENTER: An organization that provides business, administrative, and technical support to multiple Field and HQs elements. NUCLEAR SECURITY ENTERPRISE RISK: Accumulated NNSA mission risk across NNSA programs and operations at all levels of NNSA, from the M&O Contractor or National Laboratory, to the SOMs, through NNSA Program Offices, to the Office of the Administrator. This risk is that of adverse budgetary, physical infrastructure, or inadequate design consequences from mission non-execution, including failure of safeguards or security or safety systems, resulting in harm or potential harm to the public, workers, or the environment.

Section 13

PERFORMANCE EVALUATION PLAN (PEP): PEPs are associated with M&O contracts that are award fee contracts. PEP‟s are NNSA‟s integrated corporate plans that clearly document the process, associated performance objectives, performance incentives including multi-site performance incentives, award-term incentives, and associated measures and targets by which the Contractor‟s performance will be evaluated and rated. PROGRAM OFFICE: A HQ organization that is responsible for executing program management functions. PROGRAM MANAGER (PM): Program Managers set expectations, program goals and priorities, integrate overall program plans and priorities, and when necessary, provide technical program direction in accordance with their COR authorities to the Contractors directly (with parallel communication to the Site Offices). Program managers are responsible for determining which programs to implement, identifying program needs/goals, determine funding of the programs, decide allocation of money on a program, monitor progress and determine milestones of the program, and evaluate Contractor‟s performance per the PEP. The programs are national in scope and span multiple M&O Contractor sites. PMs are responsible for the ultimate resolution of any technical program conflicts considering input provided by both the COR and the SOM. Program managers share in the responsibility and accountability for mission accomplishment and site stewardship. With regard to Work Authorizations, the PM is responsible for three things: (1) Ensuring the WA is consistent with the program implementation plans. If there is an inconsistency, the PM needs to update or modify the WA or update the implementation plan to accurately reflect the change; (2) Providing technical direction to the M&O Contractor via a WA; and (3) Ensuring the PEP is consistent with the WA. If there is an inconsistency, the PM needs to process requisite changes to the PEP with the M&O and Site Office staff. In conjunction with the SOM, the CO issues the appointment letter to the M&O COR consistent with the PM NAP-21 III-7 2-28-2011 recommendation and the M&O COR responsibilities. PROGRAM DEPUTY ADMINISTRATOR: The HQ manager responsible for the support, planning, acquisition, operation, maintenance, and disposition of physical assets related to infrastructure. A program Deputy Administrator is one to whom designated field offices directly report and who has overall landlord responsibilities for the assigned direct reporting elements. RESPONSIBILITY: The state of being liable for the outcome of the exercise of an authority granted by law, regulation, or directive. Responsibility differs from accountability in that a responsible official "owns" the function for which they are responsible; it is an integral part of their duties to see that the function is properly executed, to establish criteria for the judgment of excellence in its execution, and to strive for continuous improvement in that execution. A responsible official is associated with the outcomes of the exercise of authority, whether it was delegated, or whether the delegate properly followed guidance. Accountability, on the other hand, involves the acceptance of the authority for execution (or for further delegation of components of execution) by using guidance and criteria established by the responsible authority. RISK ACCEPTANCE OFFICIAL: A risk acceptance official is the risk acceptor/decision-

Section 14

maker pursuant to the authority delegated by the NNSA Administrator or as specified in a DOE/NNSA directive. Risk acceptance across programs and operations should be exercised at the lowest level where the risk can be appropriately understood and evaluated. At each level within the line management chain extending from the Administrator to the Contractor, decision makers serve as the risk acceptance officials for those decisions they are authorized to make. In other words, the authority to make a decision carries with it the authority to accept, on behalf of NNSA, the risks associated with that decision. Within the NNSA, decision-making and the attendant risk acceptance is normally granted to the lowest level that will be responsible for and can exercise the resources needed to address any resulting undesirable consequences. Decisions involving risks that can be addressed at the Contractor level will generally be made at the Contractor level. When the risks of a bad decision would significantly impact the ability of a site to execute Site-level functions, or when the decision is an inherently governmental decision that is not required to be made at a higher level, it will be made at the Site Office level. Decisions that affect more than a single site that affect enterprise-level functions, or that are required to be made at a HQ level will be made at HQ. Because of the shared responsibility, certain decisions that have significant implications or impacts for more than one organizational level are made at the lowest level, but subject to concurrence of other affected components within the line management chain. The requirement for higher-level concurrences must be used sparingly and must not usurp the effective exercise of operational line authority and responsibility. When there is ambiguity as to where a decision is best made, the bias will be to make the decision and any needed concurrences at the lowest capable level. III-8 NAP-21 2-28-2011 RISK INFORMED: A decision making approach whereby conclusions drawn from an assessment of past performance, hazards involved, and the likelihood and consequences of accidents are considered together with other factors to make decisions that better focus contractor and Federal oversight attention on design and operational issues commensurate with their importance to public health and safety. A "risk-informed" approach enhances the deterministic approach by: (a) allowing explicit consideration of a broader set of potential challenges to safety, (b) providing a logical means for prioritizing these challenges based on risk significance, operating experience, and/or engineering judgment, (c) facilitating consideration of a broader set of resources to defend against these challenges, (d) explicitly identifying and quantifying sources of uncertainty in the analysis (although such analyses do not necessarily reflect all important sources of uncertainty), and (e) leading to better decision- making by providing a means to test the sensitivity of the results to key assumptions. SECRETARIAL OFFICER: Secretarial Officers are the Secretary, Deputy Secretary, and Under Secretaries (e.g., the NNSA Administrator). SENIOR PROCUREMENT EXECUTIVE (SPE): The Director of Acquisition and Supply Management is the SPE and is responsible for ensuring that each member of the acquisition workforce is certified to the career level appropriate to the grade they occupy or to their

Section 15

responsibilities, in accordance with DOE O 361.1B or its successor. The SPE is also responsible for the development and oversight implementation of NNSA-specific policies, procedures, programs, and management systems pertaining to procurement and financial assistance, real and personal property management, supply chain management, Contractor human resources, and related activities. The SPE is responsible for ensuring that all requisite directives are incorporated into the NNSA M&O contracts and compliance with their requirements is consistently implemented by NNSA M&O COs. SITE OFFICE: Field element responsible for contract administration and operational oversight, typically located at the Contractor-operated Site. The NNSA organization, located at a given site, having responsibility for directing and conducting oversight of Contractor operations associated with that Site. SITE OFFICE MANAGER (SOM): The SOM is the NNSA employee with primary and overall responsibility for a Site Office. The SOM oversees the M&O Contractor‟s program execution and ensures NNSA direction and guidance is implemented through the M&O contract, prime security contract, and various additional supporting contracts and that all applicable requirements are met. TECHNICAL SUPPORT SERVICES: Security, safety, engineering, and other technical services obtained for audit, on-site support, training, or other purposes. TRANSACTIONAL OVERSIGHT: An oversight model (or an element of an oversight model) that ensures contractor performance by identifying those technical areas, activities or actions that will be observed, reviewed, approved, or concurred on by the oversight organization. Limited latitude for past performance is considered in establishing what must be included due to the hazard involved and the inability to recover from inadequate NAP-21 III-9 2-28-2011 performance. Transactional oversight is most appropriate for nuclear and high-hazard activities. In general, oversight models will include some degree of transactional oversight for nuclear and high-hazard activities, complemented by a systems-based approach for non- nuclear or lower hazard activities that ensures performance by ensuring that effective management systems have been implemented. NAP-21 IV-1 2-28-2011 Chapter Four - Description of Governance Objective/Critical Factors for Governance The objective of the NNSA Reengineering and Governance Transformation Initiative is to streamline how NNSA does business and to reduce the cost of operations and increase productivity to maximize mission accomplishment. This will enable improved safety, performance, and provide greater Contractor flexibility and accountability; focused risk- informed oversight; eliminate redundant and non-value-added reviews; and improved efficiencies and availability of Federal and Contractor resources to focus oversight on highest risk areas and to support the NNSA mission. Critical factors of the NNSA Governance model include: Rigor and implementation of oversight for nuclear and high-hazard activities is maintained and enhanced; oversight for other activities is graded consistent with the associated risks. NNSA‟s system of management controls is clearly and specifically defined to ensure a common and consistent understanding within NNSA, the Contractor community and with other NNSA stakeholders. NNSA‟s requirements and standards system leverages applicable commercial industry

Section 16

standards and requirements where appropriate, and effectively and efficiently accomplishes the mission of achieving programmatic objectives in a manner that is safe, secure, and compliant with environmental standards. Roles, responsibilities, and accountabilities at NNSA HQ, Site Offices, and Contractor organizations are clearly aligned with the reformed governance process; all personnel work effectively to implement the reformed approach. Specific and objective metrics establish a performance baseline, measure the effectiveness and efficiency of the mission accomplishment, and incorporate feedback and improvement mechanisms. Programs and support functions are benchmarked with industry standards to ensure they are providing the desired results. Governance Definition/Attributes Governance is the system of management and controls exercised in the stewardship of the organization. In the NNSA, this is implemented through a collaborative partnership between organizations to accomplish a common mission that preserves the independence needed to effectively function in its self-regulatory role. Within the NNSA, this collaborative partnership is defined by clear roles and responsibilities that form the governance framework that accomplishes the mission of meeting program objectives in a safe, secure, effective, and efficient manner. The roles and responsibilities establish a well-defined line management (see definitions Chapter Three) chain that acts as IV-2 NAP-21 2-28-2011 the owner of the mission, and that is responsible for translating requirements into work to be done by the Contractor. The line management chain is headed by and accountable to the Administrator, who exercises appropriate management assurance systems to ensure that requirements are understood and implemented effectively. The governance framework is the contract that defines expectations and authorities, and verifies performance by using objectives, requirements, assessments, metrics, awards, and penalties. Governance invokes trust and confidence between NNSA and its M&O Contractors. This trust is supported by strong Contractor Assurance Systems that foster clear accountability and appropriate risk-informed decision making on the part of both the Contractor and the NNSA. Governance Implementation Each Site maintains responsibility for defining its Site-specific governance reform implementation plans that incorporate Enterprise-level governance initiatives, milestones and performance incentives. The foundational aspects of Site-level implementation must align to the governance definition, objectives, and critical factors outlined in this document. Implementation will be tailored for each Site since each Site represents different missions, associated hazards, and contract structures. The collaboration between Sites, along with lessons learned, will serve as guideposts and will ensure the sharing of best practices and lessons learned. Other NNSA performance targets and activities will be incorporated into Site-level implementation plans, such as: The Enterprise Integration Multi-Site Performance-Based Indicators that will emphasize the collective success of the NSE. The Defense Programs “Getting the Job Done” actions related to governance transformation and oversight. DOE/NNSA Strategic Plans. NAP-21 V-1 2-28-2011 Chapter Five - Organizational Roles and Responsibilities

Section 17

This chapter establishes policy on the general division of responsibilities between NNSA organizations and levels, and provides selected detailed responsibilities to frame the intended relationships. While the division of roles and responsibilities for all line, program, and functional areas are expected to be consistent with the roles and responsibilities contained in this document, it is recognized that the HQ/field division of responsibilities could vary to some degree between NNSA elements because of applicable statutory and regulatory requirements. NNSA authorities will align to accountability and, in general, will be delegated to the lowest level decision-maker whose access to information and span-of-control matches the decision to be made. More detailed assignment of HQ and field roles and responsibilities within specific line, program, and functional areas will be established during the development and promulgation of a comprehensive NNSA Functions, Responsibilities, and Authorities (FRA) Document. The NNSA FRA Document will also explicitly identify the regulatory responsibilities that belong to NNSA; will clearly address the roles, responsibilities and authorities of NNSA elements being fulfilled at HQ, field and Contractor levels; and will describe the interfaces with external organizations. Line managers bear full responsibility for achieving assigned program objectives in a manner that is safe, environmentally sound, secure, legally, ethically, and fiscally responsible and for compliance with those requirements that fall within the span of their control. Primary responsibility rests with the lowest line manager responsible for directing all of the resources needed to meet a specific requirement or objective. In most cases, this is a NNSA Site Office Manager (SOM), but, consistent with the tiered risk decision-making authority, it may be a HQ line manager. All line, program, and functional managers (see definitions section for the definition of these titles) are invested in the mission, whether they are scientific, technical, administrative, or logistic in nature. Line Managers are responsible to ensure both programmatic and functional objectives are balanced for successful mission accomplishments. Program managers have responsibility for the programs under their cognizance, and have appropriate authority over the elements that influence their program‟s success. Functional managers integrate and balance diverse requirements; and are responsible for the successful, appropriate, and efficient execution of specific functions (e.g., safety, security, IT, and HR) that play a critical role in achieving the NNSA missions. Line, Program and Functional Managers must all ensure that the rigor and implementation of independent oversight for nuclear and high hazard activities continues to be maintained and enhanced. NNSA Headquarters NNSA HQ provides the policy, resources, and objectives necessary to integrate and accomplish the NNSA mission. HQ line, functional, and program managers have responsibility for Enterprise-wide integration. Certain decisions must be made at NNSA HQ due to the degree of risk (safety, security, programmatic etc.), or as required by law or regulation, or the need to balance risks and resources across the NSE. In these cases, those V-2 NAP-21 2-28-2011 decisions having the greatest risk or consequences will be made by NA-1 (or NA-2), other

Section 18

senior executives such as NA-10, NA-20, Defense Nuclear Security, or other managers when delegated or designated formally in writing. NNSA also has a self-regulatory role in certain instances (e.g., when the Administrator issues Price Anderson Amendments Act enforcement or worker safety rule enforcement) and ensures compliance with requirements. NNSA maintains the necessary independence from NNSA‟s owner or customer role to ensure effective Federal self-regulation while avoiding excessive or overly burdensome regulation. The regulatory responsibility is predominately accomplished at the Site Office level, but some NNSA HQ elements also have regulatory responsibilities. The NNSA FRA Document will provide additional regulatory detail for NNSA elements exercising regulatory responsibilities. NNSA HQ functional elements provide technical assistance and support by employing trained and competent staff to satisfy specific functional requirements or deliver specific goods and services. HQ functional managers provide support to line and program managers at HQ and field elements to help them implement their delegated responsibilities. NNSA HQ functional managers with statutory or delegated responsibilities are expected to periodically assess NNSA compliance with statutes, regulations, and directives within their functional areas, and to provide the results of their evaluations to appropriate levels of NNSA line management for disposition. Functional evaluations of field performance by HQ functional area managers and their staff will be conducted in conjunction with scheduled Site Office assessments to the extent feasible. Dedicated HQ functional area assessments should be accomplished as needed to ensure appropriate independence, to meet regulatory requirements, or as directed by the Administrator or Principal Deputy Administrator. Assessment activities will be coordinated with Site Offices. NNSA HQ functional elements provide technical assistance, remove barriers, identify program vulnerabilities, and provide support to enable mission delivery. Functional elements also assist the delegating officials to determine that the program or Site Office has the resources and qualifications to execute their responsibilities effectively. All functions play an equally vital role in meeting mission success and supporting site stewardship. The NNSA Administrator has both the authority and accountability for decision-making on any decision that is the responsibility of NNSA, serving as the ultimate risk acceptor for NNSA, to accomplish mission requirements and meet national security needs. The NNSA Administrator or Principal Deputy Administrator serves as the Fee Determining Official (FDO). These authorities may be delegated as appropriate. HQ Program Managers execute the following functions to implement their responsibilities in NNSA in conjunction with HQ and Field line managers/Site Offices: Perform strategic planning, establish policy, perform program planning, set program priorities, design programs, set program goals and performance targets, and facilitate operational planning to prioritize program objectives and the options to achieve those objectives. Identify barriers to achieving program success and options to overcome those barriers. NAP-21 V-3 2-28-2011 Support other Federal agencies by leveraging NNSA resources to achieve other vital mission work in areas where our resources are value-added.

Section 19

Integrate program, budget, and direction to ensure consistent and balanced direction to the field by providing programmatic technical direction; with NNSA-wide expectations, Site stewardship, and long-term viability of the enterprise considered. Execute programs to accomplish program objectives through Site Offices, the NNSA SC, M&O Contractors, and/or other stakeholders. Working closely with SOMs, play a significant role in the evaluation of the M&O Contractors and Site Office performance through periodic program reviews and/or by (a) conducting assessments of Site Offices, (b) participating in Site Office assessments of Contractors , (c) analyzing performance information provided by indicators/metrics, line oversight activities of Site Offices, CASs, and other internal independent or external agencies, and when designated in writing, by accepting programmatic deliverables if they meet Government requirements. Work among HQ Offices and Site Offices to implement program direction and to coordinate program adjustments. Where cost, scope or schedule parameters exceed established bounding parameters, or changes could have significant Site-level ramifications, Program Managers will work through the appropriate Site Office(s) so that designated Contracting Officer(s) ensure that WA and other contract changes adequately address all changes. Communicate directly with their Site Office or NNSA SC functional area counterparts. (Note: Parallel communication with SOMs should be used on resource impacting issues/items and all technical direction or changes in tasking must go through the applicable Site Office or NNSA SC line management for contract WA changes.) Where program direction or changes could affect other programs or activities; impact the Site Office Manager‟s role as the Federal risk acceptance official; or for overall mission accomplishment at the Site level; Program Managers will work with the SOM to identify and resolve the issues. HQ Functional Managers, particularly Functional Accountable Executives, perform the following functions to implement their responsibilities: Perform strategic planning, establish policy, perform functional area planning, set functional priorities, design programs, set functional goals and performance targets, and facilitate operational planning to prioritize functional objectives and the options to achieve those objectives. Identify barriers to achieving functional success and options to overcome those barriers. Support other Federal agencies by leveraging NNSA resources to achieve other vital mission work in areas where our resources are value-added. V-4 NAP-21 2-28-2011 Integrate function, budget, and direction to ensure consistent and balanced direction to the field by establishing overall policy direction and NNSA-wide expectations, stewardship, and requirements to ensure the long-term viability of the enterprise. Execute programs to accomplish functional objectives through Site Offices, the NNSA SC, M&O Contractors, and/or other stakeholders. Working closely with SOMs, play a significant role in the evaluation of the M&O Contractors and Site Office performance through periodic program reviews and/or by (a) conducting assessments of Site Offices, (b) participating in Site Office assessments of Contractors , (c) analyzing performance information provided by indicators/metrics, line oversight activities of Site Offices, CASs, and other internal independent or

Section 20

external agencies, and when designated in writing, by accepting programmatic deliverables if they meet Government requirements. When requested, provide advice to Site Offices, the NNSA SC, and the Office of Secure Transportation in their areas of expertise. (e.g., compensation, position descriptions, annual performance of their field or SC counterparts, etc.) Establish specified core competencies and training requirements for employees in positions within their respective functional areas at field elements (new training or certification requirements, within the control of NNSA, must be approved in advance by the Principal Deputy Administrator). Communicate directly with their Site Office or NNSA SC functional area counterparts. (Note: Parallel communication with Site Office Managers should be used on resource impacting issues/items and all technical direction or changes in tasking must go through the applicable Site Office or NNSA SC line management for contract WA changes.) Support the Administrator in establishing NNSA technical positions for use by line and program management in their functional areas. Develop NNSA policy in their functional areas, if needed, for promulgation by the Administrator. Provide technical assistance in obtaining relief from requirements in their functional areas, where warranted. Assist approving officials in evaluating relief requests and advising on appropriate compensatory measures to be established. NNSA Site Offices In accordance with HQ program direction, Site Offices led by a SOM are responsible for on- Site Federal oversight and administration of the M&O and other direct contracts. NNSA SOMs serve as line management, Site-level mission integrator, and the authorizing official for activities at the Site on behalf of the Administrator, Deputy Administrator for Defense Programs, Deputy Administrator for Nuclear Nonproliferation, and/or Associate Administrator for Defense Nuclear Security. They are responsible for the safe, secure, and efficient operation and construction of facilities under their purview. Additionally they share NAP-21 V-5 2-28-2011 in the responsibility and accountability for mission accomplishment and site stewardship. Site Office Managers are the principle advocate for both stewardship and long-term viability of their Sites. To accomplish this, Site Office personnel: Oversee and, together with inputs from HQ program and functional managers, hold the M&O Contractors senior management accountable for contract performance. Validate and oversee a comprehensive and effective CAS consistent with the M&O/Contractor structure and focused on mission outcomes. Work with HQ program managers and M&O Contractors to maintain the knowledge and operational mission activities necessary to provide risk-informed oversight of program and non-programmatic work and serve as effective liaisons to program offices as they manage core mission programs. Integrate assessments by DOE/NNSA organizations (e.g., Office of Health, Safety and Security, Office of Inspector General, various HQ entities) to eliminate duplication and non-value added reviews, assessments, evaluations. Perform assigned regulator/self-regulator duties and functions. Ensure the appropriate level of assessments and evaluations are performed aligned with the level of risk and consistent with delegation of oversight. Establish, in collaboration with HQ managers and the Contractor, annual contract

Section 21

performance outcomes that drive efficiencies in mission areas while meeting acceptable DOE or industry standards in appropriate areas and ensure timely negotiation and modification of the contract for PEPs, as required. Oversight should assure effective compliance, be performance-based, mission-focused, and make full use of the CAS. Set Site-level requirements and performance expectations with inputs from HQs managers to accomplish assigned missions, ensure security of operations, and protect the environment, safety and health of workers and the public. Maintain a mission-focused, risk-informed field presence to verify effectiveness and accuracy of Contractor assurance/performance systems. Pursuant to written delegation letters, may serve as CORs for M&O and non-M&O contracts, Financial Assistance Awards, and Interagency Agreements supporting their respective NNSA Site Office. Additionally, the SOM: Integrates Federal Government mission deliverables with contract, business, and operational risks. The SOM approves all Site level actions that are contractually executed by a CO. Serves as on-site Federal risk acceptance official, operational risk acceptance agent and/or approval authority for NNSA to execute mission requirements and ensure adequacy of safety controls. As an example, when delegated, SOMs approve Authorization Agreements, Safety Evaluation Reports for Documented Safety V-6 NAP-21 2-28-2011 Analyses, and the startup/restart of nuclear facilities, implicitly accepting for NNSA the Federal risks inherent in those approvals. Serves as the Designated Approving Authority (DAA) of Site cyber networks and has the authority to grant formal accreditation to operate, withdraw accreditation, suspend operations, grant Interim Approval to Operate (IATOs), Interim Approval to Test (IATTs) or grant deviations when circumstances warrant when designated in writing. These authorities may be delegated further. Serves as the Fee Determining Official (FDO) if designated in writing. May be designated a CO or Administrative Contracting Officer (ACO) when the appropriate qualification requirements of DOE O 361.1B or its successor have been met and determined appropriate by the Senior Procurement Executive. Oversees the M&O Contractor‟s implementation of established safeguards and security policy requirements for the Defense Nuclear Security Program. Approves and manages the Contractor‟s PEP and, therefore, has the authority (executed by CO) to modify the Contractor's performance objectives and performance- based incentives, with input from HQ managers. Defines and implements the Site Office's oversight and assessment program based upon directives, HQ guidance, and available resources; prioritized/informed by risk. Routinely involves Functional Area Executives (FAEs) in technical oversight of key individuals in their respective areas of responsibility to include, when appropriate, input on compensation, position descriptions, position establishment, mid-term and annual performance evaluations, and budgets of those functional areas. Oversees the M&O Contractor‟s program execution and implementation of safety and security programs at their Site. NNSA Service Center (SC) The NNSA SC supports Site Offices, HQ Program Offices and functional elements, in the accomplishment of mission activities over a broad range of functional areas. The SC provides

Section 22

qualified and certified business (i.e., procurement; personal and real property and contractor human resource oversight and management) support personnel. Roles can include PCOs for M&O Contracts, COs for procurement actions (i.e., non-M&O Contracts; Financial Assistance Awards and Interagency Agreements), Organizational Property Management Officer, Industrial Property Management Specialists, Industrial Relations Specialists and Certified Realty Specialists with CO Authority. The NNSA Chief Financial Officer (CFO) reports to the NNSA SC and is aligned with the DOE HQ CFO (indirectly). The DOE HQ CFO sets policy and the NNSA CFO serves as the COR for financial and allotment related services for NNSA M&O contracts. The NNSA SC also delivers most human resource operational services with the exception of program oversight and development, policymaking, management and administration of NNSA's Senior Executive Service (SES) Program and human resource services to the Office of the Administrator. The NNSA SC also provides a core group of technical support personnel qualified to the majority of the extremely diverse NAP-21 V-7 2-28-2011 DOE/NNSA Technical Qualification Program Functional Area Qualification Standards essential in supporting mission accomplishment. To accomplish these functions, NNSA SC personnel: Support mission work and optimize efficiency by providing standardized business, administrative, safeguards and security and technical services for Site Offices, HQ and programs. Team with NNSA HQ, Site Offices, M&O Contractors (National Laboratories, Nevada National Security Site (NNSS), and Plants), and other stakeholders for mission accomplishment and Site stewardship. Generally serve as the PCO for M&O contracts. Working through Site Offices, ensure M&O Contractor accounting systems maintain financial integrity and credibility. In conjunction with the Site Office, help verify that NNSA has a thorough understanding of M&O costs and charges to the contract and verify that the charges are allocable, allowable, and reasonable. Ensure a core level of qualified technical resources to support Site Offices and HQ activities, ensuring crosscutting technical expertise is available to the NSE. Assist HQ and Site Offices, as requested or required, to support oversight, mission, business, and cost analysis needs. Support NNSA‟s implementation of human resources programs, policies, and practices for the Site Offices, NNSA SC, and most of NNSA HQ in the following areas: performance management and employee relations, employee benefits and processing, position classification and staffing/recruitment, learning and career development, and workforce planning/manpower utilization. Provide secure information management services to NNSA HQ, Site Offices, and the NNSA SC, with full life cycle business automation for Federal customers including communication routes, infrastructure purchases, and cyber security documentation. Provide Equal Employment Opportunity (EEO) and Diversity support to the Site Offices, NNSA SC and some HQ offices in the processing of discrimination complaints, mediation, training and workforce demographics, and workforce demographic reports for the NNSA in accordance with the EEO Commission and/or the Office of Personnel Management regulations. Manage the NNSA Personnel Security Program, including all aspects of investigations/reinvestigations to include Homeland Security Presidential Directive-12

Section 23

adjudication, Special Program Reviews (Human Reliability Program, Sensitive Compartmented Information, etc.), and adjudication of certain Incident Reports, with the exception of NNSA HQ personnel. Process all Freedom of Information Act/Privacy Act requests related to NNSA, including serving as the authorizing and denying official for requests. V-8 NAP-21 2-28-2011 M&O Contractors (National Laboratories, NNSS, and Plants) The M&O Contractor senior executive is responsible for the effective management of their enterprise. M&O Contractors work in full partnership with NNSA to design, certify, test, and assess the Nation‟s nuclear deterrent utilizing a base of robust science, technology and engineering tools and competencies, and production capabilities. They also provide the leadership and foundation of the Nation‟s science and technology base using leading edge fundamental science and innovative tools and technologies to deliver solutions across the spectrum of the Nuclear Security Enterprise (NSE) mission of nuclear deterrence, intelligence analysis, foreign assessments, nonproliferation and nuclear detection, nuclear counter- terrorism, and energy security. They steward the nation‟s NSE science, engineering, and production resources and knowledge and are accountable and responsible for the long-term health and success of the enterprise. NNSA line management provides direction to the M&O Contractors by authorized individuals pursuant to contracting requirements. M&O Contractors are tasked with efficiently and innovatively implementing the long-term Federal strategic vision of the NSE. They ensure work in the national interest is done consistent with contract requirements and focused on delivering mission results. To accomplish this, M&O Contractors: Ensure that all nuclear and high-hazard activities are conducted with a high level of rigor in accordance with applicable DOE directives. Determine and recommend the most cost effective means of accomplishing the missions and objectives established by NNSA in a safe and secure manner. Establish, implement, and execute a comprehensive, effective, and sound performance assurance program, supported by critical self-evaluations and internal performance assessments, using assurance programs to continually improve effectiveness. Create and maintain a transparent assurance system with the necessary level of comprehensiveness to sustain stakeholder confidence and maintain acceptable levels of performance. Provide high quality products and services in a safe, secure, and legally compliant manner and maintain, and where possible, continuously improve safety, security, efficiency, and productivity, for greater mission success. Comply with all applicable Federal, State and local laws, permits and other legally encumbering agreements. Provide and ensure the stewardship and long-term viability, safety, security and health of the workforce, the environment, the facilities, the assets, and the infrastructure of the NSE that are entrusted to their care. Deliver the products, services and/or outcome necessary to meet the requirements set by NNSA line and program management through contract vehicles. NAP-21 V-9 2-28-2011 Operate collaboratively with NNSA to achieve common goals and NNSA‟s vital and urgent needs in a safe and secure manner, while supporting NNSA‟s independent role as an owner and regulator.

Section 24

Attract and retain the highest quality workforce and protect them by maintaining a safe and secure environment. NAP-21 VI-1 2-28-2011 Chapter Six - Framework for a Contractor Assurance System (CAS) Purpose The CAS is a Contractor-designed and utilized system to manage performance consistent with contract requirements. The CAS allows the Contractor to assess its performance, provide data into the Contractor‟s management decision-making process, and allow the Contractor to more effectively manage processes, resources, and outcomes. An effective CAS provides transparency between the Contractor and NNSA to ensure alignment across the NNSA Enterprise to accomplish mission needs, and for NNSA to determine the level of Federal oversight necessary. Therefore, an effective CAS enables continuous improvement of Contractor performance, integrates and aligns Contractor management systems, and supports corporate parent governance. The purpose of a CAS is threefold: A CAS is a primary tool used by Contractor management to measure, improve, and demonstrate performance and ensure that mission objectives and contract requirements are met. For example, a CAS will ensure that programmatic goals are achieved; workers, the public, and the environment are protected; materials, property, and information is secure; and operations, facilities, and business systems are efficiently and effectively operated and maintained. A CAS is used by the Contractor to integrate its governance and management systems to achieve acceptable contract performance outcomes and provide assurances to NNSA that it will deliver on mission objectives. A robust and effectively functioning CAS provides transparency and builds trust between NNSA and its Contractor, helps to ensure alignment across the NNSA Enterprise to accomplish and address mission needs, and allows NNSA to optimize its oversight functions by leveraging the processes and outcomes of its Contractors. Features of a Fully Functional CAS An effective CAS accurately measures performance and is critical to ensuring that mission objectives and contract requirements are met. In its execution, a CAS should properly balance available resources, create internal controls that are both effective and efficient, ensure clear roles and responsibilities, and establish expectations for performance. A fully functional CAS will allow both the Contractor and the NNSA to monitor performance and tailor the level of necessary oversight based on demonstrated performance data. A CAS and its elements should be formally described and documented, and include change notifications as prescribed by the contract and/or the CAS description document. The CAS description should include processes, key activities, and accountability. CAS elements should be well implemented and used by Contractor management and governance to assure fulfillment of the contract transparent to the NNSA. The CAS should be systematically and routinely evaluated and improved to ensure that it is consistently and reliably achieving its purpose. VI-2 NAP-21 2-28-2011 The basic elements of a CAS are accurate performance data, continuous improvement, issue and corrective action management, measures, and assessments. A management system with a fully implemented and effective CAS should exhibit these critical characteristics: The CAS provides performance information that is accurate, reliable, and timely in all mission areas.

Section 25

– Information is transparent - substantive insight enables effective oversight Third Party certification is achieved as appropriate Self assessments are demonstrably rigorous and risk-informed Contractor and Federal Managers use the information provided by the CAS as a primary tool to ensure the meeting of mission objectives and contract requirements. Executive leadership uses the CAS to guide its actions to include strategic performance targets and objectives Substantive parent organization involvement and support exists The CAS is integrated with and consistently applied across all Site activities The CAS effectively drives needed performance improvement. The CAS clearly measures actual performance compared to expectations to drive continuous improvement Negative trends are identified and corrected before becoming issues Where issues are identified, the CAS drives effective and efficient causal analysis, trending, and corrective action management Evidence of Progress Objective evidence will demonstrate progress in achieving effective use of the CAS: The processes used to implement the elements described in a Contractor‟s CAS description document are predictable, repeatable, and consistently used by the Contractor The CAS is used to systematically evaluate changes needed to improve performance based on a graded approach to risk management The Site delivers sustained or improved performance with improved productivity and/or reduced cost, which is evident by performance indicators that trend/track performance. Key milestones are successfully accomplished The Site attains the critical characteristics of a management system that has fully implemented an effective CAS (as described above) As CAS effectiveness is demonstrated, NNSA will reduce duplicative or transactional oversight in favor of system oversight, based on demonstrated performance. NAP-21 VI-3 2-28-2011 Relationship of CAS to Corporate Governance Corporate governance is a subset of NNSA governance. A Contractor‟s corporate governance system provides reasonable assurance to the NNSA that the Contractor meets expectations, and ensures that effective improvement actions are underway when the Contractor does not meet expectations. The CAS is integrated with and supports its corporate governance framework consistent with the expectations defined in the Contractor‟s prime contract. The integrated information provided by the CAS should enable the members of the Contractor‟s governing body to hold Contractor management accountable for mission performance, comprehensive site management, and effective risk management. CAS performance information from measures and assessments should inform corporate governance oversight activities including parent organization assessments. It should also support strategic planning, status of organizational commitments, and the monitoring of fiscal and asset stewardship. CAS continuous improvement activities, such as issue and corrective action management and process improvement, should be supported as appropriate with parent organization expertise, consistent with prime contract expectations. Relationship of CAS to Federal Line Oversight A fully functional CAS allows the NNSA to optimize its oversight function by leveraging the data, information, processes, and outcomes of the CAS and governance system, while retaining independent oversight capability. The CAS provides transparent performance

Section 26

information that enables NNSA oversight to monitor system performance, mission delivery, and overall risk management results. An integrated and effective CAS enables NNSA oversight to hold Contractors accountable for performance. Federal oversight is expected to evolve in the context of two key factors: risk and Contractor performance. Risk and Contractor performance are not static attributes and, as both factors change over time, Federal oversight will transition to re-align its focus on risk and performance consistent with Federal statutes and regulations. For high hazard and nuclear activities, the use of the CAS will enhance NNSA Federal oversight; however, reductions in Federal oversight for high hazard and nuclear activities are not anticipated. NAP-21 VII-1 2-28-2011 Chapter Seven - Requirements Analysis Process Note: The details of Chapter 7 will be developed at a later date. This chapter will describe NNSA‟s process to examine current and/or future orders, guidance, policies and other directives documents to identify those requirements that are essential to support safe and effective mission accomplishment. This process is intended to increase contractor accountability and facilitate the streamlining of operations to focus on requirements that are essential to support safe and effective mission accomplishment. NAP-21 VIII-1 2-28-2011 Chapter Eight - Validating Line Oversight and Contractor Assurance Systems (LOCAS) Overview This chapter describes the affirmation process used by NNSA to affirm that the Contractor Assurance System (CAS) and/or Line Oversight (LO) system is implemented and effective. LO and CAS are fundamental elements of NNSA‟s management strategy for assuring effective contractor performance in meeting mission objectives and other requirements. A CAS is a contractor-designed system used by the contractor to manage performance consistent with contract requirements. A CAS is a primary tool used by contractor management to measure and achieve performance consistent with NNSA expectations and priorities; ensure that mission objectives and contract requirements are met; ensure that workers, the public, and the environment are protected; and ensure that operations, facilities, and business systems are efficiently and effectively operated and maintained. When fully functional, a CAS allows NNSA to optimize its oversight function by leveraging the processes and outcomes of the contractor‟s CAS and governance system while retaining independent oversight capability. LO is NNSA oversight of contractor performance that incorporates CAS as an oversight element. Line oversight processes include operational awareness activities, onsite reviews, assessments, self-assessments, performance evaluations, risk-informed/performance-based decision-making, and other activities that involve evaluation of contractor organizations and Federal organizations that manage or operate DOE sites, facilities, or operations. All line oversight processes include the elements established in the Nuclear Security Enterprise (NSE) Integrated Assessment Planning Model described in Chapter Nine. Line oversight activities are largely systems-based in functional areas of lower risk and where the contractor has demonstrated good performance, including an adequately functioning CAS. Line oversight always includes the following two elements: Performance Information is Analyzed – a comprehensive set of performance

Section 27

information used to analyze and evaluate the current level of performance by the contractor compared to a set of baseline expectations. Evaluation of Assurance and Oversight System Effectiveness – an evaluation of maturity and effectiveness of the assurance and oversight system performed to provide a level of confidence in the adequacy of performance information and in the ability to effectively address identified performance weaknesses. Line oversight activities become more transactional when the CAS is not functioning adequately, in functional areas where performance is inadequate, or for functional areas that VIII-2 NAP-21 2-28-2011 involve higher risk for executing the Site mission e.g., nuclear operations and safeguards and security operations. The LOCAS affirmation methodology expects there to be a self-assessment of the systems conducted prior to the Federal affirmation review. The contractor will determine its readiness for Federal review following the contractor‟s assessment. The contractor‟s assessment can be performed by the Site contractor and/or by the site contractor‟s parent companies, or through other means that provide the contractor their desired confidence level that they will meet the intent of NNSA‟s overall CAS. The Site Office Manager (SOM) determines readiness for external review of LO following a self-assessment. A Federal review team, formed by the SOM, approved by Deputy Administrator for Defense Programs (NA-10), and led by a senior manager independent of the SOM, will conduct the review guided by the Objectives, Criteria and Lines of Inquiry (LOI) provided in Attachment 4, and report its conclusion and any recommendations to the SOM. When ready, the SOM forwards the report, with his or her determination on the conclusion and recommendations, to NA-10 for a review. NA-10 accepts the SOM‟s determination after appropriate coordination (automatic after 30 days) or rejects it and provides further direction. This approach can be used to affirm LO and CAS preferably, as an integrated set of systems, or separately as site conditions warrant. Affirmation Process Scope This chapter describes the Site processes and reporting requirements to affirm these starting points via a review of the implementation and effectiveness of both Contractor Assurance and NNSA Line Oversight systems. Recognizing the variability in Contractor and Site Office requirements due to the difference in site missions, capabilities, resources and contract requirements, the processes detailed herein will ensure a wide degree in flexibility as to how the review(s) should occur. However, the reviews will reflect a common set of Objectives, Criteria, and LOIs for determining the basis for affirmation that provides consistency across the Nuclear Security Enterprise. The process will allow NNSA to ensure these systems integrate Contractor management, support corporate parent governance, and facilitate government oversight systems. Key Process Roles and Responsibilities Contractor – Plan, schedule, and execute an independent CAS validation review using the process described in this document. – Notify the SOM of the independent CAS validation review, providing at least three months advance notice. – Notify the SOM when the CAS is ready for Federal affirmation review of the CAS. – Work with the SOM to select affirmation review team members to serve on affirmation teams at other Sites. NAP-21 VIII-3

Section 28

2-28-2011 – Cooperate with and support scheduling and execution of the CAS affirmation review. Site Office Manager – Upon notification by a Contractor that a CAS is ready for the Federal affirmation review, determines whether LO will be reviewed concurrently. The preferred option, if possible, is concurrent evaluation. – Based on Site Office CAS assessments and LO self-assessment results, notifies HQ Line Management when the site LOCAS is ready for the affirmation review. – Proposes a team for the Federal affirmation review of the CAS and /or LO. Consultation with the Contractor is required to perform the affirmation review of CAS. – Works with the affirmation team leader to align review LOIs with site-specific needs and contractual requirements. – Works with the NNSA HQ to select affirmation review team members. – Communicates, as necessary, with the designated affirmation review team lead including providing evidence of implementation and self-assessment results. – Evaluates results of the affirmation review and determines whether the CAS and line oversight process is effectively implemented and reports this affirmation. – Provides the results of the LOCAS Federal affirmation review, with a determination as to the disposition of findings and/or recommendations, to the Deputy Administrator for Defense Programs. Deputy Administrator for Defense Programs – Supports the SOM in organizing the team and approves the assigned team to execute a LOCAS affirmation – Provides a cadre of “qualified” LO and/or CAS affirmation review team leaders to ensure consistency across the enterprise. – Obtains LO and/or CAS affirmation review team support from the Service Center, NNSA HQ or other Site Offices and their Contractors, as necessary. – Receives affirmation review report results, and after appropriate coordination, accepts or rejects the SOM determination. – Provides feedback to the SOM concerning implementation of the CAS and/or LO systems. Federal Affirmation Review Team – Reports to the SOM and provides the SOM its conclusions and recommendations regarding the adequacy/effectiveness of the demonstrated LOCAS. – Provides an effective, objective, and balanced review of the Site‟s LOCAS systems via consistent team leads. – Expectations: VIII-4 NAP-21 2-28-2011 o Team Leader: Significant experience in LO or CAS operations and understanding of NNSA expectations for both and their interfaces; prior experience in LO and/or CAS validation. o Deputy Team Leader: Optional based on complexity as determined by the team leader. Same expectation as a team leader except less team leader experience is necessary. o Other Team Members: Understanding of NNSA expectations for a line oversight process and experience conducting performance reviews. Team members may be selected from any organization within the NSE. Use of team members from the Site under evaluation is acceptable but should be limited to ensure independence is maintained. – General Membership: o Nominally 4 to 8 members, depending on scope of the review. o Majority of members are from Site Offices and Contractors/parents that are peers of the Site being validated, remainder will represent NNSA HQ offices or Service Center. o Members should have senior management or executive experience and expertise in evaluating Sites‟ primary mission program areas, in business operations relevant to the site‟s mission (financial, human resources, asset

Section 29

management, information management,) and in facility operations and assurance relevant to the site‟s mission (environment, safety and health, nuclear operations, conduct of operations, maintenance, safeguards and security, cyber security, emergency management, etc.) o Collectively, team member skills should include knowledge in the application and implementation of Site Office performance evaluation via assessment, issue communication/management, trending analysis in concert with Contractor management, assurance, and governance systems, including: measures, assessments, issues and corrective action management, lessons learned, and trending and analysis. – Performance with respect to individual functional areas (e.g., security, business, etc) is not the emphasis of the evaluation. LOCAS Affirmation Review Process Phase I – Contractor Validation Review and LO Self-Assessment Independent (peer review, third party, or parent organization) assessments of a Contractor‟s CAS are used effectively to evaluate the CAS. Part I of this phase is focused on the design of CAS and the Contractor‟s ability to employ CAS elements. Once the initial design and management approach is verified and implemented, Part II CAS assessments should shift to evaluating the level of implementation, the effectiveness of the individual elements of the system, and the system as a whole. These independent assessments focus on aspects of NAP-21 VIII-5 2-28-2011 implementation, functionality of tools and processes, and the ability to employ the CAS to achieve its purpose as defined in the Purpose section of this chapter. The Contractor will report the completion of each part of Phase I and its readiness for the Federal affirmation to the Site Office. The SOM should conduct a self-assessment of the Site Office LO process and determine whether the process is adequately implemented and effective prior to requesting an LO affirmation review. Phase II – Federal Affirmation Review CAS Review Expectations - NNSA seeks to confirm the Contractor‟s determination that CAS has been sufficiently designed and effectively implemented. Federal affirmation of Contractor CAS, Phase I, Parts I or II, or both, will utilize a consistent approach. The approach will reflect the application of a minimum set of NSE-wide common performance- based evaluation criteria or lines of inquiry that will result in NNSA developing the data/information sufficient for confidence that the CAS is: 1) well designed, 2) faithfully implemented, 3) used as the single, coordinated, and cohesive management system to provide decision information that is accurate, timely, and complete for all levels of Contractor management, 4) meets the contractual expectations of the Federal government; and 5) is transparent and can be relied upon. The focus will be on aspects of implementation and effectiveness of tools, processes, and use of the CAS in achieving its purpose while eliminating redundancy. LO Review Expectations - NNSA seeks to confirm: 1) the Site Office uses a systematic and effective approach to line oversight, including output from the CAS, to monitor and evaluate Contractor performance against mission and contract requirements, 2) the Site Office employs a risk-informed performance based process to focus oversight activities on processes, systems, and operations vital to ensuring the NNSA mission is executed in a manner that is safe,

Section 30

secure, legally and ethically sound, and fiscally responsible, 3) a systematic approach is used to monitor and evaluate the implementation and effectiveness of the Contractor‟s assurance system, and 4) the Site Office‟s LO systems have been effectively transformed and optimized utilizing the CAS. Affirmation Review Performance - The preferred method to perform the affirmation review is to validate both the CAS and the LO concurrently with an independent team. This provides validation of the implementation, effectiveness of the systems, and the integration that is required for them to function together. The LO and/or CAS affirmation review process is initiated when a SOM determines readiness for affirmation and notifies the Deputy Administrator for Defense Programs. In consultation with HQ and the contractor, the SOM proposes a team to conduct the affirmation review and obtains team approval by the Deputy Administrator for Defense Programs. Team leaders are appointed from a small cadre of personnel that meet expectations for team leaders. The team leader will select a deputy team leader (if needed) and other team members that meet expectations for those personnel. The review team provides a report of the results of their review to the SOM. The SOM evaluates the results of the review and reports his or her VIII-6 NAP-21 2-28-2011 conclusion and disposition or any team recommendations and the basis for both, to the Deputy Administrator for Defense Programs for review. The team leader, working with the SOM to incorporate site and contract specifics, develops an affirmation review plan that, when executed, will form the basis for affirming the LO and/or CAS attributes identified in this chapter using the objectives, criteria and LOIs provided in attachment 4. When evaluating the attributes of a LO program or criteria for a CAS, the reviewers should use the LOIs as guides for gathering and analyzing data, not as hard and fast checklists for content. The affirmation review plan should identify the participants on the team, their roles and responsibilities (including the review of relevant documentation prior to the Site visit), any required Site support, and the review schedule. There are three key aspects to be addressed in coordination between the Contractor and NNSA: lines of inquiry, observation methods, and participants. These will be reviewed by NNSA with the Contractor prior to execution of the CAS affirmation review to ensure transparency and to incorporate feedback. Prior to conducting the affirmation review, the team leader should request, and the SOM should provide sufficient documentation to provide reasonable assurance of readiness for the review. This could include the results of the Site Office LO self-assessment, local procedures that describe the Site Office LO process and recent LO related documents/reports. Likewise, the Contractor should provide on request, the Phase I independent assessment results, applicable Contractor procedures, and recent CAS related reports and products. The Federal review team will produce a report of its efforts and provide it to the SOM. The SOM will provide the report, along with his or her determination, to the Deputy Administrator for Defense Programs for review. The Deputy Administrator for Defense Programs has 30 days to accept the SOM determination (automatic acceptance after 30 days) or reject it and provide further direction.

Section 31

A typical Phase II LOCAS methodology is as follows: NAP-21 VIII-7 2-28-2011 Affirmation Team Preparations – Affirmation Team Commissioned – Notice to Contractor (CAS related only) – Information request forwarded – Off site review of Site information/data request response (Contractor and peer/3rd party independent review, completed LOIs, other Site information) – Conduct a Pre-Visit Conduct an onsite review – Objectives, Criteria and LOIs executed – Interviews conducted – Activities observed – Correlation of Paper to Practice VIII-8 NAP-21 2-28-2011 Issue Summary Report to SOM SOM develops determination on report disposition SOM forwards report, with his or her determination, to the Deputy Administrator for Defense Programs. The Deputy Administrator for Defense Programs after appropriate coordination accepts or rejects the determination. Format of LOCAS Affirmation Report Purpose Scope and Method of Affirmation Review – CAS (Part 1 or Part 2), LO, or LOCAS – Team make-up – Performance areas reviewed Results – Completed Assessment Forms Interview results Activity results – Comparison o Paper versus Practice o Demonstration and Documentation – Evaluation o Effectiveness of systems to achieve, monitor, evaluate and improve performance outcomes o Noteworthy Practices o Opportunities for Improvement Summary/Conclusions Determination - Affirmed or Not Affirmed Recommendations NAP-21 IX-1 2-28-2011 Chapter Nine - Integrated Oversight and Assessments Introduction This chapter describes an integrated assessment-planning model for use in identifying the set of NNSA assessments to be conducted across the Nuclear Security Enterprise (NSE). This model supports a shift from a directive-based to a risk-informed assessment identification process and from independently developed Site and HQ assessment plans to an integrated plan that includes HQ led assessments. “Risk Informed” is a decision making approach whereby conclusions drawn from an assessment of past performance, hazards involved, and the likelihood and consequences of accidents are considered together with other factors to make decisions that better focus contractor and Federal oversight attention on design and operational issues commensurate with their importance to public health and safety. A "risk- informed" approach enhances the deterministic approach by: (a) allowing explicit consideration of a broader set of potential challenges to safety, (b) providing a logical means for prioritizing these challenges based on risk significance, operating experience, and/or engineering judgment, (c) facilitating consideration of a broader set of resources to defend against these challenges, (d) explicitly identifying and quantifying sources of uncertainty in the analysis (although such analyses do not necessarily reflect all important sources of uncertainty), and (e) leading to better decision-making by providing a means to test the sensitivity of the results to key assumptions. The shift to “Risk Informed” still requires assessments specifically required by a Directive to be performed unless a formal exemption is approved using the authorized exemption process. In addition, this process will ensure that the rigor and implementation of independent oversight for nuclear and high hazard activities will continue to be maintained and enhanced. Also included in this chapter are a set of Assessment Identification, Planning, and

Section 32

Performance Principles to assure that if an assessment is necessary the basic tools are in place to assure that its value is maximized, and to provide both the Assessing and Assessed organization a guide to assuring such an outcome. Description The NNSA Integrated Oversight and Assessment Model (herein referred to as the “Model”) provides a framework that will guide a transition from a directive-based oversight and assessment planning approach to a risk-informed/performance-based oversight and assessment planning approach. For purposes of this model, line management refers to HQ organizations with assigned or delegated oversight responsibilities from NA-1, 2, 10 or Defense Nuclear Security. This model currently does not apply to mission line management within NA-10. Implementation of the model, together with other key governance initiative improvements, will result in selection of a focused and targeted set of risk informed/performance based assessments that are conducted in a disciplined manner. Ultimately, as seemingly redundant, lower risk and less effective assessments are identified and reduced and/or eliminated, NNSA and Contractor resources can be realigned to direct NNSA mission activities. IX-2 NAP-21 2-28-2011 The model is designed for application in a risk-informed manner across the NSE from the Contractor, to the Site Office, and the HQ Functional/Line Managers. HQ Functional Manager/Line Management concurrence with the integrated plan provides the Administrator with Enterprise Assurance as the as program owner. Two key components differentiate this model from the current planning approach: Integrated Site Assessment Plan – This model avoids the inherent potential for duplication of efforts by using a process that results in a single integrated Federal Site Assessment Plan with integration occurring at the Site Office-level for each Site. Integration is thereby accomplished at the Federal level directly responsible for Site operations and is maximized by placing the responsibility on the Site Office Manager to ensure that HQ Line and Functional Manager oversight requirements are incorporated into the integrated Site Assessment Plan in a way that optimizes the use of both Federal and Contractor resources. Recognition that “Risk” constantly varies, is usually Site-specific, and is usually best understood by line management closest to the work activities- This model recognizes that risk factors and Contractor performance are not static attributes but instead both of these factors are Site-specific and change over time. The model recognizes that Federal oversight will also transition to re-align its focus on risk and performance consistent with Federal statutes and regulations. To enable this transition the model allows for flexibility in the selection and degree of use of the various oversight tools based on timely and accurate risk and performance information. Flexibility in the selection and degree and use of the various oversight tools by the Site and Functional/Line managers based on real time performance and risk information is referred to as the oversight “dial setting.” The model also allows the Site Office and HQ functional/line managers the flexibility to select assessments in areas which significantly reduce uncertainty about the likelihood of potential adverse consequences which would have the greatest impact on safe, secure, and efficient achievement of the

Section 33

Site-specific NNSA mission. The overall result is an integrated plan that is appropriate for the specific Site situation. In addition to these two key components, the model relies on the application of the following attributes to support the transition from the current directive based process toward an integrated and risk informed process: 1) Aligned Goals and Objectives - NNSA enterprise goals and objectives are formally established and are used to establish the expected performance baseline for NNSA management and operating Contractors. Alignment of the goals and objectives across the enterprise supports development of performance expectations (requirements, outcomes, milestones) and supporting measures that are used throughout the oversight and assessment planning and execution cycle. NAP-21 IX-3 2-28-2011 2) Common Oversight and Assessment Planning Process - Using the common set of performance expectations derived from aligned goals and objectives, the various enterprise organizational elements implement oversight and assessment planning processes that includes a common set of steps. These steps include: Risk Evaluation – The relative risk of achieving mission objectives and expected performance outcomes is evaluated. Analysis of Performance Information – A comprehensive set of performance information is used to analyze and evaluate the current level of performance compared to the common set of performance baseline expectations. Evaluation of Assurance and Oversight system effectiveness – An evaluation of maturity and effectiveness of the assurance and oversight system is performed to provide a level of confidence in the adequacy of performance information and in the ability to effectively address identified performance weaknesses. 3) Transparent Performance and Oversight Information - A common set of mission performance and oversight information is provided across the enterprise. The information flow is from the Contractor to the Site Office and then from the Site Office to HQ functional/line managers. Contractor performance and oversight information (results from assessments, corrective action status, etc) is readily accessible, and transparent to the Site office primarily through the Contractor assurance system (CAS). Access to both raw data and analysis of that data is available to the Site Office from the CAS. Working with HQ functional/line managers the Site Offices establish appropriate mechanisms to provide access to both Contractor and Site Office oversight and performance information for use by the HQ functional/ line managers. 4) Risk Informed Oversight and Assessment Decisions - Each level of the enterprise selects the type and scope (breadth and depth) of assessment activities for the current planning cycle based on performance, risk, and maturity of assurance and oversight systems. The use of these inputs results in a risk informed process to select assessment targets for the planning cycle vice a directive based selection of assessment targets. The specific inputs for each level of the organization vary based on their proximity to the execution of the work and that organization‟s roles and responsibilities within the enterprise. For example, the Site Office uses operational risk, Contractor performance, and CAS maturity in their risk informed assessment selection process and the HQ functional/line manager uses mission support risk,

Section 34

functional area performance, and line oversight maturity in their risk informed input to each Site‟s Integrated Assessment Plan. The risk informed process is also used to make real time oversight decisions in response to adverse performance information during the execution cycle. For example, risk, performance, and confidence in assurance systems is used to determine the level of Site Office response that can range from monitoring the Contractor response, enhanced oversight by shadowing a Contractor led assessment, independent Site Office assessment, or a contract action such as specific direction or adverse performance evaluation or change in performance targets. IX-4 NAP-21 2-28-2011 5) Integrated Site NNSA Assessment Plan - The sequenced and coordinated development of an integrated Site NNSA assessment plan that is revised as necessary to address HQ defined assurance requirements will result in a single fully integrated NNSA assessment plan for each Site. This sequencing allows each level to identify gaps in the previous organization‟s assessment plan to negotiate appropriate additional measures in that level‟s activities and or insert additional measures as required before each Site-specific plan is finalized. Assessment schedules are provided to Site Office and HQ functional/line managers to enable enhanced oversight through various activities in concert with the Contractors (e.g. shadow assessments). This sequenced and coordinated approach enables the most effective use of Contractor and Federal resources while providing for more effective assurance from each organizational level within the enterprise. The overall result is more effective enterprise assurance. A graphical depiction of the organizational alignment of the assurance functions within the enterprise is shown below. Model Execution Process Flow A description of the nominal execution steps in the Integrated Assessment Model is as follows: 1) Based on the enterprise mission goals and objectives, Site-specific risk informed and performance based metrics, NNSA and parent company input, and external assessment results, the Contractor prepares a draft assessment plan and provides it to the Site Office. NAP-21 IX-5 2-28-2011 2) The Site Office uses Site-specific risk and performance information and the maturity of the Contractor Assurance System as input to its assessment planning process. 3) The Site Office provides the draft Site Office Assessment Plan, draft Contractor Internal Assessment Plan, and Site performance data (Contractor functional area performance and Site Office line oversight performance) to the HQ line and functional managers. 4) The HQ line and functional managers review the draft Site Office Assessment plan and based on field assurance effectiveness and functional area/mission support performance trends (e.g. LOCAS metrics) identify whether there are any areas where additional assurance activities may be required. 5) Based on the input from the HQ line and functional managers the Site Office would update their plan to form the Draft Integrated Site Assessment Plan. 6) The HQ line and functional area managers are responsible to provide assurance to NA- 1/2/10 that each Site Integrated Assessment Plan provides adequate assurance in their Functional/ Line areas. Integration > HQ – Site Office HQ line and functional area managers and the site offices work to “fill in” any

Section 35

gaps that HQ sees in the draft site office assessment plan in the most effective manner e.g. the site office may add additional internal assessment activities, the site office may work with the contractor to identify additional areas of contractor focus or HQ may “shadow” a Site or contractor activity or participate in a Site Office led review. The HQ line and functional managers will use these types of enhanced oversight tools to address areas of concern based on the common set of risk and performance information. Optimally, an assessment would only be the option chosen by the line and functional managers in areas legally required or those that involve a high risk to mission execution (for example nuclear safety). Integration > Contractor – Site Office Site office and the contractor work to “fill in” any gaps that the site office sees in the contractor plan in the most effective manner e.g. the contractor may add additional internal assessment activities, or the site office may “shadow” a contractor internal activity. Optimally an assessment would only be the option chosen by the site office in areas where an assessment is explicitly required or those that involve a high risk to mission execution (for example nuclear safety). IX-6 NAP-21 2-28-2011 7) NA-1/2/10 has the option to input any additional Enterprise considerations that may be required into the integrated Site assessment plans through the HQ line and functional managers. 8) Site Offices approve and issue Site Integrated Assessment Plan in advance of the start of each annual line oversight cycle. Organizational Assurance Functions and Interfaces Within the model framework, each organizational level has complementary assurance inputs, analysis, and outputs that support an appropriate selection and balance of oversight tools to provide assurance. The selection and balance of oversight tools is referred to as the “Dial Setting” in this Model. At a summary level the organizational assurance roles, interfaces, and assurance process information, analysis, and tools are as follows: Contractors – Determine and recommend the most effective means of accomplishing the missions and objectives established by NNSA in a safe and secure manner. – Establish, implement, and execute a comprehensive, effective, and sound Contractor assurance system, supported by critical self-evaluations and internal performance assessments, which ensures mission enablement and promotes continuous improvement. – Create and maintain a transparent assurance system with the necessary level of comprehensiveness to sustain stakeholder confidence and to maintain acceptable levels of performance. – Provide products and services in a safe, secure, legal manner, with high quality and efficiency. Information Inputs Contract Requirements Mission Objectives Stakeholder Guidance Analysis Development of Performance Measures Risk Evaluation (Integrated mission execution focus) Identification of Assessment Targets Information Outputs Performance data (Mission, System, Functional Area) Oversight and Assessment Performance Information Contractor Assessment Plan Assurance Tools Self Assessments Independent Assessments Parent Reviews Third Party Certifications Continuous Improvement Activities NAP-21 IX-7 2-28-2011 Site Offices – Oversee contract performance. – Validate and oversee an effective Contractor Assurance System.

Section 36

– Have the knowledge and operational mission awareness necessary to provide risk- informed oversight of Site work activities. – Are primarily responsible (through delegated authority) for executing the Federal oversight and administration of the M&O Contractors. – Are accountable to NNSA senior line management for the execution of Site Office authority. – Ensure safe and secure operations through the administration of each Site‟s line oversight process and oversight of each Contractor‟s assurance system; by monitoring Contractor performance through the use of appropriate metrics and indicators; through use of the Contractor performance evaluation system; and by integration and coordination of assessment and oversight activities conducted at the respective Sites. – Develop, integrate, approve, and update as necessary the Integrated Site Assessment plan to meet the assurance needs of the Site and HQ Functional and Line Managers as required while optimizing the utilization of both Contractor and Federal resources. Information Inputs Performance Evaluation Plan Contractor Integrated Assessment Plan Performance Data (Mission, CAS, Functional Area) Oversight and Assessment Performance Information HQ Line and Functional Manager Assurance Requirements Analysis Evaluation of CAS Effectiveness Risk Evaluation (Integrated Site Operational Focus) Identification of Performance Trends Identification of Assessment Targets Information Outputs Site Performance data (including CAS effectiveness) Site Office Line Oversight Performance Information Site Office Self Assessment and Continuous Improvement Information Approved Integrated Site Assessment Plan Assurance Tools Systems Oversight Operational Awareness- Shadow Contractor assessments Performance of Site Office Approved Assessments Various Contract Actions (Directed Action, PEP Changes) Negotiation with Contractor to conduct assessment or other activity Coordination with HQ/Service Center for support/assistance IX-8 NAP-21 2-28-2011 Headquarters Line and Functional Managers – Provide technical assistance and support by employing trained and competent staff to enable mission delivery and provide support to Program and Site Office Managers to implement delegated responsibilities. – Ensure that NNSA operates within statutory and regulatory authorities and provide technical assistance, remove barriers, and provide support to enable mission delivery. – Monitor and evaluate Site Office performance through periodic oversight and assessment activities. – Provide for functional oversight and support of the technical competency of the Federal workforce. – Develop, integrate, and update as necessary HQ Functional and Line Management Oversight Requirements. – Maintain knowledge of overall NNSA enterprise performance through risk informed oversight activities in order to provide corporate level information to support senior level decisions. – Assist the delegating officials to determine if the Program or Site Office has the resources and qualifications to execute their responsibilities effectively. All functions play an equally vital role in meeting mission success. Information Inputs Functional Area/Mission Support Performance Indicators Site Office Oversight Performance Information (LOCAS) Site Draft Integrated Assessment Plan Site Office Self Assessment and Continuous Improvement Information Analysis Evaluation of Field Assurance Effectiveness (LOCAS)

Section 37

Risk Evaluation (Integrated Functional Area Mission Support Focus) Identification of Functional Area/Mission Support Performance trends Identification of Shadow Assessment/Operational Awareness Targets Integration with NA-1/2/10 to provide Functional Assurance Information Outputs Functional Area/ Mission Support Performance Evaluation Field Assurance (LOCAS) Effectiveness Evaluation HQ level Functional and Line Management Assurance requirements to Site Office Assessment input to Site Office Integrated Assessment Plan Assurance Tools Systems oversight Program reviews Shadow or Participate in Site Office Led Assessments Negotiated changes to Draft Site Office Assessment Plan Identification of Legally required or High Mission Risk HQ Led Assessments to be included in Site Integrated Plan NAP-21 IX-9 2-28-2011 Office of the Administrator – The NNSA Administrator has both the authority and accountability for decision making for those decisions that are the responsibility of NNSA, serving as the ultimate risk acceptor for NNSA, balancing programmatic risks to accomplish mission requirements and meet national security needs. – Leads strategic planning and facilitates operational planning to prioritize mission objectives and the options to achieve those objectives. – Identifies barriers to achieving mission success and options to overcome those barriers. – Supports other Federal Agencies by leveraging NNSA work activities. – Integrates mission, program, budget, functional area requirements. – Responsible and accountable for mission accomplishment and enterprise stewardship. Information Inputs Comprehensive Site Performance Evaluations (Mission, Functional Area, Site office) External Inputs – Congressional, Departmental, Stakeholders Analysis Risk Evaluation (Integrated Enterprise Focus) Identification of Enterprise Mission Vulnerabilities Evaluation of Enterprise Assurance Effectiveness Information Outputs Enterprise Assurance Information provided to stakeholders Enterprise oversight guidance as required Concurrence through HQ Functional and Line Managers with Site Office Integrated Assessment Plans Assurance Tools Verification by HQ functional and line management that they agree with the level of assurance provided by the Integrated Site Assessment Plans Direction to Line Managers (Site and HQ) to address identified any enterprise vulnerabilities or Enterprise Level Supplemental requirements The graphic below shows the overall linkages between the Model Attributes and the NSE organizational Elements Contractor, Site Office, HQ Functional Area Managers, and the NNSA Administrator. This model utilizes a structured methodology at each level of the enterprise to analyze Performance, Risk, and maturity of Assurance and Oversight systems at the assessed level. IX-10 NAP-21 2-28-2011 Assessment Identification Principles The objective of the review and intended use of the assessment information and conclusions has been explicitly identified. The assessing organization has determined and validated the need for conducting the assessment based on positive responses to the following criteria: A defined requirement exists for the assessment (e.g., area governed by statute, executive order, rule or established Departmental directive.) and the responsibility for Assessment Identification, Planning and Performance Principles The guidance below supplements the model by defining key principles

Section 38

for NNSA line managers to consider when planning and scheduling NNSA assessments that are external to the host organization. If these principles are not supported, then the host site or the assessment lead may postpone or cancel the assessment. If the host and the assessing organizations cannot agree, then the issue should be brought to the attention of the next level of management. NAP-21 IX-11 2-28-2011 oversight of implementation of the requirement(s) does not reside with the Site Office Manager, or A risk-informed oversight process identified the need for an assessment, or Performance indicators or metrics are insufficient to assure continued safe and compliant operation (increased uncertainty) or reflect less than adequate performance, and an on-site assessment is the most effective method of data collection. The intended scope and need for conducting the NNSA assessment has been established with the hosting organization Integration of the assessment with other complementary reviews has been considered to minimize the footprint on host organization (e.g., ES&H integrated with nuclear safety reviews, combining similar business topics, combining S&S topical areas). Assessment Planning Principles The scope of the assessment is clearly defined and documented and the size of the assessment team is commensurate with the scope of review. An assessment team leader has been identified who has an appropriate level of independence and sufficient experience and knowledge in the area to be assessed. The proposed assessment schedule that includes the duration of the on-site portion of the assessment, deliverables, and other key milestones has been developed by the assessment team and can be reasonably supported by the host organization. The accepted schedule includes sufficient time to ensure all the necessary planning requirements can be met. The issues management process that will be used to address the results of the assessment has been agreed upon by the assessing organization and the host organization. A review plan has been developed by the assessment team leader with input from the team and accepted by the hosting organization. At a minimum, the plan will contain the following information: Purpose and Scope; Assessment Schedule; Issue Identification and Categorization; Measurable Evaluation Objectives and/or Criteria; Factual Accuracy Review; and Final Report Format. Measurable Evaluation Objectives and Criteria documented in the review plan are linked to requirements or clear expectations. Pre-assessment meetings for information exchange are initiated by the assessment team and supported by the host organization. Organizational interfaces and points of contacts are established by the host organization to support team members and organize logistics. Assessment Performance Principles The assessment team establishes meeting schedules (e.g.in-brief, daily out brief, team meetings, and closeout meetings) that support open information exchange between the assessment team and the hosting organization. IX-12 NAP-21 2-28-2011 The assessment team leader emphasizes positive interactions with the host organization, feedback focused upon the scope of the review, and the goal of providing useful information to support continuous improvement of the host organization. The host organization has agreed to provide the assessment team with access to all

Section 39

facilities, personnel, and objective evidence needed to support the review. Issues are communicated, categorized, and supported by objective evidence packages. A final out-brief will present and discuss assessment results and expected delivery of the final report. Assessment results are delivered to the agreed upon line manager(s) in the responsible organization who uses their issues management process to make a final determination of resolution. NAP-21 X-1 2-28-2011 Chapter Ten –Performance Evaluation Plan and Metrics Note: The details of Chapter 10 will be developed at a later date to define the performance criteria by which NNSA will appraise the M&O contractors‟ performance. It will be written to implement the collective principles communicated in this document and to reinforce the changes envisioned within our Governance Transformation efforts. NAP-21 Attachment 1 2-28-2011 Page 1 Attachment 1 - Advancing the NNSA’s Managerial and Cost Effectiveness Attachment 1 NAP-21 Page 2 2-28-2011 NAP-21 Attachment 2 2-28-2011 Page 1 Attachment 2 - NNSA Operating Principles NAP-21 Attachment 3 2-28-2011 Page 1 Attachment 3 - NNSA Enterprise Re-engineering Reform Initiative - LOCAS Attachment 3 NAP-21 Page 2 2-28-2011 NAP-21 Attachment 4 2-28-2011 Page 1 Attachment 4 - LOCAS Affirmation Objectives and Criteria Evaluating Contractor Assurance Systems PURPOSE: Contractors must have an operational and effective CAS to meet NNSA expectations and enable effective and efficient line oversight by NNSA. This section describes the critical attributes of a Contractor assurance system and provides the objectives, criteria, and lines of inquiry that should be used to evaluate the implementation and effectiveness of a CAS. Element 1 – Assessments Element Objective The Contractor uses a robust and effective, risk-informed approach to develop, implement, and perform comprehensive assessments of all facilities, systems, and organizational elements, including subcontractors, on a recurring basis. Implementation Criteria The processes used to implement the elements described in a Contractor’s CAS description document are sufficiently defined that they can be executed in a repeatable and predictable manner. The processes are being used in the specified manner by the Contractor’s functional and organizational segments. The scope and frequency of assessments are specified in Site plans and program documents and ensure that: 1. assessments required by applicable DOE directives are being performed; 2. the effectiveness of safety management programs, including programs that are credited in the safety basis for nuclear facilities are being assessed adequately; 3. deficiencies are being self-identified; and corrective actions are being taken in a timely and effective manner. Implementation Lines of Inquiry How do you know that assessments will be planned and performed in a reliable and predictable manner across the organization? How do you know that assessments will be planned and performed in a manner that is consistent with the risks and performance uncertainties related to the organization’s mission objectives and contractual requirements? How do you know that the assessment planning and performance processes are maintained consistent with changing organizational needs? What defines which functions and parts of the organization should be performing Attachment 4 NAP-21 Page 2 2-28-2011

Section 40

assessments? How would you know that the defined functions and/or parts of the organization are performing assessments as expected? How do you know that your assessments are providing you results that provide an accurate reflection of performance? How do you know that the assessment planning and performance processes are appropriately integrated with other CAS elements and management systems? How do you know that all assessments required by DOE Orders are being performed? What are the requirements for assessing the effectiveness of safety management programs? How do you know that safety management programs are adequately assessed? Implementation Review Approach Review the Contractor’s contract, CAS description document, and assessment planning and performance procedures and records. Review Contractor assessments including planning, implementation and results. Interview Contractor line and support (including independent oversight) managers. Observe performance of one or more Contractor assessments. Effectiveness Criteria Results of contractor assessments align and resonate with those resulting from third party, independent, and/or Federal assessments of similar functions. When results differ between contractor assessments, other similar NNSA or external assessments, the contractor proactively probes to understand why these differences exists and how best to resolve them. The Assessment program measures the degree to which the elements described in a contractor’s CAS description document are demonstrating the desired outcomes, and provides a basis for demonstrating long-term performance levels and/or trends in evidence. The Assessment program is designed to identify implementation gaps that would preclude a CAS from being deemed effective. Effectiveness Lines of Inquiry Are assessments being planned as expected? How do you know? Are there frequency, cycle time, or quality expectations that apply to assessment planning? If so, how do you know how well you are performing against them? Are assessments are being performed as expected? Are there frequency, cycle time, or quality expectations that apply to assessment NAP-21 Attachment 4 2-28-2011 Page 3 planning? If so, how do you know how well you are performing against them? Is assessment data reliably translated into actionable information? How do you know? Is assessment data adequately transparent to DOE elements and corporate governance? How do you know? Are assessments reliably finding issues before they are identified by external assessors and before they become problems? How do you know? How do the results of your assessments compare to those of audits and assessments from DOE or other external parties? What do you do if there is disagreement between internal and external assessment results? What does the Contractor do when there is a difference in their assessment results as compared to similar NNSA or external assessments? Has the CAS been modified based on implementation gaps identified by assessments? Effectiveness Review Approach Review the Contractor’s assessment planning, performance, and reporting records. Review the results of Contractor assessments as compared to similar assessment performed by NNSA or external parties. Interview Contractor line and support personnel. Review levels and trends for measures associated with assessment performance. Observe performance and/or reporting of one or more Contractor assessments.

Section 41

Element 2 – Operating Experience Element Objective Formal programs are established and effectively implemented to collect, analyze, and use information from operational events, accidents, and injuries in order to prevent them in the future. Implementation Criteria The processes used to implement the elements described in a Contractor’s CAS description document are sufficiently defined that they can be executed in a repeatable and predictable manner. The contractor establishes and implements processes to solicit feedback from workers and work activities. Formal programs are established to communicate lessons learned during work activities, process reviews, and event analyses to potential users and applied to future work activities. Attachment 4 NAP-21 Page 4 2-28-2011 The contractor identifies, applies, and exchanges lessons learned with the rest of the DOE complex. The contractor reviews and applies lessons learned identified by other DOE organizations and external sources to prevent similar occurrences. Implementation Lines of Inquiry How is the sharing of operating experience information integrated with other CAS elements and management systems? How do you know that relevant lessons learned are collected and shared in a reliable and predictable manner across the organization and with the DOE? What defines which functions and parts of the organization should be sharing and acting upon lessons learned? How would you know that the defined functions and/or parts of the organization are using lessons learned as expected? Implementation Review Approach Review the Contractor’s CAS description document and operating experience identification, screening, evaluation, and dissemination procedures and records. Interview Contractor line managers, support managers, and staff. Effectiveness Criteria The Lessons Learned processes are being used in the manner specified by the contractor’s functional and organizational segments. There is objective evidence that experience from operational events is being tracked and used to drive continuous improvement Effectiveness Lines of Inquiry Are lessons learned being collected and shared as planned? How do you know? Are lessons learned being acted upon as planned? How do you know? Are there frequency, cycle time, or quality expectations that apply to lessons learned processing? If so, how do you know how well you are performing against them? Is feedback and information from accident, event, and incident reporting and worker feedback processes being used to help identify opportunities for risk reduction and performance improvement? How do you know? Effectiveness Review Approach Review the Contractor’s operating experience identification, screening, evaluation, and dissemination records. Review levels and trends for measures of operating experience program performance. NAP-21 Attachment 4 2-28-2011 Page 5 Interview Contractor line and support personnel. Element 3 – Issues and Corrective Action Management Element Objective The Contractor ensures that a comprehensive, structured issues management system is in place. This system uses a risk-informed approach to provide for the timely and effective resolution of deficiencies and is an integral part of the CAS. Implementation Criteria Formal issues and corrective action management processes exist that apply to all areas covered by the CAS

Section 42

The issues management system ensures that issues are evaluated and graded, and made visible to management using a risk informed approach The corrective action management system ensures management level attention and buy-in graded to issue significance Roles and responsibilities with respect to issues and corrective action management are clearly identified Requirements and processes for closure of issues are clearly defined and include sufficient independence requirements to assure adequacy Issues and corrective action management are fully integrated into the CAS Implementation Lines of Inquiry How do you know that issues are identified and translated into corrective actions in a reliable and predictable manner across the organization? How do you know that corrective actions will reliably and predictably resolve the issues with which they are associated? How do you know that issues and corrective actions are prioritized in a manner that is consistent with the organization’s mission objectives and contractual requirements and NNSA expectations? How do you know that the issues and corrective action management processes are maintained consistent with changing organizational needs? What defines which functions and parts of the organization should be formally managing issues and corrective actions? How do you know that the issue and corrective action management processes are appropriately integrated with other CAS elements and management systems? Attachment 4 NAP-21 Page 6 2-28-2011 Implementation Review Approach Review the Contractor’s CAS description document and issues and corrective action management procedures and records. Interview Contractor line managers, support managers, and staff. Effectiveness Criteria Issues raised during recent internal and external reviews have been captured accurately in the issues management system; no issues are unaccounted for Corrective actions in the corrective action system are appropriate for the issues raised and are documented sufficiently using a graded approach Closure packages are complete and consistent with closure requirements Objective evidence exists of appropriate levels of management attention for open issues and appropriate management involvement in issue closure Effectiveness Lines of Inquiry Are issues being identified as planned? How do you know? Are issues being translated into corrective actions as planned? How do you know? How is causal analysis used, where appropriate, in this process? How do you know? Are issues and corrective actions being managed across functions and sub‐units of the organization as expected? Are there frequency, cycle time, or quality expectations that apply to issue processing? If so, how do you know how well you are performing against them? Are there frequency, cycle time, or quality expectations that apply to corrective action development and management? If so, how do you know how well you are performing against them? Is issue and corrective action management data transparent to DOE and corporate governance? How do you know? Are issues being effectively resolved? How do you know? Effectiveness Review Approach Review the Contractor’s issues and corrective action management records. Review levels and trends for measures of issues management performance. Interview Contractor line managers, support managers and staff NAP-21 Attachment 4 2-28-2011 Page 7 Element 4 – Performance Measures

Section 43

Element Objective The Contractor identifies, monitors, and analyzes data measuring the performance of facilities, programs, and organizations. The data are used to comprehensively demonstrate all aspects of performance with projected future trends. Implementation Criteria The contractor has established performance areas to be analyzed and trended. Performance areas correspond to the areas covered by the CAS and include metrics that are graded in detail using a risk-informed approach for each area The contractor has processes and procedures in place to capture performance data and provide the data in a timely manner. Processes and procedures exist for analyzing the data and providing the results to management for consideration Performance measures are keyed to support contractual performance evaluation Objective evidence exists that management needs for performance data have been assessed and that the performance measures support management needs Implementation Lines of Inquiry How do you know that outcome measures and their performance targets are selected consistent with the organization’s mission objectives, contractual requirements, and customer expectations? How do you know that outcome measures and their performance targets are selected in a reliable and predictable manner across the organization and its functions? How are strategic needs considered when selecting measures and setting performance targets? How is benchmarking of key functional areas used? How do you know that leading indicators are selected in a reliable and predictable manner for outcome measures? How do you know if the performance measures provide timely information that guides actionable decision-making by Contractor personnel – including senior managers? How do you know if the performance measures provide information on the current adequacy and intensity of the CAS? What defines which functions and parts of the organization should be selecting and using outcome measures and leading indicators? How do you know that they are doing so? How do you know that measures are appropriately integrated with other CAS elements Attachment 4 NAP-21 Page 8 2-28-2011 and management systems? Implementation Review Approach Review the Contractor’s contract, CAS description document, and performance measures selection and integration procedures and records. Review the Contractor’s measures that are used by line and support managers. Interview Contractor line managers, support managers and staff Effectiveness Criteria Performance areas identified in the CAS have been tracked and analyzed Managers at appropriate levels are aware of the most recent performance measures and are using them to support management decision making Performance analysis has been provided to management in a timely manner The results of external assessments are consistent with contractor performance assessment measures; inconsistencies are evaluated Effectiveness Lines of Inquiry Are measures being selected as expected? How do you know? Are measures being used by managers to evaluate organizational and functional performance? How do you know? Are the measures being kept current with the changing organizational needs? Are there frequency, cycle time, or quality expectations that apply to measures planning? If so, how do you know how well you are performing against them? Are measures providing timely data for decision-making?

Section 44

Are measure performance levels and trends reliably translated into actionable information? How do you know? Are measures adequately transparent to DOE elements and corporate governance? How do you know? Are measures reliably finding issues before they are identified by external assessors and before they become larger problems? How do you know? Effectiveness Review Approach Review the Contractor’s performance measures selection and integration records. Review the levels and trends for a selection of measures key to the Contractor’s line and support organizational performance. Review the results of external assessments. Interview Contractor line and independent oversight personnel. NAP-21 Attachment 4 2-28-2011 Page 9 Element 5 – Integrated Continuous Improvement Element Objective The Contractor ensures the long-term sustainability and stewardship of the site and uses the results of performance measures and other CAS data to achieve improvements in performance. Implementation Criteria The contractor has established formal programs to use the results of performance measures and assessments to foster continuous improvement. Translation of performance evaluations into improvement measures is documented and visible as part of the CAS. Performance information is considered in allocating resources, establishing goals, identifying performance trends, identifying potential problems, and applying lessons learned and good practices. CAS is continuously evaluated for effectiveness to ensure long-term sustainability stewardship of the site. Implementation Lines of Inquiry How does Contractor management, NNSA, and the Contractor parent organization become informed of areas of concern? How does Contractor management, NNSA, and Contractor parent organization follow- up on areas of concern that warrant attention, and provide feedback and/or course corrections to Contractor management? How does Contractor management address areas of concern identified by NNSA or Contractor parent organizations? How is Contractor management held accountable for Contractor performance? How do you know that performance levels and trends are reliably translated into opportunities for risk reduction and performance improvement? How do you know that opportunities for risk reduction and performance improvement are prioritized in a manner that is consistent with the organization’s mission objectives, contractual requirements, and NNSA expectations? How do you know that the continuous Improvement processes are appropriately integrated with other CAS elements and management systems? Implementation Review Approach Review the Contractor’s CAS description document and continuous improvement (including data analysis, correlation, and results communication) procedures and Attachment 4 NAP-21 Page 10 2-28-2011 records. Interview Contractor line and support managers, including those in parent organizations. Observe one or more executive leadership meetings. Effectiveness Criteria Results of performance measure analysis have led to validated improvements in systems, processes, or capabilities. Performance improvements have been translated into durable measures to ensure permanent improvements. Effectiveness Lines of Inquiry Do assessments reliably lead to organizational improvement? How do you know? Are patterns and trends from issues being used to help identify performance uncertainties, risks, and emerging issues? How do you know?

Section 45

Do measures reliably lead to organizational improvement? How do you know? Are identified opportunities for risk reduction and performance improvement translating reliably into changes to systems, processes, and capabilities? Are the changes to systems, processes, and capabilities achieving the desired organizational results? How do you know? How do you know that continuous improvement gains can be sustained into the future? Effectiveness Review Approach Review the Contractor’s continuous improvement (including data analysis, correlation, and results communication) records. Review levels and trends for measures key to the Contractor’s mission. Interview Contractor line and support managers, including those in parent organizations. Observe one or more executive leadership meetings. NAP-21 Attachment 4 2-28-2011 Page 11 Evaluating Site Office Line Oversight Programs PURPOSE: This appendix describes the critical attributes of a Site Office line oversight process and provides the lines of inquiry that should be used to evaluate the implementation and effectiveness of a Site Office line oversight process. Element 1 – Line Oversight Approach Element Objective A Site Office uses a systematic and effective approach to line oversight, including output from the CAS, to monitor and evaluate Contractor performance against mission and contract requirements. Implementation Criteria The approach used to implement the elements described in the Site Office line oversight description document(s) are sufficiently defined that they can be executed in a repeatable and predictable manner and the approach is being used in the specified manner by Site Office personnel The Site Office line oversight process includes easy, transparent, and complete access to all CAS data and Contractor performance measures. The Site Office line oversight approach is integrated with other management and contractual evaluation processes and requirements. The Site Office line oversight approach includes oversight of all elements of contractor performance based on risk. The Site Office line oversight approach is flexible so that it can be adjusted based on risk and Contractor performance. Implementation Lines of Inquiry Are Site Office line oversight roles and responsibilities defined in approved Site Office documents? How do you know? How is the Site Office line oversight process documented? Does the Site Office line oversight process include elements to plan and conduct assessments, document assessment results, identify and track issues including corrective actions, evaluate risk, and analyze results (including metrics and indicators) for performance trends? Are these processes well-deployed for functional oversight areas? How do you know? How does the Site Office use the line oversight process to monitor and evaluate Contractor performance? How are the outputs of the CAS used as part of the process to evaluate the Contractor’s performance? How is Contractor performance feedback from Site Office line oversight provided to the Contractor on a periodic basis throughout the Attachment 4 NAP-21 Page 12 2-28-2011 year? How is the line oversight process integrated with, and complementary to, other Site Office Contractor management and evaluation methods such as Performance Evaluation Plan, Contract Management Plan, and contract modification processes, etc.?

Section 46

How do you know an Integrated Site Office Assessment Plan is approved by the Site Office Manager and issued each year? How do you know the functional area/purpose and frequency of assessments specified? How do you know the Plan adjusted based on risk and performance? Implementation Review Approach Review the NNSA guidance regarding expectations for the Nuclear Security Enterprise Integrated Assessment Planning Model, the Contractor Assurance System, and the Line Oversight System. Review Site Office Functions, Responsibilities, and Authorities Manual, line oversight procedures, assessment and management products. Interview Site Office managers, subject matter experts, and appropriate Contractor personnel. Observe performance of one or more line oversight activities. Effectiveness Criteria The approach used to implement the Site Office line oversight process provides accurate, timely, and actionable information that can be used to improve performance or to manage risk. Significant CAS implementation gaps or degraded CAS contractor performance noted by the site office are documented and conveyed to the contractor Relevant site office line oversight information is transparently conveyed to NNSA elements to maintain NNSA-HQ line management situational awareness. Effectiveness Lines of Inquiry Are assessments being planned and executed as expected? How do you know? Are there frequency, cycle time, or quality expectations that apply to assessment planning and execution? If so, how do you know how well the Site Office is performing against them? Are line oversight results regularly translated to information available to Site Office management? How do you know? Does the Site Office use assessment, measures, issues management, lessons learned, and improvement results to help determine Contractor performance and relay appropriate information to the Contractor? How do you know? Is relevant line oversight information transparently conveyed to NNSA elements? How do you know? Effectiveness Review Approach NAP-21 Attachment 4 2-28-2011 Page 13 Review Site Office assessment planning, performance, and reporting records. Interview Site Office personnel. Element 2 – Line Oversight Process Element Objective A Site Office employs a risk-informed, performance based process to focus oversight activities on processes, systems, and operations vital to ensuring the NNSA mission is executed in a manner that is safe, secure, legally and ethically sound, and fiscally responsible. Implementation Criteria The process used to implement the elements described in the Site Office line oversight description document(s) includes a description of how to grade line oversight based upon risk and Contractor performance. Site Office employees understand how line oversight is graded based on risk and Contractor performance and are implementing the oversight process on that basis. Site Office line oversight is focused on high-risk processes, systems, and operations and/or areas where contractor CAS performance does not meet site office expectations. Site Office solicits input from NNSA functional area and line managers when developing the annual Integrated Site Office Assessment Plan The process is being used in the specified manner by the Site Office. Implementation Lines of Inquiry

Section 47

Is the Site Office using a documented risk-informed process to determine what assessment activities will be conducted each year? Does this process ensure oversight of the Contractor’s activities which have the potential to compromise the ability of the Site to execute its mission and areas where CAS performance is not fully effective? Does the process have a logical flow and enable consistent results for planning oversight activities? How do you know? Is the Site Office using information/results from the following as part of its risk-informed decision-making process when identifying line oversight activities: line oversight assessments; operational awareness activities (e.g., feedback from facility representative tours), third party reviews (e.g., DOE Office of Health, Safety and Security evaluations); performance metrics; outputs from the CAS process and elements; available personnel resources; and importance of the functional area to mission execution. How do you know? Does the Site Office solicit input from NNSA functional area and line managers when developing the annual Integrated Site Office Assessment Plan? How do you know? Is the Site Office periodically providing the result/conclusion of line oversight activities to Attachment 4 NAP-21 Page 14 2-28-2011 appropriate functional and line managers in NNSA? How do you know? Implementation Review Approach Review Site Office line oversight procedures, assessment, and management products. Interview managers and staff at the Site Office and NNSA functional area managers. Observe Site Office line oversight activities Effectiveness Criteria The process used to implement the Site Office line oversight process assures that functional areas/processes are evaluated in context with the risk to mission, demonstrated contractor CAS performance, and with input from NNSA functional area managers. Site Office line oversight is continually reviewed and adjusted as necessary based on risk and Contractor performance. The Site mission is successfully executed in a manner that is safe, secure, legally and ethically sound, and fiscally responsible. Effectiveness Lines of Inquiry Are line oversight activities consistent with the conclusions of risk-informed decision- making and agreements with NNSA functional area/line managers? How do you know? Effectiveness Review Approach Review Site Office assessment planning, performance, and reporting records. Interview Site Office managers and assessment personnel. Element 3 – Oversight of CAS Element Objective A systematic approach is used to monitor and evaluate the implementation and effectiveness of the Contractor’s assurance system. Implementation Criteria The process used to monitor and evaluate the implementation and effectiveness of the Contractor’s assurance system is included in the line oversight processes and is sufficiently defined that it can be executed in a repeatable and predictable manner. The Site Office has easy, transparent, and complete access to all CAS data and Contractor performance measures. The Site Office oversight process includes an evaluation of the use of CAS information by the Contractor, the corrective actions identified and implemented, and the effectiveness of NAP-21 Attachment 4 2-28-2011 Page 15 the corrective actions in improving contractor performance. The site office provides documented feedback to the Contractor regarding CAS performance noting performance strengths and weaknesses and opportunities for improvement.

Section 48

Implementation Lines of Inquiry How is the line oversight process monitoring the implementation and effectiveness of the CAS including the aspects of mission performance, operational efficiencies, and management effectiveness to drive improvements? Does the LO approach include a systematic method to evaluate the fidelity and transparency of CAS data and information? Is fidelity and transparency evaluated through comparison with independent assessment results e.g., line oversight activities, third party reviews and other assessments? How do you know? How is the feedback regarding the CAS transmitted to the Contractor when the line oversight process identifies opportunities for improvement? How is the Site Office line oversight process for monitoring and evaluating implementation of the CAS documented? Implementation Review Approach Review Site Office line oversight procedures, assessment, and performance feedback reports to the contractor. Interview Site Office management and assessment personnel. Effectiveness Criteria The Site Office process for monitoring the implementation and effectiveness of the CAS results in improved performance of the CAS. The Site Office process for monitoring the implementation and effectiveness of the CAS results in changes to the Site Office line oversight process that seeks to confirm improvements in CAS performance. Effectiveness Lines of Inquiry Is the feedback from the Site Office regarding the CAS relevant to improving the Contractor’s performance? How do you know? How does the Site Office process for monitoring the implementation and effectiveness of the CAS result in changes to the Site Office line oversight process? Effectiveness Review Approach Review Site Office line oversight reporting records. Attachment 4 NAP-21 Page 16 2-28-2011 Interview Site Office and Contractor management and assessment personnel. Element 4 – Line Oversight Self-Assessment Element Objective A systematic approach is used to monitor, evaluate, and drive improvements in the implementation and effectiveness of Site Office Line Oversight system to ensure long-term sustainability. Implementation Criteria A self-assessment process to evaluate implementation of the line oversight process is sufficiently defined that it can be executed in a repeatable and predictable manner. The self-assessment process for line oversight is documented and maintained. The Site Office process evaluates the results of line oversight self-assessments, utilizes performance measures, identifies performance weaknesses/trends, and tracks the implementation of improvements. The self-assessment process includes external, independent assessments to complement and/or confirm site office awareness of performance from its self-assessment activities. Implementation Lines of Inquiry Does the Site Office process for performing self-assessments include a systematic method for evaluating the line oversight process? How do you know? Is the self-assessment process for line oversight documented in an approved procedure? How do you know? Does the Site Office self-assessment process include elements to plan, resource and conduct assessments, document assessment results, identify and track issues including corrective actions, and analyze results for performance trends? How do you know? Are performance metrics used by site office managers to determine the site office performance level and to take action to address performance weaknesses/trends? How do you know?

Section 49

How does the self-assessment process include external, independent assessments to complement and/or confirm site office awareness of self-assessment performance? Implementation Review Approach Review appropriate Site Office procedures, assessments, and management products. Interview appropriate Site Office management and personnel that develop, review, approve, and execute the self-assessment processes. NAP-21 Attachment 4 2-28-2011 Page 17 Effectiveness Criteria Site Office self-assessment activities result in sustained, continuously improving line oversight performance. Effectiveness Lines of Inquiry Do Site office self-assessments of the line oversight process provide conclusions regarding adequacy? How do you know? Are self-assessment results meaningful for sustaining the resources to maintain and improve the line oversight performance? How do you know? Effectiveness Review Approach Review appropriate Site Office assessment procedures, staffing analyses, performance assessments, and management products. Interview Site Office management and personnel with self-assessment responsibilities.

Something wrong with this record? Tell us