TDA-12: Customized Development of Critical Components
Mechanisms exist to custom-develop critical system components, when Commercial Off The Shelf (COTS) solutions are unavailable.
Control Question: Does the organization custom-develop critical system components, when Commercial Off The Shelf (COTS) solutions are unavailable?
General (10)
| Framework | Mapping Values |
|---|---|
| CIS CSC 8.1 | 16.7 16.11 |
| CIS CSC 8.1 IG2 | 16.7 16.11 |
| CIS CSC 8.1 IG3 | 16.7 16.11 |
| CSA IoT SCF 2 | SDV-03 SDV-05 |
| NIST 800-53 R4 | SA-20 |
| NIST 800-53 R5 (source) | PM-30(1) SA-20 SA-23 |
| NIST 800-53 R5 (NOC) (source) | PM-30(1) SA-20 SA-23 |
| NIST 800-161 R1 | SA-20 |
| NIST 800-161 R1 Level 2 | SA-20 |
| NIST 800-161 R1 Level 3 | SA-20 |
US (1)
| Framework | Mapping Values |
|---|---|
| US CERT RMM 1.2 | RISK:SG3.SP1 TM:SG1.SP1 TM:SG3.SP2 |
Capability Maturity Model
Level 0 — Not Performed
There is no evidence of a capability to custom-develop critical system components, when COTS solutions are unavailable.
Level 1 — Performed Informally
C|P-CMM1 is N/A, since a structured process is required to custom-develop critical system components, when COTS solutions are unavailable.
Level 2 — Planned & Tracked
Technology Development & Acquisition (TDA) efforts are requirements-driven and governed at a local/regional level, but are not consistent across the organization. CMM Level 2 control maturity would reasonably expect all, or at least most, the following criteria to exist:
- Development and acquisition management is decentralized (e.g., a localized/regionalized function) and uses non-standardized methods to implement secure, resilient and compliant practices.
- IT/cybersecurity personnel identify cybersecurity and data protection controls to address applicable statutory, regulatory and contractual requirements for technology development and acquisition management.
- IT/cybersecurity personnel implement secure practices to protect the confidentiality, integrity, availability and safety of the organization's technology assets, data and network(s).
- Secure development practices mostly conform to industry-recognized standards for secure engineering (e.g., OWASP, NIST SP 800-218, NIST SP 800-160, etc.).
- Procurement practices require third-party developers of systems, system components or services to follow secure engineering practices.
- A Project Management Office (PMO), or project management function, enables the implementation of cybersecurity and data privacy-related resource planning controls across the System Development Lifecycle (SDLC) for all high-value projects.
- An application development team, or similar function, custom-develops business-critical system components, when Commercial Off The Shelf (COTS) solutions are unavailable.
- Procurement contracts require system developers and integrators to provide training on the correct use and operation of the system, system component or service.
Level 3 — Well Defined
Technology Development & Acquisition (TDA) efforts are standardized across the organization and centrally managed, where technically feasible, to ensure consistency. CMM Level 3 control maturity would reasonably expect all, or at least most, the following criteria to exist: o Provides governance oversight for the implementation of applicable statutory, regulatory and contractual cybersecurity and data protection controls to protect the confidentiality, integrity, availability and safety of the organization's applications, systems, services and data for technology development and acquisition. o Ensures the Information Assurance Program (IAP) evaluates applicable cybersecurity and data protection controls as part of “business as usual” pre-production testing. o Operates the Cybersecurity Supply Chain Risk Management (C-SCRM) program to identify and mitigate supply chain-related risks and threats.
- Secure development practices conform to industry-recognized standards for secure engineering (e.g., OWASP, NIST SP 800-218, NIST SP 800-160, etc.).
- A procurement team, or similar function, ensures that third party development and/ or acquisitions meet, or exceed, the organization's business, cybersecurity and data privacy requirements to have secure and resilient systems, applications, services and processes.
- A Software Assurance Maturity Model (SAMM) governs a secure development lifecycle for the development of systems, applications and services.
- Administrative processes exist and technologies are configured to implement secure configuration settings by default to reduce the likelihood of software being deployed with weak security settings, putting the asset at a greater risk of compromise.
- An IT Asset Management (ITAM) function, or similar function, categorizes devices according to the data the asset stores, transmits and/ or processes and applies the appropriate technology controls to protect the asset and data.
- A formal Change Management (CM) program help to ensure that no unauthorized changes are made, all changes are documented, services are not disrupted and resources are used efficiently.
- A Governance, Risk & Compliance (GRC) function, or similar function;
- A Project Management Office (PMO), or project management function, enables IAP pre-production testing of cybersecurity and data protection controls as part of the organization's established project management processes.
- An application development team, or similar function, custom-develops business-critical system components, when Commercial Off The Shelf (COTS) solutions are unavailable.
- Procurement contracts require system developers and integrators to provide training on the correct use and operation of the system, system component or service.
Level 4 — Quantitatively Controlled
Technology Development & Acquisition (TDA) efforts are metrics driven and provide sufficient management insight (based on a quantitative understanding of process capabilities) to predict optimal performance, ensure continued operations and identify areas for improvement. In addition to CMM Level 3 criteria, CMM Level 4 control maturity would reasonably expect all, or at least most, the following criteria to exist:
- Metrics reporting includes quantitative analysis of Key Performance Indicators (KPIs).
- Metrics reporting includes quantitative analysis of Key Risk Indicators (KRIs).
- Scope of metrics, KPIs and KRIs covers organization-wide cybersecurity and data protection controls, including functions performed by third-parties.
- Organizational leadership maintains a formal process to objectively review and respond to metrics, KPIs and KRIs (e.g., monthly or quarterly review).
- Based on metrics analysis, process improvement recommendations are submitted for review and are handled in accordance with change control processes.
- Both business and technical stakeholders are involved in reviewing and approving proposed changes.
Level 5 — Continuously Improving
See C|P-CMM4. There are no defined C|P-CMM5 criteria, since it is reasonable to assume a continuously-improving process is not necessary to custom-develop critical system components, when COTS solutions are unavailable.
Assessment Objectives
- TDA-12_A01 suppliers of critical or mission-essential technologies, products and services are identified.
- TDA-12_A02 suppliers of critical or mission-essential technologies, products and services are prioritized.
- TDA-12_A03 suppliers of critical or mission-essential technologies, products and services are assessed.
- TDA-12_A04 critical system components to be reimplemented or custom-developed are defined.
- TDA-12_A05 critical systems are reimplemented or custom-developed.
- TDA-12_A06 systems or system components supporting mission-essential services or functions are defined.
- TDA-12_A07 organization-defined criteria are employed on systems or system components supporting essential services or functions to increase the trustworthiness in those systems or components.