CAP-04: Performance Monitoring
Automated mechanisms exist to centrally-monitor and alert on the operating state and health status of critical Technology Assets, Applications and/or Services (TAAS).
Control Question: Does the organization use automated mechanisms to centrally-monitor and alert on the operating state and health status of critical Technology Assets, Applications and/or Services (TAAS)?
General (6)
| Framework | Mapping Values |
|---|---|
| AICPA TSC 2017:2022 (used for SOC 2) (source) | A1.1-POF1 |
| CSA IoT SCF 2 | SNT-03 |
| NIST CSF 2.0 (source) | PR.IR-04 |
| SCF CORE ESP Level 1 Foundational | CAP-04 |
| SCF CORE ESP Level 2 Critical Infrastructure | CAP-04 |
| SCF CORE ESP Level 3 Advanced Threats | CAP-04 |
EMEA (1)
| Framework | Mapping Values |
|---|---|
| EMEA Germany Banking Supervisory Requirements for IT (BAIT) | 8.8 |
APAC (1)
| Framework | Mapping Values |
|---|---|
| APAC India SEBI CSCRF | DE.CM.S4 |
Americas (2)
| Framework | Mapping Values |
|---|---|
| Americas Canada CSAG | 3.1 |
| Americas Canada OSFI B-13 | 2.8.2 |
Capability Maturity Model
Level 0 — Not Performed
There is no evidence of a capability to centrally-monitor and alert on the operating state and health status of critical Technology Assets, Applications and/or Services (TAAS).
Level 1 — Performed Informally
C|P-CMM1 is N/A, since a structured process is required to centrally-monitor and alert on the operating state and health status of critical Technology Assets, Applications and/or Services (TAAS).
Level 2 — Planned & Tracked
Capability & Performance Planning (CAP) are requirements-driven and governed at a local/regional level, but are not consistent across the organization. CMM Level 2 control maturity would reasonably expect all, or at least most, the following criteria to exist: o Business stakeholders to identify business-critical systems and services. o Business stakeholders to identify single points of failure from a system/applications/services perspective. o Create and maintain infrastructure performance metrics to understand current resource needs. o Deploy preventative technologies to minimize the effect of Denial of Service (DoS) attacks against business-critical services.
- Capacity management is decentralized (e.g., a localized/regionalized function) and uses non-standardized methods to implement secure, resilient and compliant practices.
- IT/cybersecurity personnel identify cybersecurity and data protection controls that are appropriate to address applicable statutory, regulatory and contractual requirements for capability management.
- IT personnel work with:
- IT infrastructure personnel:
Level 3 — Well Defined
Capability & Performance Planning (CAP) efforts are standardized across the organization and centrally managed, where technically feasible, to ensure consistency. CMM Level 3 control maturity would reasonably expect all, or at least most, the following criteria to exist: o Create an annual infrastructure growth plan with input from both technology and business stakeholders. o Create and maintain infrastructure performance metrics to understand current resource needs. o Produce a capacity plan that covers current use, forecasted needs and support costs for new Technology Assets, Applications and/or Services (TAAS).
- The Chief Information Security Officer (CISO), or similar function with technical competence to address cybersecurity concerns, analyzes the organization's business strategy to provide guidance for capacity and performance planning practices.
- The CISO, or similar function, develops a security-focused Concept of Operations (CONOPS) that documents management, operational and technical measures to apply defense-in-depth techniques across the organization. This CONOPS for capacity and performance planning may be incorporated as part of a broader operational plan for the cybersecurity and data privacy program.
- A Governance, Risk & Compliance (GRC) team, or similar function, provides governance oversight for the implementation of applicable statutory, regulatory and contractual cybersecurity and data protection controls to protect the confidentiality, integrity, availability and safety of the organization's applications, systems, services and data.
- A steering committee is formally established to provide executive oversight of the cybersecurity and data privacy program and establishes a clear and authoritative accountability structure for capacity and performance planning operations.
- IT personnel work with business stakeholders to identify business-critical systems and services, as part of the organization's IT Asset Management (ITAM) program.
- Automated tools continuously monitor the operating state and health status of systems/applications/services.
- Business stakeholders conduct a Business Impact Analysis (BIA) to determine acceptable downtime constraints and any dependencies between applications or systems, to objectively determine the criticality of systems, applications or services, as well as the order is which systems need to be restored.
- Demand is managed for computing resources based on BIA-defined prioritization.
- Based on BIA results, IT infrastructure personnel deploy preventative technologies to minimize the effect of Denial of Service (DoS) attacks.
- IT architects identify appropriate solutions to make sure service levels can be met.
- IT infrastructure personnel:
- Automated tools continuously monitor the operating state and health status of Technology Assets, Applications and/or Services (TAAS) to expand the availability of resources, as demand conditions change.
- IT personnel work with business stakeholders to identify single points of failure from a system/applications/services perspective.
Level 4 — Quantitatively Controlled
Capability & Performance Planning (CAP) efforts are metrics driven and provide sufficient management insight (based on a quantitative understanding of process capabilities) to predict optimal performance, ensure continued operations and identify areas for improvement. In addition to CMM Level 3 criteria, CMM Level 4 control maturity would reasonably expect all, or at least most, the following criteria to exist:
- Metrics reporting includes quantitative analysis of Key Performance Indicators (KPIs).
- Metrics reporting includes quantitative analysis of Key Risk Indicators (KRIs).
- Scope of metrics, KPIs and KRIs covers organization-wide cybersecurity and data protection controls, including functions performed by third-parties.
- Organizational leadership maintains a formal process to objectively review and respond to metrics, KPIs and KRIs (e.g., monthly or quarterly review).
- Based on metrics analysis, process improvement recommendations are submitted for review and are handled in accordance with change control processes.
- Both business and technical stakeholders are involved in reviewing and approving proposed changes.
Level 5 — Continuously Improving
See C|P-CMM4. There are no defined C|P-CMM5 criteria, since it is reasonable to assume a continuously-improving process is not necessary to centrally-monitor and alert on the operating state and health status of critical Technology Assets, Applications and/or Services (TAAS).
Assessment Objectives
- CAP-04_A01 the operating state and health status of critical systems, applications and services is centrally-monitored.
Evidence Requirements
- E-CAP-03 Technology Performance Monitoring
-
Documented evidence of performance monitoring for technology-related capacity and/or performance criteria.
Capacity Management
Technology Recommendations
Micro/Small
- ManageEngine OpManager (https://manageengine.com)
Small
- ManageEngine OpManager (https://manageengine.com)
Medium
- ManageEngine OpManager (https://manageengine.com)
- Splunk (https://splunk.com)
- Solarwinds (https://solarwinds.com)
Large
- ManageEngine OpManager (https://manageengine.com)
- Splunk (https://splunk.com)
- Solarwinds (https://solarwinds.com)
Enterprise
- Splunk (https://splunk.com)
- Solarwinds (https://solarwinds.com)