Skip to main content

    IT Risk

    IT Risk Assessment: Getting from a Risk Register Entry to a Tested Control

    Many IT risk registers are lists of worries with colours attached. They are reviewed quarterly, the colours rarely change, and nobody can say which control is supposed to address which entry or whether that control has ever been tested. An IT risk assessment that is worth the effort produces a chain: a risk written so that it can be tested, the control that is relied on to address it, a test designed for that control, a result, and a finding that tells someone what to do first.

    This article walks a single fictional entry through that chain, including what to do when the evidence is insufficient, and ends with how a bounded engagement is scoped so the work stays proportionate.

    By
    AuditPartners
    Added
    Reading time
    10 min
    Status
    Educational guide

    Frameworks and vocabulary

    Two NIST publications supply the vocabulary used here. NIST SP 800-30 Rev. 1 describes risk assessment in terms of threat sources, threat events, vulnerabilities, likelihood and impact, and is explicit that the output should inform decisions, not sit in a document. NIST CSF 2.0 organises cybersecurity outcomes into six functions, Govern, Identify, Protect, Detect, Respond and Recover, and is a convenient way to check that a risk register covers more than preventive controls. For testing, NIST SP 800-53A Rev. 5 gives the examine, interview and test methods that distinguish self-reported from inspected from tested evidence.

    None of these is a compliance requirement in itself. They are reference points; the criteria for any engagement are the ones agreed with the organisation. If the organisation runs an ISO/IEC 27001:2022 management system, its own risk methodology is the criterion and the standard's requirement for risk assessment and treatment applies, paraphrased rather than quoted here because the text is licensed.

    Step 1: write a risk that can be tested

    A risk statement is testable when it names an asset, a threat event, a consequence and a current rating with a stated basis. "Cloud security risk: High" fails all four. The rewrite below is the fictional entry we will follow.

    The rewrite already changed the conversation: 'two near-misses caught by chance' means the organisation has no detective control it can point to, which the next step makes explicit.

    Step 2: map the controls relied on

    For each risk, list the controls management relies on to reduce likelihood or impact, who owns each, and what kind of control it is. Checking the list against the CSF 2.0 functions is a quick way to see whether the organisation is relying on prevention alone.

    Controls relied on for R-17, as stated by management before testing
    ControlTypeCSF 2.0 functionOwnerManagement's description (self-reported)
    C-17.1 Organisation policy blocks public bucket accessPreventive, automatedProtectHead of Platform"An org-level policy prevents public access on all projects."
    C-17.2 Infrastructure-as-code reviewPreventive, manualProtectPlatform Lead"All storage changes go through pull-request review."
    C-17.3 Daily configuration scan with alertingDetective, automatedDetectSecurity Engineer"A posture tool scans daily and pages on public buckets."
    C-17.4 Data classification and bucket inventoryGovernanceIdentify / GovernData Protection Lead"We know which buckets hold personal data."
    C-17.5 Incident runbook for data exposureCorrectiveRespond / RecoverSecurity Manager"There is a runbook and we have exercised it."
    Everything in the last column is self-reported at this stage. The purpose of step 3 is to replace it with inspected and tested evidence.

    Step 3: design a test per control

    A test design states the method, the population, the sample and the pass condition. A single attempt can demonstrate an automated preventive control's behaviour at that point, not its operation throughout a period. Inspection of reliable operating records can support operating effectiveness; manual controls need evidence across the period, and detective controls need both a configuration check and evidence that alerts were acted on. The sample sizes, test periods and pass conditions below are illustrative, selected by risk, scope and the organisation's criteria, not universal requirements. All public-exposure or permission-denial exercises are performed only in an approved isolated sandbox with synthetic data and recovery controls, never on production buckets or unrelated real data.

    Test design for the R-17 controls
    ControlMethodPopulation and samplePass condition
    C-17.1 Org policyExamine policy configuration; test by attempting to set a public ACL on a synthetic-data bucket only in an approved isolated sandbox replicating each project type, with recovery controls.All projects in the organisation (policy inheritance); one sandbox attempt per project type.Policy present and enforced at the organisation node with no exempted projects; sandbox attempt denied.
    C-17.2 IaC reviewExamine repository protection; examine a sample of merged storage changes for an independent approver.All merged changes touching storage modules in the last 12 months (population from the repository); sample 25.Branch protection requires review; every sampled change has an approver other than the author before merge.
    C-17.3 Daily scanInspect scanner configuration, schedule, run records and alert history; test/re-perform detection by injecting a public synthetic-data bucket only in an approved isolated sandbox with recovery controls, and time the alert.All scan runs and alerts in the last 90 days; one sandbox injected test.Reliable records show daily scans with no gaps over 90 days; the sandbox injected bucket alerts within the documented window and reaches an on-call person.
    C-17.4 ClassificationExamine the bucket inventory; reconcile to the cloud provider's full bucket list.All buckets in the organisation.Every bucket holding personal data is in the inventory with a classification and owner.
    C-17.5 RunbookExamine the runbook and the record of the last exercise; interview participants.Exercises in the last 24 months.Runbook current; exercised at least once in the period with documented lessons and completed actions.

    Step 4: results, including insufficient evidence

    Three outcomes are possible for each test: the control operated, the control did not operate (an exception), or the evidence was insufficient to tell. The third is the one most often mishandled. Insufficient evidence is not a pass by default, and it is not a finding of failure either; it is a finding that the control cannot be relied on until evidence exists.

    R-17 test results
    ControlResultEvidence basisNote
    C-17.1 Org policyExceptionInspected + testedPolicy enforced at the organisation node, but two legacy projects are exempted for a vendor integration; a public ACL attempt succeeded in an approved isolated sandbox replica of one exempted project, using synthetic data and recovery controls.
    C-17.2 IaC reviewOperated, with one exceptionInspected24 of 25 sampled changes had an independent approver; one was merged by an administrator bypass during an incident.
    C-17.3 Daily scanFailed injected test + insufficient historical evidenceInspected + tested (test/re-performance)Inspection found scanner configuration and an alert rule, but run records and alert history were retained for only 30 days; 60 of the last 90 daily runs cannot be evidenced. In the approved isolated sandbox with synthetic data and recovery controls, the injected bucket produced no alert within four hours; the on-call rotation for the alert channel was empty.
    C-17.4 ClassificationExceptionInspectedInventory lists 38 buckets; the provider reports 51. Seven of the 13 unlisted buckets contain manifest exports created by a reporting pipeline.
    C-17.5 RunbookInsufficient evidenceSelf-reportedRunbook exists (document). Management states it was exercised in 2025; no record of the exercise, participants or actions could be produced.

    Step 5: one prioritised finding, not five equal ones

    Five results do not deserve five equal findings. Prioritise by what most changes the residual risk and what can be fixed fastest. For R-17, inspected project exemptions and a successful public-access attempt in an isolated sandbox replica (C-17.1), combined with failed sandbox detection and insufficient historical evidence (C-17.3), indicate a potential exposure path without demonstrated effective detection, in buckets partly missing from the inventory (C-17.4). No production bucket was exposed by the exercise.

    The remaining results (the review bypass in C-17.2 and the unevidenced runbook exercise in C-17.5) become lower-priority findings with their own owners and dates. The register entry for R-17 is updated with the tested residual rating and the date it was tested, which is the single change that turns the register from a list of worries into a record someone can rely on.

    Keeping the engagement bounded

    The chain above was worked for one risk. A proportionate engagement does not attempt it for every register entry. In our IT Audit & Technology Risk work a bounded engagement typically agrees: the register entries in scope (often the top five to ten by rating, plus any the sponsor is unsure about), the period, which controls will be tested rather than inspected, and the evidence the organisation must be able to produce before fieldwork. The AI Audit Evidence Request Checklist is written for AI systems but its owner / period / source / purpose structure is the same one we use for IT risk evidence requests.

    Whether the right engagement is an advisory assessment or an internal audit depends on who needs to rely on the result; Gap Assessment vs. Internal Audit sets out the difference. Where the risks concern AI-generated changes to systems like Orrin's dispatch platform, AI Technical Controls Assessment: From Work Ticket to Production shows the same chain applied to a single change. And if the question is simply whether your AI-related risks are in any register at all, the free AI Governance QuickScan is a ten-minute starting point.

    Key takeaways

    • Rewrite each risk with an asset, threat event, consequence, rating basis and owner before testing anything.
    • Map the controls relied on and check them against the CSF 2.0 functions to see whether detection and response exist at all.
    • Design each test with method, population, sample and pass condition selected by risk and scope; reliable records can support operation, and one automated-control test does not establish period-wide operation.
    • Insufficient evidence is neither a pass nor a failure; it means the control cannot be relied on until evidence exists, and the residual rating must reflect that.
    • Issue one prioritised finding per risk with ordered actions, owners and dates, then update the register with the tested residual rating.
    Related serviceIT Audit & Technology RiskRelated resourceAI Audit Evidence Request ChecklistFree toolAI Governance QuickScan

    References

    Primary sources cited above. Standards are referenced by number and year; their text is licensed and is paraphrased, not reproduced.

    1. NIST SP 800-30 Rev. 1, Guide for Conducting Risk Assessments, September 2012 (opens in a new tab) — Threat sources, threat events, vulnerabilities, likelihood and impact.
    2. NIST CSWP 29, The NIST Cybersecurity Framework (CSF) 2.0, February 2024 (opens in a new tab) — Govern, Identify, Protect, Detect, Respond and Recover functions.
    3. NIST Cybersecurity Framework programme page (opens in a new tab)
    4. NIST SP 800-53A Rev. 5, Assessing Security and Privacy Controls, January 2022 (opens in a new tab) — Examine, interview and test methods.
    5. ISO/IEC 27001:2022, Information security management systems — Requirements (opens in a new tab) — Licensed text; risk assessment and treatment requirements referenced, not reproduced.
    6. The IIA, Global Internal Audit Standards (effective 9 January 2025) (opens in a new tab) — Applies where the testing is performed as internal audit.

    Need this applied to your environment?

    A scoped assessment follows the agreed criteria, procedures and evidence described here. Findings are reviewed and signed off by accountable professionals.