Skip to content
CWS
CorovaAboutContact
Book a Call
All articles
Service Delivery

The Benchmark Score Went Up. The Exposure Did Not Go Down.

The quarterly posture score went up and you cannot name anything that is meaningfully safer. Nobody gamed it. A benchmark weights its recommendations roughly alike, which is the right design for a portable standard, and it means a hundred configuration corrections move the number further than the one architectural problem that would take a quarter to fix.

CWSAugust 14, 20266 min read

The score moved and the estate feels the same

The report lands with the number higher than last quarter. The remediation log behind it is real: every line was closed by an engineer who did the work and captured the evidence. Then somebody asks what an attacker would find harder this month than in April, and the answers get vague.

The benchmark score is arithmetic over counts: recommendations passed over recommendations assessed, split by profile level where the benchmark defines them. Under that arithmetic a retention setting corrected on one service and the flat trust between two account groups, which lets a foothold in either one reach the other, are one item each, if the second appears at all.

The team's response to that measure is the correct one. Given a list where every line counts the same and one quarter to move a number, you close the lines that close, and those are the ones a policy can assert across the estate on a Tuesday. The architectural item needs a design conversation, a slot in a platform team's roadmap and somebody senior enough to fund it, so it will still be open at the next review whatever anyone intends today.

What moves a count quickly, ordered by how little has to be agreed first:

  • A default corrected once at account creation, which clears the same recommendation everywhere it applies from then on
  • A setting an organization policy can assert across every account in an afternoon
  • Logging and retention configuration, applied by script across a service
A hundred items that close in a quarter and one that does not, counted the same way, produce exactly this quarter.

Weighting every recommendation alike is the right call

A benchmark has to be portable across every organization that adopts it, which is exactly why it weights its recommendations alike. The weight of a recommendation depends on the estate it lands in: which account holds regulated data, which subscription fronts customer sign in, which project was stood up for a trial. Which of your findings is architectural is a fact about your estate, and it is held by the people who built it. Weights inside the benchmark would put that judgment in the wrong hands and stop the number comparing across organizations and across years, which is most of what a portable standard is for.

The standard is explicit about where its own judgment stops. CIS Benchmarks separate profile levels, so a recommendation intended for broad adoption sits apart from one written for a security sensitive estate, and each recommendation carries an assessment status distinguishing what a tool can determine from what a person inspects. The same body publishes a prioritized set of critical security controls organized into implementation groups, a different artifact answering a different question.

Scope matters more here than weight. A configuration benchmark grades settings on resources, precisely, one resource at a time. Several of the things that decide how far an intruder gets are relationships between resources: which account trusts which, which network path exists because a migration needed it and nobody removed it. Every resource along a path like that can pass every recommendation that applies to it.

The score is a strong answer to the questions it was built for:

  • Whether a platform is configured the way a broad consensus says that platform should be configured
  • Whether the configuration held between one quarter and the next
  • Whether accounts added since the last assessment entered at the same standard as the older ones
  • What an auditor asking for a configuration baseline is asking for

The second statement: what someone could reach

The other half of the report answers a different question and takes a different shape. Cloud native application protection platforms compute attack paths and toxic combinations across the estates they cover, and they assemble candidate paths faster than any team could by hand. What stays with you is the selection: which of those paths runs to something this business cannot afford to lose, what evidence shows it is live today, and who owns closing it. That half is prose, and it names paths: what is reachable from outside without a credential, and how far a foothold travels once one exists.

Each of those is a claim, so each carries evidence, an owner and a date. A workload in a shared services account can assume a role in every production account, and the path was built for a deployment pipeline that has since moved: that is a sentence with a beginning and an end. It closes on the day the path closes, and the hundred corrected settings elsewhere in the estate leave it exactly where it was.

There will be few of these, which is the point of them and also why they struggle to survive a report built around a chart. Four sentences look thin beside a percentage that moved, and they are the part a board can act on, because each names a decision somebody has to fund.

The questions that produce them:

  • What is reachable from the internet today without a credential, listed with what sits behind each entry point
  • What one valid credential from an ordinary engineering laptop reaches, and where the reach stops
  • What a single compromised workload touches, stated as the accounts and data stores it can get to
Four sentences about paths, each carrying an owner and a date, are the part of the report a board can fund.

Which control families move which number

CWS scores AWS, Azure and Google Cloud posture against CIS Benchmarks, the Cloud Controls Matrix and the NIST Cybersecurity Framework, tool agnostically. One of the more useful outputs of that work sits beside the score: which control families move the score, which move exposure, and which move both. The mapping is estate specific, it is built once and then maintained, and it belongs in front of whoever writes the next remediation plan.

Logging and monitoring carries many recommendations and changes what you can reconstruct after an event, while leaving what an intruder can reach today where it was. That makes it worth doing and a weak proxy for exposure. Identity trust runs the other way: few recommendations, and those few decide how far a foothold travels once it exists.

Two items each worth one line on the score can sit a long way apart on what they change about reachability. Once the families are sorted, the remediation plan can carry both orders: the sequence that closes the most lines, and the sequence that closes the shortest path to something that matters.

What the sorting produces, written down once:

  • The families where closing an item removes a path, each listed with the path it removes
  • The families where closing an item improves what you can see, and the question that improvement answers
  • The recommendations no exposure statement depends on, kept and worked as hygiene
  • The exposure statements no recommendation covers, which is where the architectural work sits

Publishing both numbers

The two go on the same page in different formats. One is a percentage. The other is a short list of sentences, each with a named owner, a date it was last tested, and the decision it is waiting on.

One rule keeps them from collapsing into each other. Movement in the score never closes an exposure statement. Write it down before the first report goes out, because the pressure to let a good quarter answer for both comes from people acting in good faith. A quarter where the score climbed and every exposure statement reads as it did last time produced configuration hygiene, and saying so plainly protects that work from being dismissed later.

All three of those moves are CWS design choices: the exposure statement published beside the score, the rule that a rising score leaves an exposure statement exactly where it was, and the division of control families by which number they move. Each sits outside what any standards body publishes, and each is offered as a position to argue with.

The hundred corrections stay in the report. Each removed an opportunity, they cost little, and a team that closes them consistently has change machinery that works, which is what the architectural item will need when its turn comes.

Where this changes behavior is next quarter's plan. With both on the page, the architectural item has somewhere to be reported from: a list of four sentences where its absence from the closed column is visible every quarter. On the score it is one line among hundreds, and a line among hundreds is easy to carry forward for a year.

What the page holds:

  • The score, with the benchmark, its version, the profile level and the scope it was computed over
  • The count of corrected configurations, reported as what it is
  • The exposure statements, each naming a path, an owner and the date it was last tested
  • Which statements closed since the last report, and which are word for word what they were
A benchmark score answers whether the estate is configured to a standard. Reporting only that number is what teaches a team to optimize it.

Sources

  • CWS delivery corpus: tool agnostic multi-cloud posture assessment across AWS, Azure and Google Cloud, scored against CIS Benchmarks, the Cloud Controls Matrix and the NIST Cybersecurity Framework
  • CIS Benchmarks, Center for Internet Security: per platform configuration benchmarks, their profile levels and the assessment status carried by each recommendation
  • CIS Critical Security Controls, Center for Internet Security: implementation groups as a separately published prioritization
  • Cloud Controls Matrix, Cloud Security Alliance
  • NIST Cybersecurity Framework, National Institute of Standards and Technology
  • The exposure statement, the rule about score movement, and the control family division: CWS design choices, published by no standards body