오늘 닫기

Go to Top

Go to Top

Why Do Flaws Persist Despite Annual Audits? What Changed When I Looked Through an Attacker’s Eyes
Why Do Flaws Persist Despite Annual Audits? What Changed When I Looked Through an Attacker’s Eyes

Security Insights

Security Insights

Security Insights

Why Do Flaws Persist Despite Annual Audits? What Changed When I Looked Through an Attackers Eyes

Why Do Flaws Persist Despite Annual Audits? What Changed When I Looked Through an Attackers Eyes

Why Do Flaws Persist Despite Annual Audits? What Changed When I Looked Through an Attackers Eyes

ENKI WhiteHat

ENKI WhiteHat

Content

Content

Content

Even if a company gets checked every year and rated "Good," a Red Team project will find critical flaws. We look at the difference between vulnerability checks and real attacks, plus what to check before a breach happens.

——————

In recent years, the IT landscape has shifted rapidly. Infrastructure moved from on-premise to cloud, code is deployed many times daily via CI/CD, and AI coding tools like Cursor and GitHub Copilot have entered development. Services are created and updated faster than ever before.

The issue is that the way we verify system security—annual vulnerability checks—remains virtually unchanged. This leads to a recurring paradox. When we run Red Team projects on firms with annual 'Good' ratings, we always find critical flaws. This spans finance, manufacturing, retail, healthcare, e-commerce, and public sectors. Notably, the highly regulated finance sector is no exception. If it happens there, other less audited sectors are even more vulnerable.

This article comes from my experience as both a defender and an attacker. However, the goal is not just to describe the issue. I want to explain what annual checks structurally miss, and more importantly, what security officers need to change today. Having been on both sides, I wrote this as honestly as possible.

As a defender, I checked boxes; as an attacker, I hunt real vulnerabilities.

I know this gap better than anyone because I once worked on the audited side. Frankly speaking, back then, I was just busy "proving" things. I bring this up not to confess my past, but because many security managers in the same position today might be standing on the very same line.

As a former defender, I checked boxes; as an attacker now, I find real vulnerabilities.

When I worked in finance security, my day was not filled with digging deep into systems to find and fix vulnerabilities. It was spent checking off compliance checklists from regulators, drafting supporting documents, and gathering scattered data from departments to meet deadlines. It felt less like security and more like "proving" security.

But this is not about individual laziness; it is a problem of evaluation metrics. The first question from executives and regulatory bodies to a security officer is never, "How serious a vulnerability did you find?" It is always, "Did you satisfy all items on the checklist?" When evaluations are structured that way, the focus of work follows. Getting "compliant" on every row becomes the goal, while asking, "If a real attacker targeted this system, how would they get in?" is pushed aside. Compliance-driven tasks and actual security are not the same, but organizations always reward the former.

Is your daily routine really any different from this today? If so, this is not a personal failure on your part, but a flaw in the evaluation structures you operate under—and that structure is precisely the environment that attackers welcome most.

A defender's day is filled with checklists, not with vulnerabilities.

On the Red Team, everything was inverted. No checklists to complete, no tables to format for presentation, no templates to follow. Within my authorized scope, my job simplified to just one thing: find actual critical vulnerabilities by any means. Freed from the constraints and formats that bound me as a defender, the system's true nature began to appear.

With the goal narrowed to one, what I saw changed. Through the very items I once labored to mark as "Secure" as a defender, attackers slipped by with ease. The documents I piled up to match templates offered no defense against the actual path of intrusion. The tasks on which I spent most of my time as a defender were the first, most easily bypassed obstacles for attackers.

Having stood on both sides, I saw it clearly. Vulnerability assessment asks, "Is the checklist met?" but attackers ask, "Is it actually secure?" The gap between these two questions is why critical vulnerabilities are found in companies rated "Secure" year after year. Let us structurally examine exactly where this gap widens.

Red teaming strips formality to find strictly critical vulnerabilities.

Vulnerability checks and real attacks have different goals, methods, and viewpoints. This difference leaves gaps. Let's look at six gaps repeatedly found in practice.

1. The checked scope and the actual attacker's scope are different.

Vulnerability checks have a fixed scope. Schedules are announced, target systems are agreed upon, and sensitive assets that could affect operations are often excluded. This is a reasonable choice for stable checks.

However, real attackers face no such limits. Forgotten legacy servers, systems handed over from outsourcing, temporary services, open ports—all become entry paths. In ENKI Whitehat's Red Team projects, the actual starting point of intrusion was often an asset completely outside the check's scope. Checks look where we show; attackers look where we forgot.

2. Checks are a "checklist," while attacks are a "scenario."

Vulnerability checks have inherent limits. They match the system against a list of known vulnerabilities and summarize the results.

Red Teams achieve goals instead of checking items. With goals like stealing customer data, accessing secrets, manipulating payments, or taking over servers, they replicate the tactics, techniques, and procedures (TTPs) of real attackers, combining low-risk vulnerabilities into one attack. Connecting small leaks, loose authorization, and unused open ports creates a path from outside to critical data. Checklists structurally fail to find this. Individual items were "Good" or "Low," but combined they became "Critical." This is the biggest difference.

3. Checks are point-in-time, while attacks are continuous.

Quarterly or bi-annual checks are inherently like a single snapshot. However, today's systems are deployed many times a day, and settings change slightly even during operation.

Updates and new assets during the long gaps between checks are effectively defenseless. The cycle of change is now in minutes, but verification remains quarterly or bi-annual. One API added or one firewall policy opened in a hurry after a check stays exposed for months. This gap is where critical vulnerabilities begin.

4. Checks only look at systems, not people and processes.

Vulnerability checks look at systems. However, real-world breaches often start with a phishing email, a neglected partner account, or social engineering that exploits trust.

Data backs this up. Global breach analysis reports repeatedly show that many breaches bypass systems via "people" through phishing, stolen credentials, or poor insider access controls. Yet, no secure coding guide flags this as "vulnerable." Red Teams verify by integrating people, processes, and systems into one attack surface.

5. They look at 'can we block,' but not 'can we detect.'

Vulnerability checks ask, "Is there a hole?" But the more critical question is, "Can we detect it when someone actually breaks in?"

Many companies block initial entry through checks. Yet once in, attackers move laterally, escalate privileges, and extract data while detection often fails. Taking hundreds of days to identify and respond reveals that organizations invest less in 'detecting' than 'blocking.' Often, as attackers roam for days, no security alert triggers. Verifying entry risk and detection capacity together is Red Teaming's core value.

6. The trap of peace of mind created by "Good Reports"

The last issue is organizational, not technical. Accumulating "Good" reports over years creates a false sense of security that "we are a well-checked company." The root cause is the direction of appraisal. As long as leadership asks, "Did we pass the checklist?" rather than "How severe were the vulnerabilities found?" the organization optimizes to get "Good" ratings rather than find risks. Vendors also lack incentive to present uncomfortable truths to maintain business relationships.

This is why Red Teams exist with an independent, adversarial viewpoint. Only verification judged by results, not relationships, reveals the real risks hidden in reports.

Why do vulnerabilities persist despite annual audits?

The six gaps mentioned above ultimately point in one direction. The security practitioner's job must shift from "filling out checklists" to "verifying from an attacker's perspective." This does not mean a grand reorganization is needed. Regardless of your industry, here are three practical steps to start changing the way you work today.

Step 1. Design the Assessment - Scope and Assets

  • Do not read "compliant" as "secure." "Compliant" in an assessment report only means no known risks were found; it is not proof of safety.

  • You cannot protect assets you do not know about. Map your entire attack surface. External attack surface management and maintaining an asset inventory is a matter of survival, not compliance.

  • Do not make vulnerability assessments easy to perform. Assessments conducted with open firewalls and whitelisted security tools do not reflect the actual environment an attacker faces. Do not grant conveniences during assessments that are not available to attackers.

Step 2. Verify - Beyond Checklists to Scenarios

  • Think about attack paths, not just vulnerabilities. Multiple "low" severity vulnerabilities can combine to form a critical flaw. You must first consider what is possible by chaining them through threat modeling.

  • Replicate real attacker TTPs. Instead of assessments that check off known items based on MITRE ATT&CK, simulate attacks that achieve objectives to reveal hidden flaws.

  • Go beyond prevention to verify detection and response procedures. Assume the perimeter is breached and try internal expansion, privilege escalation, and data exfiltration. Measure if EDR, SIEM, and SOC actually detect it, how long detection takes, and how long containment takes.

Step 3. Continuous Operation - Continuous, Not One-time

  • Shift to continuous verification. Align assessment cycles with the rate of change using breach and attack simulations or continuous penetration testing. Quarterly assessments cannot keep up with systems changing by the minute.

  • Include people and vendors in your scope. Supply chains, outsourced operations, and employees must be included in the verification scope using social engineering. As long as you only assess technology, the most common entry paths will always exist.

  • Manage discovered vulnerabilities through processes. Do not just patch critical vulnerabilities found by the red team. Feed them back into security policies, development guides, and detection rules to prevent the same flaws from recurring.

  • Create a culture that welcomes uncomfortable results. The partner who finds critical vulnerabilities and makes you uncomfortable is actually the partner protecting you best.

So what should we check? - Step-by-step verification

Regular vulnerability checks are the start of security, not the end. While tests check if known issues exist within this scope, attackers target gaps between scans, from outside the scope, via unknown paths.

In closing, there is one question security officers must ask themselves: Are we working to "fill out playlists" or to "actually be safe"? Experiencing both defender and attacker roles shows that when you distinct the two, real security begins. Spend time and resources used for "satisfactory" grades to attack ourselves first from attacker's eyes; that is where change must start.

Enki White Hat finds critical vulnerabilities across sectors not because of a secret weapon. It is because we test with scenarios, not checklists; continuously, not just once; systems, people, and processes; and if we are detected, not just breached.

All your diligent work might have only made you "believe" you are safe, rather than actually making you safe. The moment you realize this is exactly when real security begins.

Summary

Regular vulnerability testing is the starting point of security, not the ending point. Testing checks if known issues exist within this scope, but attackers target unknown paths, outside the scope, and the gaps between tests.

In closing, there is only one question a security officer must ask themselves. Are we now working to "fill out the checklist," or are we working to "actually be safe"? Experiencing both defender and attacker roles, the moment that distinguishes these two is when real security begins. Turning some of the time and resources used to get "satisfactory" into attacking ourselves first from an attacker's perspective—that is where change must start.

The reason ENKI Whitehat can find critical vulnerabilities regardless of the industry is not because of any special secret weapon. It is because we verify with scenarios instead of checklists, continuously instead of at one point, human and process as well as system, and whether it gets caught beyond whether it is breached.

The work we have done diligently might have been making us "believe" we are safe, rather than actually making the company safe. And the moment we realize this fact is where real security finally begins.

ENKI WhiteHat

ENKI WhiteHat

ENKI WhiteHat
ENKI WhiteHat

Offensive security experts delivering deeper security through an attacker's perspective.

Offensive security experts delivering deeper security through an attacker's perspective.

The Beginning of Flawless Security System, From the Expertise of the No.1 White Hacker

Prepare Before a Security Incident Occurs

The Beginning of Flawless Security System, From the Expertise of the No.1 White Hacker

Prepare Before a Security Incident Occurs

The Beginning of Flawless Security System, From the Expertise of the No.1 White Hacker

Prepare Before a Security Incident Occurs

구독하기

콘텐츠가 유용했다면?
엔키 레터를 구독하세요!

Copyright © 2025. ENKI WhiteHat Co., Ltd. All rights reserved.

Copyright © 2025. ENKI WhiteHat Co., Ltd. All rights reserved.

Copyright © 2025. ENKI WhiteHat Co., Ltd. All rights reserved.