A scanner finds known issues quickly. A human penetration test shows what an attacker can actually chain and reach. Buy continuous scanning for routine coverage, and a scoped penetration test before launch, before an enterprise deal, and after an incident.
A vulnerability scan arrives with hundreds of findings, and the seller says the system is ready to launch. Or a penetration test arrives as a long document describing three critical issues, and the question remains which one should block an enterprise deal. Both reports can be accurate in their own context. A scan and a test answer different questions, and the buying mistake is choosing one tool when the phase calls for the other.
This guide separates the two tools on coverage, false positives, exploit chains, and report quality, then sets out what to buy first by phase: before launch, before an enterprise deal, after a security incident, and as routine annual coverage. It also explains how to write a tight statement of work, how the Personal Data Protection Law changes the decision, and how to read a report in terms of severity, exploitability, and business impact. One pricing point is stated plainly. Our cybersecurity line is quote only, because effort follows scope and there is no published band for it.
Vulnerability scanner vs penetration test: what each covers
A vulnerability scanner is an automated tool that does exactly what its name says. It reports that operating system libraries are outdated, that an admin endpoint is exposed to the internet, that a security header is missing, and that a component version carries a documented flaw. Its strengths are clear. Coverage is fast and broad, repeat scans are cheap, and running the tool needs no downtime or special accounts. Its limits are also clear. First, it relies on signatures and fingerprints, so anything missing from its database is missed. Second, it produces false positives, reporting an issue that is visible in the surface but not reachable from the entry point that matters. Third, it does not build exploit chains, so each weakness is listed alone and the path combining two weak points to reach data stays hidden. The scanner answers which known issues exist. It does not prove what an attacker can complete.
A human penetration test starts where the scan ends. A person with experience takes an outcome and attempts to reach it through a sequence of steps. The tester reads what the scanner found, verifies each item by hand, and then chains points together. A flaw in user input leads toward an admin account, an authorization error in an API exposes files belonging to another customer, and a weak report path turns into full account takeover. The strengths of this work are direct. It removes false positive noise, because an issue that cannot be exploited is set aside, while a real issue is proven with a reproducible demonstration. Report quality is also different. A good human report explains business risk, shows the chain step by step, gives practical remediation, and includes a retest after the fix.
| Dimension | Vulnerability scanner | Human penetration test | Practical rule |
|---|---|---|---|
| Coverage | Broad and fast, suited to routine sweeps | Narrow and deep, limited to a scope and outcome | Scan often, test what proves impact |
| False positives | Common, and need manual triage | Fewer, because verification is part of the work | Do not judge risk from a count of findings |
| Exploit chains | Does not build chains, lists each point alone | Builds chains and demonstrates the path to data | A chain is the point that proves impact |
| Report quality | Long lists with identifiers and severity tags | Executive summary, paths, remediation, retest | Ask for a report that shows paths, not counters |
| Best for | Periodic review and change monitoring | Launch, deal, or incident decisions | Match the tool to the phase, not to habit |
What to buy first, by phase
Before launch, the goal is to prove that the main entry points do not allow unauthorized access. The practical order starts with an automated scan of sessions, dependencies, and libraries, then a narrow penetration test on the flows that move data. The scan removes obvious errors quickly. The human test checks authorization on user documents, payment actions, and phone sign-in. Do not order a broad test across every layer before the first release. Order a focused test on the path that carries personal data and on internet-exposed entry points, with time reserved for fixes and a retest. Launch that waits for a report mixing everything together wastes time and lowers result quality.
Before an enterprise deal, the goal is to prove diligence, not to list technology features. Many organisations ask for recent evidence of a penetration test and of routine vulnerability scanning. The right commercial order starts with a full-scope scan covering everything the customer will see, then a structured penetration test that proves standard protections on customer data, with certificates and remediation plans tied directly to contract clauses. A scan report alone does not prove diligence, because it is a dated list. A test report alone without routine scanning does not prove monitoring. The package larger customers accept combines both with documented dates, coverage, and scope. For what our team brings to this work, see cybersecurity solutions at Rasad.
After a security incident, the goal is to understand the intrusion path before issuing any report. Do not start with another scan, because it will list what was already known and leave the actual attack path open. Start with a review of one exit, one suspicious sign-in, or one unauthorized disclosure, then a penetration test on the same scope from the same angle until you know how far the attacker actually reached. The real exit may involve application behavior, server permissions, or a misconfigured rule. The automated scan is used here as a map, and the penetration test is the tool that proves the current failure. After fixes, run a retest, then restore routine scanning. For annual routine coverage, the scan is a discipline against drift, not a replacement for any test after an incident or before a contract. Set a known cadence. Scan monthly or quarterly when releases are frequent, and run a penetration test at least once a year, more often when the system changes materially or a new service goes into use.
Scope discipline: box type, target, and depth
Box type classifies the attacker information given, not the effort spent. Black box gives the tester no information and the tester works as an external attacker. It proves assumptions about the outside attack surface but stays narrow and slow. Grey box gives some information such as user accounts, API diagrams, and ordinary permissions, and the tester works as an insider with limited knowledge of the product layers. White box gives full information such as source code, server access, and the data map, and the tester works as an engineer with full access to expose internal weakness and access control failures. The choice follows the decision purpose. Before launch, an external view shows what the internet sees. Before an enterprise deal, grey box usually proves the most about real transaction controls. Before or after a serious incident, white box exposes the failure that black box would miss.
From reading to shipping
Want this built, not just explained?
Bring us the problem behind the article. We will tell you what it takes, what it costs, and whether we are the right team.
The second depth is the target. Web testing checks pages, sessions, input forms, and file uploads. API testing checks authentication, rate limits, media permissions, and queries. Mobile testing checks local storage, stored credentials, permission requests, and account pages. If a vendor names APIs and mobile without a separate test, ask for an example finding in each area. Write the scope in the statement of work. Name the target, the interaction guidelines, the data sources, the test environment, the test window, the identity to verify, and who owns each fix. A vague scope invites hours of exploratory work and lowers report quality. Keep the scope narrow and deliberate, so only what the target carries is tested.
What the Personal Data Protection Law changes
The Personal Data Protection Law has been fully enforceable since September 2024, and procurement in Saudi Arabia is now assessed inside that framework. The Saudi Data and AI Authority published draft amendments to the Implementing Regulation for consultation on 6 October 2026, with the consultation closing on 5 November 2026. The draft proposes removing the harm threshold and requires notification within 72 hours of awareness of a breach, and the draft proposes a general requirement to store personal data inside the Kingdom with limited exceptions. Because the amendments are still a draft, they are proposed by the draft and not required by the law until adopted. The practical implications are already a buying rule now.
These duties turn into concrete buying decisions. A sound design limits access so only data that a role needs is visible, keeps logs that prove who opened a file and when, documents retention periods that can be enforced, and keeps log entries long enough to reconstruct an incident. A human test speaks directly to this, because it proves whether authorization actually restricts data and not only the display. Start with direct questions. Which personal data will the system process? Where is data stored? Who can reach it from the server? Which logs exist? How quickly can the logs show an incident? Test these questions in vendor correspondence before requesting a quote. For the practical steps, refer to the client portal compliance checklist.
How to read a report: severity, exploitability, and business impact
Severity is read first, and it is never read alone. A critical severity means a flaw with large impact such as full access, admin-level control, or personal data leaving the system. Severity alone does not mean direct exploitability. A file reachable without authentication is more dangerous than a file that needs an authenticated account and a task inside the interface. A point flagged easily by a tool is a tool signal, not an attacker path. In a good report, each point is sized on three questions. Does it need authentication? Does it need admin rights? Can an attacker reach it from the internet? These questions rewrite the severity in practical terms.
Business impact is the deciding test. Size the point on what the breach means for the operation. Are customer records exposed? Are user credentials and tokens at risk? Are payment logs and invoices affected? Is there a way to change birth dates or official documents? A critical point in a global settings table matters less than a medium point in an export that an unauthorized user can see. Read the combined findings before the individual ones. Review full exploit chains, not only the list of points. A main acceptance test is threefold. Does the report give reproduction steps? Does it give practical remediation guidance? Does it include a retest inside the test scope? Without these three parts, the report does not lead you to a practical result. It is only a mental read.
Pre-test checklist
Target named in writing. Name the entry points, APIs, and data inside the scope, and name what is outside it.
Accounts ready and limited. Provide ordinary and admin user accounts, test data, and log access.
Box type and test mode in writing. Fix black, grey, or white box, the frozen test environment, and the work window.
Interaction rules stated. What is allowed and what is banned? Are real files in reach? What attacker paths are off-limits?
Fix owners assigned. Name the owner of each fix, the repair deadline per severity, and the retest plan.
Logging and retention agreed. Define what the systems record, the retention period, and how it is exported in the scope.
Incident roster identified. Set the contact plan before the test and the internal notification time from awareness with 72 hours in mind.
Documentation room ready. Prepare the API catalogue and documents, the data map, and the expected report outputs.
Frequently asked questions
Do we need both a scan and a test? Usually yes. Routine scanning covers small continuous changes, and a human test proves impact. A scan alone is a map, and a test alone is a decision.
What is the practical difference between black, grey, and white box? Black box starts with no information, grey box with some information, and white box with full information. Grey box is often best before a deal, and white box is best for exposing internal access failures.
Does a human test prove full compliance? No. Law compliance needs integrated decisions on access, logging, retention, and notification. A human test proves part of the picture, and it does not replace logs and operational controls.
How often do we run both? Scanning repeats on a frequent cadence such as monthly when releases are intense. A human test runs at least yearly, more often when the system changes materially or a new service goes live.
Can an old test report be reused? No. A dated report expires, and a retest after fixes is required. Verify authorization again after every change in entry points, data, or permission topology.
Sources
- PDPL Implementing Regulation — the official source for processing, disclosure, and incident notification duties.
- OWASP Web Security Testing Guide — a methodology for web security testing and task work by test type.
- OWASP Top 10 — a short reference for the most common web risks.
- SDAIA PDPL portal — enforcement status and draft amendment material.
