What is a penetration testing methodology?
It is the written plan for how a test is run: which phases happen in which order, what gets checked in each, and what each phase produces. A methodology is what makes two tests of the same system comparable, and what lets a reviewer check that nothing important was skipped.
Most firms build theirs on one or more public standards. PCI DSS v4.0.1 requirement 11.4.1 makes this formal for card data environments: the entity must define, document and implement a penetration testing methodology that includes "industry-accepted penetration testing approaches."
What are the phases of a penetration test?
The usual sequence has eight phases, and the middle ones loop. NIST SP 800-115 draws four (planning, discovery, attack, reporting) and notes in a footnote that there are many acceptable ways to group the work. The Penetration Testing Execution Standard (PTES, at pentest-standard.org) splits it into seven sections. The table below follows PTES and adds the retest, which PCI DSS 11.4.4 requires.
| Phase | What happens | Output |
|---|---|---|
| Pre-engagement | Scope, targets, exclusions, accounts, windows, contacts and stop conditions are agreed and signed | Rules of engagement, test plan |
| Reconnaissance | The tester maps hosts, services, endpoints, roles and technologies, from public sources and active discovery | Asset and endpoint inventory |
| Threat modeling | The tester decides what matters: sensitive data, privileged functions, likely attackers and their goals | Prioritized attack scenarios |
| Vulnerability analysis | Scanners and manual review identify candidate weaknesses in the prioritized areas | Candidate list, not yet confirmed |
| Exploitation | Each candidate is attempted; what works becomes a finding with proof | Confirmed findings with evidence |
| Post-exploitation | From each foothold the tester tries to escalate, move laterally and reach the scenario goals | Attack paths and real impact |
| Reporting | Findings are written with severity, reproduction steps and fixes, plus an executive summary | Report, often an attestation letter |
| Retest | Fixes are tested with the original steps and nearby variants | Updated status per finding |
The loop matters. NIST describes a feedback path from attack back to discovery: new access reveals new systems, which get their own reconnaissance and analysis. A test that runs the phases once, in a straight line, stops at the first layer.
What does one finding look like as it moves through the phases?
Here is a single invented example from a gray-box test of a multi-tenant SaaS app at app.example.
- Pre-engagement. The RoE lists
app.exampleandapi.example, two tenants, and an admin and a member account in each. - Reconnaissance. The JavaScript bundle references
/api/v2/exports, which appears nowhere in the published API spec. - Threat modeling. Exports contain tenant data, so cross-tenant access to them is a top scenario.
- Vulnerability analysis. The endpoint takes an
export_idthat looks sequential (export_3301,export_3302). - Exploitation. A member of tenant B requests
export_3301, created by tenant A, and receives it. The finding is confirmed. - Post-exploitation. The tester checks whether the same flaw allows deletion, and whether an export includes session tokens or API keys. It allows neither, which caps the impact.
- Reporting. One finding, with both requests, the missing tenant check named, and a fix in the shared authorization layer.
- Retest. The original request now returns 404. The tester also tries the v1 path and a job ID from a different endpoint, both blocked.
Steps 2 and 6 are where methodologies differ most in practice. A checklist-only test would not have found the undocumented endpoint, and a test without post-exploitation would have reported the impact as unknown.
Which standards define penetration testing methodology?
Five are cited most often. They overlap but are not interchangeable: two are end-to-end processes, one is a web testing catalog, one is a security measurement method, and one is a model of attacker behavior.
| Standard | Maintainer | Current version | What it covers | Best used for |
|---|---|---|---|---|
| PTES | PTES community | Its site calls the current text v1.0 | Seven phases from pre-engagement to reporting, with separate technical guidelines | Structuring a whole engagement |
| OWASP WSTG | OWASP | v4.2, December 2020; v5.0 in development | Web application tests in 12 categories, from information gathering to API testing | Coverage of web and API tests |
| NIST SP 800-115 | NIST | September 2008 | Planning, techniques and reporting for security testing in general, with an RoE template | Government and regulated programs |
| OSSTMM 3 | ISECOM | 2010 | One method across five channels: human, physical, wireless, telecommunications and data networks | Measuring attack surface across channels |
| MITRE ATT&CK | MITRE | Enterprise matrix v19 | Adversary tactics and techniques observed in real attacks | Planning scenarios and mapping findings |
A few details are worth knowing:
- PTES states that the standard itself gives no technical guidance on executing a test; that lives in a companion technical guide.
- The OWASP WSTG gives each test an ID such as WSTG-ATHZ-02 (bypassing authorization schema). Reports that cite these IDs show exactly which checks ran. Its 12 categories run from 4.1 Information Gathering to 4.12 API Testing.
- NIST SP 800-115 has not been revised since 2008, so its tool references are dated. Its phase model and Appendix B RoE template are still widely used; see rules of engagement.
- OSSTMM 3 replaced risk scoring with an attack surface metric (the "rav") and a Security Test Audit Report (STAR).
- MITRE ATT&CK describes itself as a knowledge base of adversary tactics and techniques based on real-world observations. It is not a test procedure. Testers use it to choose realistic scenarios and to label what they did, such as Initial Access, Privilege Escalation and Lateral Movement. FedRAMP's Penetration Test Guidance lists ATT&CK tactics as goals a test should attempt to attain.
For a web product, a common combination is PTES for the engagement structure, the WSTG and the OWASP API Security Top 10 for coverage, and ATT&CK for post-exploitation scenarios.
What does PCI DSS require a methodology to include?
Requirement 11.4.1 lists what the documented methodology must cover. In summary: industry-accepted approaches; the entire CDE perimeter and critical systems; testing from inside and outside the network; validation of segmentation and scope-reduction controls; application-layer testing for at least the vulnerabilities in requirement 6.2.4; network-layer testing of components that support network functions and operating systems; review of threats and vulnerabilities from the last 12 months; a documented approach to assessing the risk of what is found; and retention of results and remediation for at least 12 months.
That list is a reasonable test of any vendor's methodology, PCI or not. See internal vs external penetration testing for the inside and outside requirement.
Common mistakes
- Naming a standard in the proposal without saying which parts apply to this test.
- Skipping threat modeling, so effort spreads evenly across low-value and high-value features.
- Stopping at the first exploit with no post-exploitation, which understates impact.
- A retest that replays only the original request. Fixes often block one path and leave its neighbors open; see pentest retest.
[ Sources ]
- NIST SP 800-115: Technical Guide to Information Security Testing and Assessment (section 5.2.1)
- OWASP Web Security Testing Guide (WSTG) v4.2
- ISECOM: OSSTMM 3, The Open Source Security Testing Methodology Manual
- MITRE ATT&CK: Enterprise tactics
- PCI DSS v4.0.1 Requirement 11 text (11.4.1)
- FedRAMP Penetration Test Guidance v3.0 (2022)
Written by Parameter · Last reviewed

