Continuous Penetration Testing: Models, Cadence and Cost
Published by Zero Hunt, an autonomous AI red team on an on-premise appliance running private AI: automated penetration testing for networks and infrastructure, black-box or gray-box, with a human approving every step that matters.
Short definition
Continuous penetration testing replaces the once-a-year pentest with testing that repeats on a schedule and after changes, delivered by human testers on a platform (PTaaS), by autonomous software, or by both.
Why this matters now
An annual pentest describes the network on the days it was tested. New CVEs, configuration changes and new assets reopen attack paths every week, and the time from disclosure to exploitation is now measured in days. Regulators still mostly ask for at least yearly tests and tests after significant change, but the second half of that sentence is what an annual cycle cannot meet.
Key points
- ▸There is no standard definition. Vendors use the same words for three different things: subscription pentesting by humans (PTaaS), autonomous testing software, and hybrids.
- ▸The OWASP Continuous Penetration Testing Framework is only a 2022 statement of intent with no published document. Do not expect a standard to settle the definition.
- ▸PCI DSS, DORA and NIST SP 800-53 require periodic tests plus tests after significant changes; NIS2 asks you to assess the effectiveness of your measures without setting a frequency.
- ▸A practical cadence: external surface weekly, internal network monthly, after every significant change and every relevant KEV listing, plus at least one human-led test a year.
- ▸Cost models differ more than prices: credits or tester hours for PTaaS, a yearly licence by assets or sites for platforms.
What continuous penetration testing means
The term describes an outcome, testing that keeps up with change, rather than a method. In practice you will be offered one of three models:
- PTaaS (penetration testing as a service). Human testers working through a platform: you book tests, see findings as they are found, talk to testers and get retests within a window. Cobalt, Synack, HackerOne, NetSPI, Bishop Fox and BreachLock sell this model, often with automation and now AI agents added.
- Autonomous continuous testing. Software that runs the attack itself, on a schedule, without a tester per run. Horizon3.ai NodeZero, Pentera and XBOW are examples, and so is Zero Hunt. See autonomous penetration testing and AI pentesting agents.
- Hybrid. A platform runs automated or AI-driven testing continuously and human testers verify findings or test what the software cannot.
Related terms overlap: continuous automated red teaming (CART) usually means the same idea applied to the external surface, and Gartner's Adversarial Exposure Validation groups automated pentesting with breach and attack simulation.
If you searched for the OWASP Continuous Penetration Testing Framework: the project page exists, but it only states an intention to standardise the practice, and its repository has not changed since 2022. There is no framework document to follow.
Annual pentest, PTaaS and autonomous continuous testing
| Annual pentest | PTaaS (human, on a platform) | Autonomous continuous testing | |
|---|---|---|---|
| Who tests | A consultancy team | Human testers, often a vetted crowd, with platform tooling | Software agents, with people approving sensitive actions |
| How often | Once a year, sometimes twice | Windows bought in advance: per test, quarterly, yearly | Daily, weekly, monthly or on demand |
| Retest after a fix | Usually a separate engagement | Included within a retest window | Re-run the same campaign |
| Business logic and custom apps | Strong | Strong | Weaker than skilled humans |
| Internal network and Active Directory | When in scope | Depends on remote access or an agent on site | When the platform runs inside the network |
| Where test data lives | Consultancy laptops and reports | Vendor cloud | Vendor cloud or on premise, depending on the product |
| Typical cost model | Day rate × days | Credits or tester hours | Yearly licence by assets or sites |
Annual pentest
- Who tests
- A consultancy team
- How often
- Once a year, sometimes twice
- Retest after a fix
- Usually a separate engagement
- Business logic and custom apps
- Strong
- Internal network and Active Directory
- When in scope
- Where test data lives
- Consultancy laptops and reports
- Typical cost model
- Day rate × days
PTaaS (human, on a platform)
- Who tests
- Human testers, often a vetted crowd, with platform tooling
- How often
- Windows bought in advance: per test, quarterly, yearly
- Retest after a fix
- Included within a retest window
- Business logic and custom apps
- Strong
- Internal network and Active Directory
- Depends on remote access or an agent on site
- Where test data lives
- Vendor cloud
- Typical cost model
- Credits or tester hours
Autonomous continuous testing
- Who tests
- Software agents, with people approving sensitive actions
- How often
- Daily, weekly, monthly or on demand
- Retest after a fix
- Re-run the same campaign
- Business logic and custom apps
- Weaker than skilled humans
- Internal network and Active Directory
- When the platform runs inside the network
- Where test data lives
- Vendor cloud or on premise, depending on the product
- Typical cost model
- Yearly licence by assets or sites
Most programmes combine two columns: autonomous testing for breadth and frequency, human testing for depth.
Why annual testing is not enough
- Change. Every new server, firewall rule, cloud account or software release can open a path that last year's report never saw.
- New vulnerabilities. Edge devices, VPNs and file-transfer servers keep getting critical CVEs that are exploited within days of disclosure. A test in March says nothing about a CVE published in June.
- Drift. Fixes get undone, temporary exceptions become permanent, and credentials get reused.
- Proof of remediation. Without a retest, a closed ticket is a claim, not evidence.
None of this makes the annual human-led test useless. It makes it the deep check, not the only one.
What regulations say about frequency
Most rules set a minimum and add a trigger for change, which is the part continuous testing answers:
- PCI DSS v4.0.1, requirement 11.4: internal and external penetration tests at least once every 12 months and after any significant infrastructure or application upgrade or change. See PCI DSS 11.3 and 11.4.
- DORA, art. 24(6): appropriate tests at least yearly on all ICT systems and applications supporting critical or important functions; art. 26 adds TLPT at least every three years for the entities identified. See DORA penetration testing beyond TLPT.
- NIS2, art. 21(2)(f): policies and procedures to assess the effectiveness of risk-management measures, with no frequency set. In Italy, ACN's Allegato 2 requires essential entities to run vulnerability assessment and/or penetration testing periodically and before go-live. See NIS2 obligations and deadlines.
- NIST SP 800-53 Rev. 5, CA-8: penetration testing at an organisation-defined frequency.
The pattern: a yearly floor, and tests after significant change. If changes happen every week, so should tests.
How often to test: a practical cadence
- External attack surface: weekly. Internet-facing services change fastest and are attacked first.
- Internal network and Active Directory: monthly, from an assumed-breach position with an ordinary user account (gray box).
- After every significant change: new site, merger, major release, firewall or identity-provider change.
- After a relevant KEV listing: test the affected systems while the patch is pending, and again after it. See the KEV emergency patch playbook.
- Before go-live of a relevant system, as Italian NIS2 rules require of essential entities.
- After every fix: re-run the same test to close the finding with evidence.
- Once a year: a human-led test of business logic, custom applications and anything the regulation reserves for qualified testers.
Cost models
Public prices are rare, but the models are clear and decide what continuous testing will cost you:
- Credits or tester hours (PTaaS). You buy a bank of testing time. Cobalt, for example, sells credits worth eight pentest hours each. Testing more often means buying more credits.
- Subscriptions per test window. A fixed number of tests or a testing period per year, sometimes with continuous monitoring between them.
- Yearly licence (autonomous platforms). Priced by assets, IPs or sites, with unlimited runs. Here the cost of testing weekly is the same as testing monthly, which is what makes a high cadence affordable.
When you compare quotes, price the cadence you need, not the one in the brochure: 52 external runs and 12 internal runs a year, plus retests. More in automated pentesting cost.
Questions to ask a vendor
- Who or what runs each test? A person, software, or software with a person checking the results?
- What does continuous mean in the contract? Runs per month, retests included, testing after changes on request?
- Can it test the internal network and Active Directory, or only internet-facing assets?
- Where do findings, credentials and evidence go? Vendor cloud, a region of your choice, or your own premises?
- How is scope enforced and who can stop a test at once?
- What evidence comes with each finding, and does a retest prove the fix?
- Which regulations do reports map to, and does that include the ones you answer to?
The evaluation guide turns these into a pilot plan.
Questions
What is the difference between continuous penetration testing and PTaaS? PTaaS is a delivery model: human testers on a platform, bought as a subscription. Continuous penetration testing is the goal of testing as often as things change; PTaaS is one way to get there, autonomous testing software is another.
Is continuous penetration testing the same as vulnerability scanning? No. A scanner lists what might be vulnerable. A penetration test, continuous or not, tries to exploit it and chain findings into attack paths. See vulnerability assessment vs penetration testing.
Does continuous testing replace the annual pentest? For breadth and frequency it can; for depth on business logic and custom applications, and where a rule requires qualified testers or TLPT, keep a human-led test.
Is there a standard for continuous penetration testing? No. The OWASP project with that name has published nothing since 2022. For autonomous platforms, the OWASP Autonomous Penetration Testing Standard covers scope, safety, human oversight and evidence.
How does Zero Hunt do continuous penetration testing? Zero Hunt is an autonomous AI red team for networks and infrastructure on an on-premise appliance with its own models, so no customer data leaves it. Campaigns run once, daily, weekly, monthly or on a custom schedule, in black-box or gray-box mode, and an operator can start one after a change. A re-run after a fix shows closure with signed evidence. Five autonomy levels decide which actions wait for an operator, scope is validated on tool calls and in generated scripts, and findings map to 34 compliance frameworks worldwide. Zero Hunt publishes no benchmark numbers yet; its evaluation methodology is in preparation.
Sources
- OWASP Continuous Penetration Testing Framework, project page
- Regulation (EU) 2022/2554 (DORA), EUR-Lex
- Directive (EU) 2022/2555 (NIS2), EUR-Lex
- PCI Data Security Standard, PCI SSC
- NIST SP 800-53 Rev. 5
- ACN Allegato 2, basic measures for essential entities (PDF)
- Cobalt, pentest pricing
- Security Boulevard, Synack adds AI agent for continuous penetration testing (May 2026)
Goes deeper
Want this against your environment?
Book a 30-minute scoping call — we will map this directly to your current compliance scope and threat profile.