← Learn
Definition8 min read

Continuous Penetration Testing: Models, Cadence and Cost

Published by Zero Hunt, an autonomous AI red team on an on-premise appliance running private AI: automated penetration testing for networks and infrastructure, black-box or gray-box, with a human approving every step that matters.

Short definition

Continuous penetration testing replaces the once-a-year pentest with testing that repeats on a schedule and after changes, delivered by human testers on a platform (PTaaS), by autonomous software, or by both.

Why this matters now

An annual pentest describes the network on the days it was tested. New CVEs, configuration changes and new assets reopen attack paths every week, and the time from disclosure to exploitation is now measured in days. Regulators still mostly ask for at least yearly tests and tests after significant change, but the second half of that sentence is what an annual cycle cannot meet.

Key points

  • ▸There is no standard definition. Vendors use the same words for three different things: subscription pentesting by humans (PTaaS), autonomous testing software, and hybrids.
  • ▸The OWASP Continuous Penetration Testing Framework is only a 2022 statement of intent with no published document. Do not expect a standard to settle the definition.
  • ▸PCI DSS, DORA and NIST SP 800-53 require periodic tests plus tests after significant changes; NIS2 asks you to assess the effectiveness of your measures without setting a frequency.
  • ▸A practical cadence: external surface weekly, internal network monthly, after every significant change and every relevant KEV listing, plus at least one human-led test a year.
  • ▸Cost models differ more than prices: credits or tester hours for PTaaS, a yearly licence by assets or sites for platforms.

What continuous penetration testing means

The term describes an outcome, testing that keeps up with change, rather than a method. In practice you will be offered one of three models:

  • PTaaS (penetration testing as a service). Human testers working through a platform: you book tests, see findings as they are found, talk to testers and get retests within a window. Cobalt, Synack, HackerOne, NetSPI, Bishop Fox and BreachLock sell this model, often with automation and now AI agents added.
  • Autonomous continuous testing. Software that runs the attack itself, on a schedule, without a tester per run. Horizon3.ai NodeZero, Pentera and XBOW are examples, and so is Zero Hunt. See autonomous penetration testing and AI pentesting agents.
  • Hybrid. A platform runs automated or AI-driven testing continuously and human testers verify findings or test what the software cannot.

Related terms overlap: continuous automated red teaming (CART) usually means the same idea applied to the external surface, and Gartner's Adversarial Exposure Validation groups automated pentesting with breach and attack simulation.

If you searched for the OWASP Continuous Penetration Testing Framework: the project page exists, but it only states an intention to standardise the practice, and its repository has not changed since 2022. There is no framework document to follow.

Annual pentest, PTaaS and autonomous continuous testing

Annual pentest

Who tests
A consultancy team
How often
Once a year, sometimes twice
Retest after a fix
Usually a separate engagement
Business logic and custom apps
Strong
Internal network and Active Directory
When in scope
Where test data lives
Consultancy laptops and reports
Typical cost model
Day rate × days

PTaaS (human, on a platform)

Who tests
Human testers, often a vetted crowd, with platform tooling
How often
Windows bought in advance: per test, quarterly, yearly
Retest after a fix
Included within a retest window
Business logic and custom apps
Strong
Internal network and Active Directory
Depends on remote access or an agent on site
Where test data lives
Vendor cloud
Typical cost model
Credits or tester hours

Autonomous continuous testing

Who tests
Software agents, with people approving sensitive actions
How often
Daily, weekly, monthly or on demand
Retest after a fix
Re-run the same campaign
Business logic and custom apps
Weaker than skilled humans
Internal network and Active Directory
When the platform runs inside the network
Where test data lives
Vendor cloud or on premise, depending on the product
Typical cost model
Yearly licence by assets or sites

Most programmes combine two columns: autonomous testing for breadth and frequency, human testing for depth.

Why annual testing is not enough

  • Change. Every new server, firewall rule, cloud account or software release can open a path that last year's report never saw.
  • New vulnerabilities. Edge devices, VPNs and file-transfer servers keep getting critical CVEs that are exploited within days of disclosure. A test in March says nothing about a CVE published in June.
  • Drift. Fixes get undone, temporary exceptions become permanent, and credentials get reused.
  • Proof of remediation. Without a retest, a closed ticket is a claim, not evidence.

None of this makes the annual human-led test useless. It makes it the deep check, not the only one.

What regulations say about frequency

Most rules set a minimum and add a trigger for change, which is the part continuous testing answers:

  • PCI DSS v4.0.1, requirement 11.4: internal and external penetration tests at least once every 12 months and after any significant infrastructure or application upgrade or change. See PCI DSS 11.3 and 11.4.
  • DORA, art. 24(6): appropriate tests at least yearly on all ICT systems and applications supporting critical or important functions; art. 26 adds TLPT at least every three years for the entities identified. See DORA penetration testing beyond TLPT.
  • NIS2, art. 21(2)(f): policies and procedures to assess the effectiveness of risk-management measures, with no frequency set. In Italy, ACN's Allegato 2 requires essential entities to run vulnerability assessment and/or penetration testing periodically and before go-live. See NIS2 obligations and deadlines.
  • NIST SP 800-53 Rev. 5, CA-8: penetration testing at an organisation-defined frequency.

The pattern: a yearly floor, and tests after significant change. If changes happen every week, so should tests.

How often to test: a practical cadence

  1. External attack surface: weekly. Internet-facing services change fastest and are attacked first.
  2. Internal network and Active Directory: monthly, from an assumed-breach position with an ordinary user account (gray box).
  3. After every significant change: new site, merger, major release, firewall or identity-provider change.
  4. After a relevant KEV listing: test the affected systems while the patch is pending, and again after it. See the KEV emergency patch playbook.
  5. Before go-live of a relevant system, as Italian NIS2 rules require of essential entities.
  6. After every fix: re-run the same test to close the finding with evidence.
  7. Once a year: a human-led test of business logic, custom applications and anything the regulation reserves for qualified testers.

Cost models

Public prices are rare, but the models are clear and decide what continuous testing will cost you:

  • Credits or tester hours (PTaaS). You buy a bank of testing time. Cobalt, for example, sells credits worth eight pentest hours each. Testing more often means buying more credits.
  • Subscriptions per test window. A fixed number of tests or a testing period per year, sometimes with continuous monitoring between them.
  • Yearly licence (autonomous platforms). Priced by assets, IPs or sites, with unlimited runs. Here the cost of testing weekly is the same as testing monthly, which is what makes a high cadence affordable.

When you compare quotes, price the cadence you need, not the one in the brochure: 52 external runs and 12 internal runs a year, plus retests. More in automated pentesting cost.

Questions to ask a vendor

  • Who or what runs each test? A person, software, or software with a person checking the results?
  • What does continuous mean in the contract? Runs per month, retests included, testing after changes on request?
  • Can it test the internal network and Active Directory, or only internet-facing assets?
  • Where do findings, credentials and evidence go? Vendor cloud, a region of your choice, or your own premises?
  • How is scope enforced and who can stop a test at once?
  • What evidence comes with each finding, and does a retest prove the fix?
  • Which regulations do reports map to, and does that include the ones you answer to?

The evaluation guide turns these into a pilot plan.

Questions

What is the difference between continuous penetration testing and PTaaS? PTaaS is a delivery model: human testers on a platform, bought as a subscription. Continuous penetration testing is the goal of testing as often as things change; PTaaS is one way to get there, autonomous testing software is another.

Is continuous penetration testing the same as vulnerability scanning? No. A scanner lists what might be vulnerable. A penetration test, continuous or not, tries to exploit it and chain findings into attack paths. See vulnerability assessment vs penetration testing.

Does continuous testing replace the annual pentest? For breadth and frequency it can; for depth on business logic and custom applications, and where a rule requires qualified testers or TLPT, keep a human-led test.

Is there a standard for continuous penetration testing? No. The OWASP project with that name has published nothing since 2022. For autonomous platforms, the OWASP Autonomous Penetration Testing Standard covers scope, safety, human oversight and evidence.

How does Zero Hunt do continuous penetration testing? Zero Hunt is an autonomous AI red team for networks and infrastructure on an on-premise appliance with its own models, so no customer data leaves it. Campaigns run once, daily, weekly, monthly or on a custom schedule, in black-box or gray-box mode, and an operator can start one after a change. A re-run after a fix shows closure with signed evidence. Five autonomy levels decide which actions wait for an operator, scope is validated on tool calls and in generated scripts, and findings map to 34 compliance frameworks worldwide. Zero Hunt publishes no benchmark numbers yet; its evaluation methodology is in preparation.

Sources

Goes deeper

Want this against your environment?

Book a 30-minute scoping call — we will map this directly to your current compliance scope and threat profile.