Why technical training does not fix every pentest team problem

Technical training matters, but many penetration testing team problems come from weak judgement, unclear communication, poor scoping and inconsistent leadership.

By Simon Chapman

Talk to us All articles
Penetration testing team discussing technical findings, client communication and delivery quality
Consultant development

Technical training matters.

A penetration tester needs to understand systems, vulnerabilities, exploitation, evidence and controls. Without technical depth, the work is weak.

But technical training does not fix every pentest team problem.

Many of the issues that slow teams down are not caused by a lack of tooling knowledge or another missing certification. They come from unclear communication, poor judgement, inconsistent QA, weak scoping and a lack of confidence in client-facing situations.

Those problems need a different kind of development.

Some delivery problems are not technical

When a report is late, the cause is not always technical difficulty.

The tester may have found the issues but struggled to write them clearly. The scope may have been ambiguous. The client may have challenged severity. The evidence may have been incomplete. QA may have needed several review cycles. A senior tester may have had to rewrite large parts of the report.

None of that is fixed by sending the tester on another exploit development course.

The problem may sit in how the tester thinks, communicates and makes decisions under pressure.

This matters because many offensive security teams default to technical training as the main development answer. That is understandable. It is easier to define. It is easier to buy. It gives the tester something recognisable to complete.

But it does not always address the real constraint in the team.

This is why technical pentesters need consulting skills. The issue is not whether technical ability matters. It is whether the tester can turn that ability into clear, evidenced and useful work for the client.

More technical skill does not automatically create better judgement

A tester can be technically strong and still struggle with judgement.

They may find real issues but overstate the risk. They may understand the exploit path but fail to explain the business consequence. They may identify a control weakness but not know whether it matters in the client’s environment. They may be unable to separate what was proven from what was assumed.

Good judgement is built through structured experience, review and challenge.

It needs feedback on decisions, not just answers. Why was this severity appropriate? What evidence supports the conclusion? What would change the rating? What should be caveated? What should be left out?

That kind of development is often informal.

A senior tester leaves a comment in a report. A team lead gives quick feedback after a client call. A manager corrects the issue during QA. The junior tester learns something, but the learning is fragmented.

The result is inconsistent progress.

Some testers develop quickly because they are close to good mentors. Others keep making the same mistakes because nobody has created a clear standard.

Poor communication creates technical-looking problems

Weak communication often presents itself as a technical issue.

A client challenges a finding, so the team assumes the evidence was not strong enough. A report creates confusion, so the recommendation is rewritten. A debrief goes badly, so a senior tester joins the next call. A scope dispute occurs, so delivery adds more checks.

Sometimes the technical content is the issue. Often, the issue is how it was explained.

A finding needs to show what happened, why it matters and what the client should do next. That requires structure. It also requires the tester to understand who the report is for.

The technical team may want exploit detail. The risk owner may want business relevance. The remediation team may want clear steps. The security manager may want defensible prioritisation.

A good consultant knows how to serve those needs without weakening the technical accuracy.

That is not just writing style. It is part of professional delivery.

Client pressure needs more than technical confidence

Pentesters face client pressure regularly.

A client may ask for a severity to be changed. They may dispute exploitability. They may argue that compensating controls reduce the risk. They may say the issue is accepted internally. They may ask whether the finding really needs to appear in the report.

A tester who only has technical confidence may still struggle here.

They may become defensive. They may concede too quickly. They may repeat the technical detail without addressing the client’s concern. They may escalate every difficult conversation to a senior person.

The better response is structured.

The tester needs to explain the evidence, the assumptions, the likely impact and the conditions that would change the judgement. They need to listen to client context without letting the finding become a negotiation.

That is a consulting skill.

It protects quality because the finding remains defensible. It protects the relationship because the conversation stays calm. It protects margin because senior people are not pulled into every challenge.

This is especially true when handling severity disputes. The tester needs to separate evidence, context, exploitability and professional judgement rather than treating the discussion as a fight over a rating.

Technical training does not fix poor scoping

Scoping problems often become delivery problems.

If the objectives are unclear, the tester may not know what the client actually needs from the engagement. If assumptions are missing, delivery may inherit work that was never priced. If prerequisites are weak, testing may start late. If user roles are incomplete, coverage may be compromised.

These problems are sometimes blamed on delivery.

In reality, they often start earlier.

Technical training will not fix poor qualification, weak handover or unclear expectations. The team needs better commercial and operational habits around scoping.

That includes asking better questions, documenting assumptions clearly, identifying risky dependencies and knowing when the requested work does not match the client’s real need.

This does not mean every tester needs to become a salesperson.

It means the delivery team needs enough consulting awareness to recognise when a scope is likely to fail.

QA defects are often development signals

QA is a useful place to look for the real training need.

If a tester repeatedly misses technical issues, technical development may be needed. But if the recurring defects are unclear evidence, weak recommendations, poor severity justification or vague risk language, the training need is different.

The same applies at team level.

If reports regularly need heavy rewriting, the issue may be report structure. If severity debates keep happening, the issue may be rating guidance. If clients keep asking for clarification, the issue may be how findings are framed. If senior testers keep being pulled in late, the issue may be review timing or team confidence.

This is where good QA in a penetration testing team becomes more than a final report check. QA should expose patterns that tell leaders where testers need coaching, clearer standards or better support.

QA should not only be a gate.

It should be a feedback source for team development.

The aim is to understand patterns. One weak report may just be a bad day. Repeated weak report sections are a system issue.

AI makes judgement more important

AI tooling will change parts of the testing workflow.

It can help with research, drafting, summarising notes, generating test ideas and reviewing language. Used carefully, it can save time. Used carelessly, it can create confident output that has not been properly understood.

That increases the need for judgement.

A tester still needs to know whether the output is accurate. They need to validate evidence. They need to spot weak assumptions. They need to understand whether a suggested issue is relevant to the client’s environment. They need to know when a finding is real, when it is overstated and when it should not be included.

This is already changing how teams need to think about junior development. AI changes the junior pentester role because it may make some mechanical tasks faster while increasing the need for validation, explanation and professional scepticism.

AI can support a tester. It cannot carry the professional responsibility for the conclusion.

That means technical training alone becomes even less sufficient.

Teams need people who can reason clearly, challenge output and explain decisions. The human part of the work becomes more important, not less.

What offensive security leaders should develop

Technical development should remain part of the plan.

But it should sit inside a broader model of consultant development.

Useful areas to develop include:

  • explaining technical risk clearly
  • separating evidence from assumption
  • writing defensible findings
  • handling severity challenge
  • asking better scoping questions
  • understanding client context
  • making proportionate recommendations
  • knowing when to escalate
  • communicating uncertainty
  • reviewing AI-assisted output critically

These are not abstract soft skills. They are delivery skills.

They affect report quality, client trust, senior workload and project margin.

What this means for pentest team performance

Technical training is necessary, but it is not enough.

A penetration testing team can have capable technical people and still struggle with inconsistent reports, poor client conversations, weak scoping, delivery friction and senior bottlenecks.

Leaders need to be clear about the problem they are trying to solve.

If the issue is technical depth, invest in technical training. If the issue is judgement, communication, QA quality or client handling, the development plan needs to address those things directly.

Otherwise, the business keeps buying technical training while the same operational problems continue.

For many pentest teams, the next constraint on performance is not whether testers can find vulnerabilities.

It is whether they can explain, evidence and defend the work well enough for the business to scale.

If this article describes a real delivery pressure, turn it into a next step.

Conversec helps offensive security teams improve consulting maturity, leadership capacity, and delivery clarity.