01Side by side
| Compared on | Scripted attackers | Adaptive attackers |
|---|---|---|
| Behaviour | A set plan per character | Changes tactic based on replies |
| Comparability | High: same pressure each run | Lower: needs more runs for a range |
| Realism | Like a determined but predictable customer | Like a real negotiator or fraudster |
| Finds | Known weaknesses, reliably | Weaknesses between known tactics |
| Risk of overfitting | Higher if scripts are visible | Lower |
02When each is the better choice
Scripted attackers
- Comparing two versions of the agent fairly.
- Regression checks on every change.
- Measuring one tactic precisely.
Adaptive attackers
- Before launch, to see how the agent holds against a thinking opponent.
- Agents with high authority (refunds or payments without a person).
- After the agent already passes the scripted set.
03Using both
Use scripted characters as the steady baseline, add adaptive attackers to probe beyond them, and keep the exact scripts private so the agent is improved, not tuned to the test.
04What Duelpoint does
Duelpoint’s library has scripted characters for every area and adaptive attackers (a haggler, a refund seeker, a fraudster and a supplier) that switch tactic when one fails. Adaptive attackers are included in Assessments and available as an add-on to an Agent Check. See the tests.
Questions
Are the attack scripts public?
The kinds of tactic are described publicly; the exact wording is kept private, so an agent cannot be tuned to pass the test without actually becoming safer.
See where your agent leaks money. Tested against your own rules, with the money at stake.