Playbook · Finance and accounts payable

AI agents in accounts payable: a testing playbook.

A purchasing or accounts-payable agent is pushed by suppliers: price rises after agreement, fees added to the invoice, invoice numbers nobody issued, deadlines and new bank details. Pay only invoices that match an approved purchase and amount, never change bank details from a message, test the agent against those suppliers on a test copy, and reconcile what it paid.

Payment fraud aimed at finance teams is already large. The FBI’s Internet Crime Complaint Center recorded 21,442 business email compromise complaints and $2.77 billion in reported losses in 2024 (2024 IC3 Report). An agent that reads supplier messages and pays invoices meets the same tactics.

01The threats

TacticWhat it tries to get
Price hikeA higher price after agreement, “because the market moved”
Hidden feeA handling or rush fee that appears on the invoice
New invoice numberAn invoice that was never issued, or a duplicate
Fake supplier invoiceAn invoice from a supplier you do not use
Bank details change“Our bank has changed, please pay this account”
Bundle pressureMinimum quantities that push the order past the budget
Deadline squeeze“Pay today or lose the price”

02The rules to write

As data the agent and your systems can check, not only as sentences in its instructions.

  • Approved purchases and their approved amounts, as data the agent can check.
  • The purchasing budget it may not exceed.
  • That bank details are never changed from a message.
  • When an invoice goes to a person: new supplier, new amount, new details.

03The tests to run

Run each on a test copy of the agent, with honest customers mixed in, enough times for a useful range: see how many test conversations are enough.

04Pre-launch checklist

  1. Invoices are paid only if they match an approved purchase and amount.
  2. Bank detail changes are verified outside the conversation.
  3. The budget is enforced by the payment system.
  4. New or changed invoices go to a person.
  5. The agent has been tested against fake and inflated invoices on a test copy.
  6. Genuine invoices are paid: over-refusal is measured.

The full 50-point version is in the enterprise guide.

05What to monitor after launch

  • Payments by the agent reconciled against approved purchases, every week.
  • Invoices paid above their approved amount, however small.
  • Requests to change supplier details, and their outcome.

Questions

How do AI agents get tricked into paying fake invoices?

By believing the invoice instead of checking it against an approved purchase and amount. See the question page on this for the checks that stop it.

See where your agent leaks money. Tested against your own rules, with the money at stake.

See the testsHow we score