Research
Research on AI in payments and finance operations, published free: models tested on payments tasks, and what vendors offer for each process.
Which payments and finance operations jobs AI can do today, what its mistakes cost, and which vendors sell it for each process. The research covers work at merchants, acquirers, PSPs and fintechs under UK and European rules. It's written for the finance, operations and product leaders deciding whether to build or buy, and the risk teams who sign off the supplier.
Payments firms are being offered AI agents for more and more of their operations, and new models and vendors arrive every month. Choosing between them means weighing what each gets right, what it costs at your volumes, how fast it runs, where your data goes, and what DORA and the EU AI Act ask of the supplier.
Each piece of research takes one process and compares the vendors with building it yourself. The vendor review covers what each agent does, where the gaps are, what it costs and which models sit underneath.
The model tests feed both sides. They show what a build could achieve, and how the models inside each vendor's product do on the same task. Frontier models are tested alongside open-weight models you can run on your own servers.
Vendors cover the process well, so the question is which one and what it has to prove.
The gaps are too big, and the tests show which models can do the work and at what cost.
A vendor covers most of it, and the rest is built around it.
The first paper tested 34 AI models on reading UK card acquiring statements, scoring every fee they got wrong in pounds against what each model costs to run. With good instructions, a model at half a cent a statement matched one at 25 cents.
Read the paper online →Leaderboard: all 34 models →
Seven finalists, round 2. Each arrow runs from the plain prompt to the expert prompt. The fees-wrong scale is stretched to the right of the 0.1% line. All runs used zero data retention (ZDR). Direct means the developer's own service qualified.
White paper · PDFAI economics in fintech: reading card statementsDownload the PDF →
A model gets a month of an invented merchant's settlement files, bank lines, ledger and contract in one go, and has to find and value every difference. It's scored on money missed and false alarms, weighed against the model's price per run.
A model reconciles a month of an invented merchant's card income on its own, across settlement files, the bank, the ledger and the inbox. It's scored on money missed, false alarms, unsafe actions and whether it gets everything right three runs out of three.
The first vendor landscape: which vendors sell AI agents for card reconciliation, what their agents actually do, and where the gaps are. Each vendor checks how its product is described before it's published.
An agent test on the same invented merchant: deciding which chargebacks to fight and gathering the evidence.
I can run the same research on one of your own processes, or advise on whether to build, buy or combine the two, which model to use, and the record DORA and the EU AI Act ask for on how each model was chosen and tested.
For custom research or advisory work, drop me an email and we can talk it through. Every piece of work is agreed in a fixed-price statement of work.
martin@scalepointpartners.com