There's a conversation that happens in every compliance team, usually sometime between month three and month nine of a new platform implementation.
Someone pulls up the demo recording. The one where the sales engineer walked through a clean, frictionless onboarding flow — the UBO structure resolved in seconds, the risk score populated automatically, the case closed without a single manual touchpoint. Then they look at their screen. At the queue of 40 open cases. At the spreadsheet they still use to track what the platform can't.
This isn't a technology failure story. It's a procurement gap story. And it happens, with startling regularity, across compliance teams at banks and fintechs of every size.
I've sat on the buying side of this. Multiple times. Across institutions at different scales and regulatory contexts. This piece isn't a prosecution of vendors. It's an honest account of the structural gap between what gets sold and what gets deployed — and what compliance teams can do about it.
The numbers say this is systemic, not exceptional
Before we get into the mechanics, it's worth establishing that this isn't a complaint about a single vendor, or an unlucky procurement cycle. The data suggests it's the default condition.
Seventy percent of finance sector software buyers say they regret at least one of their software purchases within the past 18 months — a full ten percentage points higher than the cross-industry average. Over half of them feel those decisions have had a significant long-term impact on their business. (Source: Gartner Digital Markets / Capterra, 2024 Finance Tech Trends Survey)
The reasons cited are instructive. Financial businesses that experience regret point to the technology being too basic for their needs (35%), failure to deliver ROI (32%), and the software costing more than expected (32%). In other words: the product didn't do what it implied it would, it didn't justify its cost, and the real price was higher than the sticker price. That's the overpromise pattern in three data points. (Source: Capterra, 2025 Tech Trends Report — Financial Services)
It gets worse at the implementation stage. According to Capterra's 2026 Software Buying Trends Report, only 34% of buyers successfully achieve both a smooth buying and implementation process. The remaining 66% experience unexpected disruption, regret, or both — and nearly nine in ten of those who regret a purchase first encountered an unexpected implementation disruption. (Source: Capterra, 2026 Software Buying Trends Report)
The disruptions follow a recognisable pattern: integration problems, data migration issues, delays, and configuration difficulties. Anyone who has tried to map a vendor's rigid data model to a complex corporate ownership structure will recognise all four.
The compliance-specific version of this problem
The generic software-buying problem gets amplified in compliance for a specific reason: the demo environment is almost never the live environment.
In a sales demo, the vendor controls the data. Clean company structures. Complete registry data. Tidy UBO chains. Standard document formats. The product looks elegant because it's been fed inputs that were designed to make it look elegant.
Live compliance environments look nothing like this. Research from Fenergo found that more than two-thirds of global banks have lost clients due to slow and inefficient KYC onboarding — a 19% year-on-year increase — with the majority of banks (86%) attributing the problem to poor data management and siloed processes. (Source: Fenergo, KYC in 2024 — Banking Report, October 2024)
The same research found that 70% of firms globally lost clients in the past year due to inefficient onboarding, up from 67% in 2024 and 48% in 2023. Average annual spend on AML and KYC operations now stands at $72.9 million per firm, with UK institutions reporting the highest average at $78.4 million. (Source: Fenergo, 2025 Financial Crime Industry Trends Report)
This is the central paradox: institutions are spending more on compliance technology than ever before, and the operational outcomes are getting worse, not better.
AI adoption in KYC and AML has leapt from 42% in 2024 to 82% in 2025. Yet automation of periodic KYC reviews averages only around a third of total workloads. (Source: Fenergo, 2025 Financial Crime Industry Trends Report) Adoption of AI tools and automation of actual work are two completely different things. The gap between them is where vendor promises go to die.
What the overpromise actually looks like in practice
Having worked across institutions at different stages of compliance maturity, the vendor overpromise tends to cluster around five specific areas:
1. Coverage gaps that only appear post-contract
Vendors claim global coverage. What they mean is coverage for the jurisdictions where the data quality is good. For anything off the beaten path — a Maltese holding company, a UAE LLC with nominee directors, a trust structure in the BVI — the automated flow breaks, the case drops to manual review, and the STP rate the vendor cited in the RFP becomes theoretical.
2. Configurable risk scoring that isn't really configurable
Most platforms sell on the premise of a flexible, rules-based risk model. In practice, the configurability stops at a relatively shallow layer. Changing weightings is possible. Changing the underlying logic — adding a new factor category, adjusting how jurisdiction risk interacts with entity type — requires either a professional services engagement or a wait for the product roadmap to catch up.
3. Integration that assumes a clean stack
Vendor demos assume clean, well-structured API connections to a modern tech stack. Real institutions have legacy systems, bespoke CRMs, third-party document management platforms, and data that lives in formats the vendor's ingestion layer doesn't support. In 2024, 60% of firms cited overwhelmed staff as the top barrier to realising the full benefits from their compliance platforms. (Source: Mordor Intelligence, Enterprise GRC Market Report, 2024) Often the integration cost alone exceeds what was budgeted for the platform itself.
4. Hidden total cost of ownership
Among financial services buyers who experienced regret, over a third said the total investment was more expensive than they had been led to believe. (Source: Gartner Digital Markets, 2024 Finance Tech Trends) The subscription fee is the visible number. The hidden numbers are: implementation services, data migration, configuration work, staff training, and — most expensively — the ongoing manual effort required to work around what the platform can't do.
5. The demo environment versus the production environment
This is the one that compliance practitioners learn to ask about directly. The demo is a controlled environment. Production is not. Ask the vendor to show you their platform running against data from your actual jurisdiction mix. Ask for reference customers in your segment — not their flagship enterprise customer, but a firm at your scale and complexity. The answers are often revealing.
Why vendors aren't entirely at fault
This is the part that often gets missed in post-implementation frustration.
Most RegTech vendors are genuinely trying to solve hard problems. The gap between demo and reality isn't always deliberate misrepresentation. It's often the product of:
- Sales cycles that outpace product development. A feature roadmap gets described as current capability.
- Platform generalisation. Building for the broadest possible customer base means depth in common use cases and shallowness in edge cases — and compliance is almost entirely edge cases.
- Buyer-side optimism. Compliance teams under resource pressure want the platform to solve the problem. They interpret ambiguous product capability charitably during procurement. 41% of finance buyers say identifying the right software during the planning phase is a challenge, and a similar number voice concerns about choosing software that meets their security requirements. (Source: Capterra, 2024 Finance Tech Trends) The due diligence gap is partly on the buying side too.
Understanding this dynamic matters, because it shifts the frame from "bad vendors" to "structural misalignment" — and structural misalignment is solvable.
What compliance teams actually want
I've had this conversation many times — in procurement processes, in post-implementation reviews, and most recently as a recurring theme at practitioner discussions in the compliance community. The ask, distilled, is consistently the same:
Transparency over polish. Show us what the product can't do. Show us the failure modes. Show us what happens when the data is incomplete. Compliance buyers have strong enough internal expertise to know that no product is perfect; they're looking for honest partners, not a perfect demo.
Practitioner access before contract. Not just a sales engineer who knows the platform. Someone who has sat in a compliance team and operated this kind of workflow. Someone who can map your specific use case to what the product actually delivers.
Real reference customers. At your scale, your regulatory context, your geography. Not "we work with major global banks" — that's not a reference, it's a market claim.
A clear implementation path. Not "we'll scope it during onboarding." A documented view of what the implementation involves, how long it takes, who does the work, and what the known challenges are.
Modular pricing that reflects how compliance actually works. The per-check model sounds simple until you're running 20 checks per corporate entity across a high-volume pipeline. Compliance teams want to be able to model the real cost before they're contractually committed.
The test before you sign
If you're currently evaluating compliance vendors, here are five questions that tend to separate the genuinely capable platforms from the polished demos:
-
"Can you show me a live run against a complex UBO structure with a multi-jurisdictional holding chain?" Not a pre-built demo. A live run.
-
"What is your STP rate for our jurisdiction mix — and how do you define STP?" Vendors use different definitions. Some count a case as STP if it auto-progresses to the next step, even if that step is manual review.
-
"What is the typical time from contract to live?" And then ask the reference customers the same question.
-
"What does configuration actually require — your team, our team, or professional services fees?"
-
"Where have you had implementation failures, and what caused them?" The answer to this question tells you more than any RFP response.
Where this leaves us
The compliance technology market is growing fast. Financial institutions spent over $30 billion on RegTech in 2020, and 2025 forecasts exceed $130 billion. (Source: Juniper Research, cited in ScienceDirect — RegTech: Technology-driven compliance, 2024) Investment at that scale attracts vendors whose primary capability is fundraising and sales, not deep operational compliance delivery. Not always — but often enough that the procurement filter matters enormously.
The compliance teams that navigate this best are the ones that treat vendor selection with the same rigour they'd apply to a risk assessment. Not because vendors are adversaries, but because the cost of the wrong platform — in wasted implementation time, in missed STP targets, in regulatory exposure from gaps the tool didn't cover — is substantial and slow to unwind.
Lived experience of these workflows is worth something in that process. Not as cynicism, but as calibration. The question "does this actually work in the field" is different from the question "does this work in a demo." Asking the right one, early, is the difference.
First Mile Labs builds KYB and KYC compliance infrastructure for banks and fintechs. If you're evaluating compliance technology and want a practitioner perspective before you sign, talk to us.
See automated KYB in practice
Book a demo and walk through a live KYB case from application to decision.
Request a demo →