FinCrimeBench™ — the independent benchmark for AI in fraud & AML
As institutions move to a zero-trust posture, fraud and AML detection becomes the line that has to hold. FinCrimeBench is the expert-built, threat-driven standard for how reliably frontier AI models actually perform that work — measured against the ≥90% accuracy operational deployment requires. Live results below; new threats added through 2026. Take a look at our leaderboards and request the report.
The Benchmark Will Eat Finance
Simon Taylor's Fintech Brainfood featured a dedicated deep dive into the launch of FinCrimeBench, analyzing how rigorous, domain-specific evaluation is shifting the balance of power in financial services AI. See the feature.
Leaderboards
NOTE: Figure 2 in the original Phase 0 whitepaper has been corrected to accurately reflect the results across the four LLMs tested.
By submitting your details, you agree to our Privacy Policy.
↓
What we've found so far
We probed four frontier LLM providers across 110 expert-curated prompts spanning select fraud typologies. Performance on conceptual tasks was generally competent. Performance on tasks closest to operational decision-making was not.
Example: Risk Level Assessment
Of the task categories we probed, none matters more operationally than risk level assessment — the judgment that determines whether a case is escalated, a transaction is held, or a restriction is placed on a customer.
The pattern across providers was wrong in the direction that matters most, with confident-sounding rationale.
BEST FRONTIER MODEL
1 in 3
WRONG risk ratings on a four-tier classification. The other three providers ranged from 46%–53% accuracy — meaning the typical frontier model got nearly half of risk ratings wrong.
↓
How FinCrimeBench is built
Prompts curated by practitioners
110 prompts in Phase 0, written and reviewed by financial crime experts with hands-on experience in fraud and AML. Each prompt is paired with an expert answer key reflecting how a competent senior practitioner would respond.
Anchored to recognized standards
The taxonomy and scoring framework draw on guidance from the OCC, FFIEC, FATF, FinCEN, and NIST, with the methodology referenced in the whitepaper.
Provider-neutral and independent
FinCrimeBench is independent research from CoveLabs.ai. While we are in discussions with LLM providers about financial crime training data, FinCrimeBench operates under separate governance with no provider influence over methodology, evaluation, or published results.
↓
Get Involved
Executive Summary
A two-page overview of Phase 0 findings, methodology, and what's coming in Phase 1. Designed to be read in five minutes and shared with your team.
We'll send the summary to your inbox right away.
Full Technical Whitepaper
The complete Phase 0 report — provider-level results, prompt-category breakdowns, scoring methodology, and the detailed findings behind the headline numbers.
We prioritize access for senior leaders accountable for fraud and AML risk at financial institutions, fintechs, and RegTech providers, and LLM researchers.
Executive Briefing
A 30-minute conversation with senior fraud and AML leaders. We walk through findings relevant to your domain — including provider-level results not published in the whitepaper.
We review briefing requests on a rolling basis. Typically confirm or decline within a week.
↓
About CoveLabs.ai
CoveLabs.ai is leading this independent research effort focused on evaluating and improving how AI systems perform on financial crime tasks. We were founded by industry and AI experts with decades of hands-on experience in fraud and AML, and FinCrimeBench is our first published initiative.
© 2026 CoveLabs.ai LLC · CoveLabs.ai · LinkedIn
FinCrimeBench™ is a proprietary benchmark developed and owned by CoveLabs.ai LLC. The benchmark name, methodology, taxonomy, prompts, expert answer keys, scoring framework, evaluation results, and all associated content, deliverables, and derivative works are the exclusive intellectual property of CoveLabs.ai LLC. The contents of this site and the available whitepaper documents, including all analysis, findings, figures, and text, are protected by copyright. No part of this work may be reproduced, distributed, or used to train, fine-tune, or evaluate machine learning models without the prior written consent of CoveLabs.ai LLC, except for personal, non-commercial reference and for the limited fair-use purposes recognized under applicable law.
Privacy Policy
Effective Date: July 2026
Last updated: July 2026
1. Overview
This Privacy Policy explains how CoveLabs, Inc. and its affiliates, including FinCrimeBench (“CoveLabs,” “FinCrimeBench,” “we,” “us,” or “our”), collect, use, disclose, and protect personal information when you visit or interact with our websites, including fincrimebench.ai, submit forms, request research, register for events, or otherwise communicate with us.
By using our website or submitting information to us, you acknowledge that we may collect, use, and disclose your information as described in this Privacy Policy.
2. Information We Collect
We may collect personal information that you voluntarily provide to us, including when you:
- Request FinCrimeBench research or other materials;
- Submit a contact form or inquiry;
- Register for an event, webinar, demo, briefing, or other activity;
- Subscribe to updates or otherwise request communications from us;
- Communicate with us by email or through other channels.
The types of information we may collect include:
- Name;
- Email address;
- Company or organization;
- Job title or role;
- Industry or professional area of interest;
- Country, region, or location information you choose to provide;
- Any message, inquiry, or other information you submit to us.
We may also automatically collect certain technical and usage information when you visit our website, such as IP address, browser type, device information, pages visited, referring pages, and interactions with our website. We may collect this information through cookies, analytics tools, server logs, or similar technologies.
3. How We Use Your Information
We may use personal information for the following purposes:
- To respond to your inquiries;
- To provide requested research materials, reports, updates, or other content;
- To send follow-up communications related to FinCrimeBench;
- To send new or updated research, benchmark updates, reports, articles, event invitations, webinars, product or service updates, partnership opportunities, and other FinCrimeBench-related communications;
- To understand interest in FinCrimeBench, our research, and our services;
- To operate, maintain, analyze, and improve our website, research, products, services, and communications;
- To manage event registrations, briefings, webinars, demos, or other interactions;
- To maintain business records and manage our relationships with users, customers, prospects, partners, and other contacts;
- To protect the security and integrity of our website, systems, and organization;
- To comply with legal obligations and enforce our rights.
If you request FinCrimeBench research, register for an event, download materials, submit a form, or otherwise provide your contact information to us, we may use your contact information to send you related FinCrimeBench communications. These may include new research, updates to prior research, benchmark updates, event invitations, webinars, product or service updates, and other information that we believe may be relevant to your professional interests.
You may opt out of receiving marketing, research update, or event-related communications at any time by using the unsubscribe instructions included in our emails or by contacting us at admin@covelabs.ai. Even if you opt out of these communications, we may still send you non-marketing communications, such as responses to direct inquiries or administrative messages related to your interactions with us.
FinCrimeBench is designed to provide research, benchmarks, insights, and related information concerning financial crime, compliance, risk management, and related topics. If you provide your contact information to request or access FinCrimeBench materials, we may send you additional FinCrimeBench-related communications from time to time.
These communications may include:
- Updates to previously requested research;
- New FinCrimeBench research or reports;
- Benchmark updates or methodology updates;
- Event, webinar, briefing, or demo invitations;
- Product or service updates;
- Partnership or collaboration opportunities;
- Other CoveLabs or FinCrimeBench information relevant to financial crime, compliance, AI benchmarking, or related professional interests.
We aim to be transparent about why you are receiving these communications. Our emails may explain that you are receiving the message because you previously requested FinCrimeBench research, registered for an event, submitted a form, or otherwise expressed interest in FinCrimeBench.
You may opt out of these communications at any time.
4. Cookies & Tracking
We may use cookies, pixels, analytics tools, and similar technologies to collect information about how visitors use our website. This may include information about pages viewed, links clicked, time spent on the website, referring websites, browser type, device type, and general location information.
We may use this information to:
- Operate and improve our website;
- Understand website traffic and user engagement;
- Measure the effectiveness of our content and communications;
- Troubleshoot technical issues;
- Protect against misuse or unauthorized activity.
You may be able to control cookies through your browser settings. If you disable cookies, some parts of our website may not function properly.
5. How we share this information
We do not sell personal information.
We may share personal information with the following categories of recipients:
Service Providers
We may share information with service providers that perform services on our behalf, such as website hosting, analytics, customer relationship management, email delivery, event management, communications support, cloud storage, security, and other business operations.
These service providers are authorized to use personal information only as necessary to provide services to us or as otherwise permitted by law.
Affiliates and Business Partners
We may share information within CoveLabs and with affiliates or business partners where reasonably necessary to provide research, services, events, communications, or other FinCrimeBench-related activities.
Legal, Compliance, and Protection Purposes
We may disclose information if we believe disclosure is necessary or appropriate to:
- Comply with applicable laws, regulations, legal processes, or governmental requests;
- Protect our rights, privacy, safety, property, users, customers, partners, or the public;
- Detect, prevent, or address fraud, security, technical, or misuse issues;
- Enforce our agreements, policies, or terms.
Business Transactions
If we are involved in a merger, acquisition, financing, reorganization, sale of assets, or similar business transaction, personal information may be disclosed or transferred as part of that transaction, subject to appropriate protections where required by law.
6. Legal Bases for Processing
Where applicable data protection laws require us to identify a legal basis for processing personal information, we rely on one or more of the following legal bases:
- Consent, where you have provided consent for a specified purpose;
- Legitimate interests, including our interests in responding to inquiries, providing requested research, developing and improving FinCrimeBench, communicating with professionals who have expressed interest in FinCrimeBench, sending relevant business-to-business research updates, event invitations, and related communications, and operating our business;
- Performance of a contract or pre-contractual steps, where processing is necessary to provide requested materials, services, information, or interactions;
- Legal obligations, where processing is necessary to comply with applicable laws, regulations, or legal processes.
When we rely on legitimate interests, we consider the nature of the information, the context in which it was collected, your relationship with us, your reasonable expectations, and your rights and interests.
7. Third-Party Form Processor (Tally.so)
Our contact form is powered by Tally.so, a third-party form service. When you submit a contact request, your data (name, work email, company, role, and message) is processed and stored by Tally in accordance with their Privacy Policy (tally.so/privacy). We use Tally solely to receive and manage contact form submissions. Tally does not use your data for advertising or sell it to third parties. We have configured Tally to accept work email addresses only. Personal email domains (Gmail, Yahoo, Hotmail, and similar) are not accepted. You may request deletion of your form submission data by contacting us at admin@covelabs.ai.
8. Email Preferences and Opting Out
You may opt out of receiving marketing, event, research update, or other promotional communications from us at any time by following the unsubscribe instructions included in our emails or by contacting us at admin@covelabs.ai
If you opt out, we may retain limited information, such as your email address, to maintain a suppression list and ensure that we honor your communication preferences.
Please note that opting out of promotional or research update communications does not prevent us from sending non-promotional communications, such as responses to your direct inquiries, transactional messages, legal notices, security notices, or administrative communications.
9. Data Retention
We retain personal information for as long as reasonably necessary to fulfill the purposes described in this Privacy Policy, including to provide requested materials, send FinCrimeBench-related communications unless you opt out, manage our relationship with you, maintain business records, comply with legal obligations, resolve disputes, protect our rights, and enforce our agreements.
The length of time we retain information depends on the type of information, the purpose for which it was collected, legal and business requirements, and whether you have requested that we delete or stop using the information.
10. Data Security
We use reasonable administrative, technical, and organizational measures designed to protect personal information from unauthorized access, disclosure, alteration, or destruction.
However, no method of transmission over the internet or method of electronic storage is completely secure. We cannot guarantee absolute security.
11. International Users
If you access our website or provide information from outside the United States, your information may be transferred to, stored in, or processed in the United States or other jurisdictions where we or our service providers operate.
These jurisdictions may have data protection laws that differ from those in your location. Where required by applicable law, we take steps designed to provide appropriate protections for cross-border transfers of personal information.
12. Your Privacy Rights
Depending on your location and applicable law, you may have certain rights regarding your personal information. These rights may include the right to:
- Request access to personal information we hold about you;
- Request correction of inaccurate or incomplete information;
- Request deletion of personal information;
- Request restriction of or object to certain processing;
- Request portability of certain information;
- Withdraw consent where processing is based on consent;
- Opt out of certain communications.
To exercise privacy rights, please contact us at admin@covelabs.ai. We may need to verify your identity before fulfilling certain requests.
13. Children's Privacy
Our website, research, and services are intended for business and professional audiences. They are not directed to children under the age of 13, and we do not knowingly collect personal information from children under 13.
If we learn that we have collected personal information from a child under 13, we will take appropriate steps to delete that information.
14. Changes to This Policy
We may update this Privacy Policy from time to time. Any changes will be reflected with an updated date at the top of this page. Continued use of the site constitutes acceptance of the updated policy.
15. Contact
For any privacy-related questions or requests, please contact us at: admin@covelabs.ai
↓