A new study from Billtrust, a leader in B2B accounts receivable software, reveals a significant trust gap as finance leaders adopt artificial intelligence. The research, based on a survey of 500 finance professionals and C-suite decision-makers, found that 82% are concerned about AI's potential for misuse, particularly in sophisticated fraud and financial crime. This apprehension exists alongside a strong intent to adopt AI, with 83% planning to implement AI-enabled solutions within the next two years.
Quick Intel
82% of finance leaders are concerned about AI misuse, especially for fraud.
45% have encountered AI-generated phishing emails.
29% have seen AI voice cloning used to impersonate known contacts.
76% believe they would catch a fraudulent invoice, yet many flag 6+ suspicious invoices monthly.
27% of organizations do not track suspicious activity or are unsure of their numbers.
A framework for responsible AI emphasizes human oversight and transparency.
The report highlights the growing threat of sophisticated, AI-powered fraud tactics that are eroding trust. Nearly half of the respondents have encountered AI-generated phishing emails, and 29% have witnessed AI voice cloning used to impersonate colleagues or business contacts. Other threats include deepfake video calls and convincingly branded fake invoices, creating a new and complex challenge for financial security teams.
Despite these advanced threats, the study uncovered a potential overconfidence in traditional detection methods. While 76% of finance leaders believe they would catch a fraudulent invoice before payment, many also report flagging six or more suspicious invoices every month. Furthermore, a significant transparency gap exists, with 27% of organizations failing to track suspicious activity or being unsure of their metrics, indicating a lack of clear visibility into the true scale of the problem.
To bridge the trust gap, the study outlines a essential framework for responsible AI deployment in finance. This framework is built on five pillars: human-in-the-loop architecture for critical oversight, transparency and explainability in AI decisions, continuous governance and performance review, secure and ethical deployment aligned with company values, and a digital infrastructure capable of supporting scalable, trustworthy AI systems.
The Billtrust study underscores a critical moment for the financial industry. While the drive to adopt AI for efficiency is strong, success hinges on building systems that prioritize security, transparency, and human oversight. For AI to become a trusted tool in finance, it must be implemented responsibly to augment human expertise without compromising control or ethical standards.
About Billtrust
Finance leaders choose Billtrust to get paid faster, control costs, and maximize customer satisfaction. As a B2B accounts receivable workflow and payment software market leader, we provide the world's leading brands with AI-powered solutions to delight their buyers across the full AR lifecycle—from invoice presentment to payment application. With more than $1 trillion invoice dollars processed, Billtrust delivers business value through deep industry expertise and a culture relentlessly focused on meaningful customer outcomes.
TechIntelPro empowers B2B technology decision-makers with the latest industry trends, deep insights, leadership perspectives and actionable intelligence to drive both organizational and professional milestones—and thrive on the tech pulse.