Five Key Questions for Banks and Financial Institutions to Uncover the Best AI Amid Growing Skepticism

How financial leaders can navigate the rush to adopt AI and find the ideal solution for their business.

By Binny Gill, CEO of Kognitos

Enterprises across every industry are eagerly jumping on the AI bandwagon, driven by the promise of unparalleled efficiency, innovation, and a supposed competitive edge. However, the journey from ambition to real-world implementation is fraught with significant challenges, especially for the banking and finance sectors.

While businesses initially embraced AI with enthusiasm, there is now growing skepticism about the tangible ROI that AI can deliver. Major media outlets are questioning why seven leading tech giants are doubting the technology’s long-term investment viability; while others are asking, “Has the AI bubble burst?” Some hedge funds have even warned investors to be skeptical of companies like Nvidia, while others suggest Big Tech is struggling to convince Wall Street that AI investments will bring real returns altogether.

Recent insights from Gartner underscore these challenges, predicting that 30 percent of generative AI projects will be abandoned after the proof-of-concept stage by 2025. Major financial institutions like Goldman Sachs echoed this cautionary stance, recently releasing a report downplaying the so-called “AI gold rush,” describing the promised ROI from Silicon Valley as little more than snake oil—a sentiment shared by Barclays and Sequoia Capital.

So, what’s the verdict? Is AI just another overhyped trend destined to fade away? Not quite. There’s more to the story than the doubters suggest.

At the enterprise level, scaling AI solutions, ensuring security and ethical compliance, and managing increasing costs—particularly those associated with training large language models (LLMs)—present challenges. But the release of OpenAI’s GPT-4o mini has reignited discussions on the long-term viability of AI adoption, spotlighting a shift towards smaller, specialized LLMs.

Are these specialized AIs more valuable than general-purpose ones? As companies navigate AI’s vast potential, many remain unsure of the most effective use cases, often realizing they don’t know what they don’t know.

For financial leaders, the potential benefits of generative AI extend beyond the hype. Financial processes that are integral across organizations—like Procure to Pay (P2P), Order to Cash (O2C), and Record to Report (R2R)—can gain significantly from these advanced capabilities. While some may be skeptical of yet another automation promise, it is essential to take a holistic view.

Embracing AI’s potential streamlines workflows, fosters innovation, and helps maintain a competitive edge in a rapidly evolving market. For financial leaders, this all begs one major question: How can we make it work for our business?

How Financial Institutions Should Evaluate AI Providers

Effective evaluation of smaller AI solutions requires asking the right questions. By zeroing in on these crucial inquiries, organizations can meticulously assess AI models and vendors and thoroughly address concerns about the safety and efficacy of AI technologies. This approach ensures that the solutions they choose are not only trustworthy but also perfectly tailored to their specific needs and risk profiles.

Here are the right questions to ask:

Can the vendor clearly explain automated processes in plain language?

Ensure the AI vendor provides straightforward descriptions of all automated processes. This transparency helps stakeholders understand the AI system, verify compliance with standards, and build trust in the vendor’s accountability.

Can the vendor customize LLMs and cloud environments for your needs?

Confirm the vendor’s ability to tailor LLMs and cloud setups to your specific requirements. Customization enhances performance, security, and compliance, aligning the AI solution with your strategic goals.

Do AI processes include human oversight and verification?

Check if the AI system allows for human control and review. This is essential for ensuring accuracy, reliability, and ethical use, helping to prevent errors and biases while maintaining system integrity.

Does the vendor offer both factual and intuitive AI capabilities?

Ensure the vendor supports both deterministic (fact-based) and generative (intuitive) AI processes. This combination leverages accuracy and creativity, enhancing decision-making and operational efficiency.

Does the vendor use your data to train models outside your organization?

Confirm if the vendor uses your data for training models beyond your control. Protecting your data ensures privacy, safeguards intellectual property, and maintains compliance with data protection regulations.

The Next Frontier for Financial Workflow Transformation

Traditional automation has hit a wall when it comes to the complexity of financial workflows. But, without all the hyperbole, AI is a real game-changer. It can handle tasks previously deemed impossible, turbocharging productivity and slashing costs across financial operations. Unlike rigid, high-maintenance predecessors, AI adapts, learns, and evolves.

Unlike earlier automation tools, AI’s adaptability and learning capabilities allow it to handle intricate, cross-functional processes. This flexibility, coupled with generative AI’s broad applications, positions AI as a transformative technology for the financial industry. Business leaders just need to know how to implement it.

Imagine workflows that seamlessly connect your entire organization, unlocking hidden value. Yes, there are challenges—transparency, accuracy, and privacy always are—but with careful scrutiny, these can be managed. By addressing these challenges and asking the right questions, financial institutions can unlock new opportunities to streamline operations, drive innovation, and maintain a competitive edge.