Skip to main content

AI's Emerging Threat: Stolen API Tokens

Generative AI is transforming the way we work at unprecedented rates, creating efficiencies and unlocking new capabilities. However, as organizations race to integrate this technology, an emerging threat is rising: the theft and fraudulent use of AI authentication tokens. In this new digital economy, AI API keys have become the new gold, and fraudsters are rushing to exploit them.

The Anatomy of an API token Heist

The methods attackers use are growing in sophistication, often targeting the foundational building blocks of AI applications. A recent incident highlights the danger of supply chain vulnerabilities. A malicious group successfully exploited LiteLLM, an open-source AI proxy tool with over 95 million monthly downloads1. By design, this tool routes and manages API connections, but the compromised version was engineered to see and store every API key that passed through it. This gave the attackers access to a treasure trove of credentials for major AI providers.

For threat groups that have historically focused on crypto mining, the economics of this new fraud are attractive. A single stolen API key—especially enterprise ones that do not have a spending cap—can generally be worth more than a rack of compromised servers by the threat actors. For the fraudster, the theft costs virtually nothing, but for the victim, the fraudulent usage can cost thousands of dollars per hour.

The Impact

The financial and operational consequences of a stolen AI key can be large, impacting both enterprises and individual developers. The threat isn't theoretical; there are already severe examples.

In one case, a small, three-person development team in Mexico faced potential bankruptcy after their Google Cloud API key was stolen2. Over a mere 48 hours, attackers used the compromised key to rack up over $82,000 in unauthorized charges on Gemini Pro models, a massive jump from their usual $180 monthly bill. 

According to the news, the issue was compounded by a default setting in Google Cloud that can grant old, publicly exposed API keys for services like Maps new, powerful permissions for AI services like Gemini the moment they are enabled.

The scale of the attack doesn't have to be massive to be crippling. A mobile app developer experienced a sudden and shocking spike in their API costs, which leaped from a predictable $0.05 to $0.07 per day to over $120 in a single day3 . While this developer was able to act quickly identify their API key was exposed directly into their mobile app, it's important to recognize that larger organizations may not be as rapid in detecting these types of “low and slow” unauthorized charges or activities.

These incidents underscore a "shared responsibility model" that governs most cloud and AI services. While providers secure their infrastructure, the customer is ultimately responsible for securing their own credentials.

Considerations

The rise of this threat demands a multi-faceted approach. Here are a few considerations: 

RecommendationDescription
Treat Keys Like Crown Jewels

Implement robust key management protocols, including strict access controls, secret scanning within your codebases, and regular credential rotation. Never embed keys directly in client-side code or public repositories.

Establish Financial Guardrails

One of the most critical steps is to set hard spending limits and billing alerts on all API keys. An immediate notification of unusual spending can be the difference between a minor incident and a financial disaster.

Conduct Supply Chain Diligence

The LiteLLM incident is a reminder that you must vet all third-party and open-source packages integrated into your systems. Understand what data they can access and how they are secured.

Prepare for Incident Response

Develop a response plan and tabletop exercises specifically for AI-related security incidents. It can be instrumental in identifying the point of compromise, determining the scope of the breach, and preserving crucial evidence for internal investigations or potential disputes.

Footnotes

1 Baran, Guru. “LiteLLM PyPI Package With 95 Million Downloads Compromised by TeamPCP Hackers.” Cyber Security News, 25 Mar. 2026
2 Lyons, Jessica. “Dev stunned by $82K Gemini API key bill after theft.” The Register, 3 Mar. 2026.
OpenAI Developer Community. “Unauthorized API Key Usage.” May 2023. 

Meet the team

Image of David Nides
David Nides
Principal, Advisory, KPMG US

Thank you!

Thank you for contacting KPMG. We will respond to you as soon as possible.

Contact KPMG

Use this form to submit general inquiries to KPMG. We will respond to you as soon as possible.
All fields with an asterisk (*) are required.

Job seekers

Visit our careers section or search our jobs database.

Submit RFP

Use the RFP submission form to detail the services KPMG can help assist you with.

Office locations

International hotline

You can confidentially report concerns to the KPMG International hotline

Press contacts

Do you need to speak with our Press Office? Here's how to get in touch.

Headline