1. Home
  2. AI
  3. Cost Effective & Sustainable AI
    Why today "Good Enough" is often a smarter choice.

Cost Effective & Sustainable AI
Why today "Good Enough" is often a smarter choice.

Fujitsu / October 23, 2025

For much of the last decade, the narrative around artificial intelligence has been driven by the pursuit of scale. Each new generation of frontier large language models (LLMs) boasts more parameters, deeper reasoning abilities, and ever expanding benchmarks. The implicit assumption is that bigger is better, that organizations will always gain advantages by adopting the most advanced, state-of-the-art systems. Yet, as the true costs of training and operating these models become more visible, an alternative strategy is emerging: the deliberate use of smaller, more efficient “good enough” language models that balance capability, cost, and sustainability.

For managers and executives, the question is no longer simply “What can AI do?” but rather “what level of AI is worth deploying for which business case?” As AI adoption accelerates across industries, choosing between frontier models and leaner alternatives may become one of the most consequential cost and sustainability decisions leaders face.

The Cost Curve of Frontier AI

The economics of training and operating frontier AI models reflect a stark reality. Building the largest models demands access to tens of thousands of high-end GPUs or TPUs, operating continuously for weeks or even months. Current estimates suggest that training a single state-of-the-art model can cost hundreds of millions of dollars. Moreover, the demands continue beyond training. Running inference, or generating responses, requires substantial computational resources for each interaction, thereby inflating operational costs.
Enterprises face these expenses indirectly through pricing structures. Frontier models are often available only via APIs that charge usage-based fees reflecting their massive infrastructure needs. Managing millions of customer queries through such systems can rapidly result in millions of dollars in recurrent costs. For the majority of companies, particularly those outside the technology sector, this cost curve is daunting.
The environmental costs mirror the financial burden. The energy required to train frontier AI models has been likened to the lifetime consumption of a small city, and the carbon footprint of these models increasingly attracts regulatory attention, especially in regions like the European Union, where sustainability reporting requirements are becoming stricter.
For executives tasked with balancing budgets and corporate social responsibility, the allure of frontier AI must be carefully weighed against these significant trade-offs.

Loading component...

AI Computing Brokers

Today, AI Computing Brokers such as the Fujitsu AI Computing Broker are becoming increasingly important in the effective use of “Good Enough” AI models. These brokers help organizations optimize the use of costly, power-intensive resources such as GPUs. By orchestrating workloads across various models, they enable enterprises to automate the deployment of smaller language models for routine tasks, while reserving advanced systems for complex reasoning. This approach facilitates a more cost-effective and sustainable use of AI models without compromising functionality or capability. https://en-documents.research.global.fujitsu.com/ai-computing-broker/

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...

Loading component...