While AI inference startups like Modal Labs are capturing billion-dollar valuations at breakneck speed, a closer look reveals an industry at a crossroads. Modal Labs, a startup specializing in AI inference infrastructure, is reportedly in talks to raise a new round at a valuation of about $2.5 billion, more than doubling its $1.1 billion valuation from less than five months ago. This comes as the company’s annualized revenue run rate sits at approximately $50 million, with General Catalyst potentially leading the round. But this isn’t just another funding story – it’s a microcosm of an industry racing toward maturity while grappling with fundamental questions about sustainability, human impact, and market stability.
The Inference Gold Rush
Modal’s potential funding round is part of a broader trend where inference-focused companies are attracting intense investor attention. Last week, competitor Baseten announced a $300 million raise at a $5 billion valuation, more than doubling its previous valuation from September. Similarly, Fireworks AI secured $250 million at a $4 billion valuation in October. These companies are all focused on optimizing inference – the process of running trained AI models to generate answers from user requests – which reduces compute costs and lag time between prompts and responses.
Modal was co-founded by CEO Erik Bernhardsson in 2021 after he spent more than 15 years building data teams at companies including Spotify and Better.com. The startup counts Lux Capital and Redpoint Ventures among its earlier backers. But as these companies scale rapidly, questions emerge about whether the market can sustain such valuations and what happens when the hype meets reality.
The European Counterbalance
Across the Atlantic, French AI startup Mistral provides a contrasting perspective on sustainable growth. The company has seen its annualized revenue run rate soar from $20 million to over $400 million in the past year, with projections to surpass $1 billion in annual recurring revenue by year-end. Mistral, valued at nearly �12 billion, is investing �1.2 billion to build AI data centers in Sweden, its first facility outside France.
“Europe has realized that its dependency on US digital services was excessive and at breaking point today,” said Mistral co-founder and chief executive Arthur Mensch. “We bring them leverage because we bring them models, software and compute that is fully independent from US players.” About 60% of Mistral’s revenues come from Europe, with the rest from the US and Asia, serving customers including ASML, TotalEnergies, HSBC, and several European governments.
The Human Cost of AI Acceleration
As companies race to implement AI tools, research reveals troubling human consequences. A Harvard Business Review study conducted over eight months at a 200-person tech company found that employees who embraced AI tools ended up working longer hours as expectations rose, with to-do lists expanding to fill time saved. More than 40 in-depth interviews with employees revealed a pattern of increased burnout rather than productivity gains.
“You had thought that maybe, oh, because you could be more productive with AI, then you save some time, you can work less,” said an unnamed engineer at the studied company. “But then really, you don’t work less. You just work the same amount or even more.” Additional research from the National Bureau of Economic Research found AI adoption led to just 3% time savings with no impact on earnings or hours worked.
Financial Markets Sound Alarm
Investors are turning away from listed private credit funds that lend to software companies due to concerns that AI will disrupt their business models and reduce profits. The launch of Anthropic’s new AI model, which automates professional tasks, has intensified worries about software companies’ ability to service debt, leading to a sell-off in the sector.
“The software sector is facing an existential crisis right now,” said Christian Hoffmann, head of fixed income at Thornburg Investment Management. “The recent product rollouts have really accelerated those fears. Both private credit and software are facing significant pullbacks.” Shares of Blue Owl Technology Finance Corp fell about 11% from the beginning of the year, while the spread on its five-year bonds rose from 2.55 to 2.8 percentage points since issuance in January.
Leadership Turmoil at Major Players
The industry’s rapid growth is also revealing cracks in leadership stability. xAI, Elon Musk’s AI venture, has seen five of its 12-person founding team depart, including recent co-founder Tony Wu who resigned late Monday night. “It’s time for my next chapter,” Wu said. “It is an era with full possibilities: a small team armed with AIs can move mountains and redefine what’s possible.”
These departures come as xAI faces multiple challenges, including a merger with SpaceX that critics view as financial engineering to combine xAI’s nearly $1 billion in annual losses with SpaceX’s roughly $8 billion in annual profits. The company also faces investigation over its Grok chatbot generating sexualized images of minors, leading to a California attorney general investigation and a police raid of its Paris offices.
The Path Forward
As the AI inference market matures, companies face critical decisions about sustainable growth. The contrast between Modal’s rapid valuation increase and Mistral’s revenue-driven expansion highlights different approaches to scaling. Meanwhile, the human and financial costs of AI acceleration cannot be ignored.
“There is a little bit of ‘sell first, ask questions later’ approach going on,” said David Brown, global co-head of investment grade at Neuberger Berman, referring to market reactions to AI disruption. “Until that’s figured out, the market is going to punish everybody.” With nearly half of all money lent by business development companies to the software sector maturing after 2030, the industry has limited time to prove its long-term viability.
The question isn’t whether AI inference will transform industries – it already is. The real question is whether the companies driving this transformation can build sustainable businesses that benefit both their bottom lines and the people who use their technology. As valuations soar and human costs mount, the industry’s next chapter may be defined not by how fast it grows, but by how wisely it scales.