The AI infrastructure sector has witnessed a new investment leap with the announcement by "Fal," a company specializing in hosting and operating AI models for video, images, and audio, that its market valuation has doubled to reach $16 billion. This came in conjunction with the company's success in raising $1.3 billion in new funding during its latest funding round led by Bessemer Venture Partners, with participation from prominent companies including Nvidia, Sound Ventures, and T. Rowe Price.
The San Francisco-based company explained that it announced its fifth and sixth funding rounds together, bringing the total funds raised across both rounds to approximately $1.65 billion, after Sequoia led the previous round. This new valuation represents double the company's value of $8 billion, which it recorded just last April, according to reports.
Inference Surge and Growing Revenues
The sixth funding round comes amid a sharp rise in demand for inference services, which is the software process of running pre-trained AI models to generate outputs, especially from customers who rely on open-source models. Fal managed to surpass the $800 million mark in annual recurring revenue earlier this year.
Financial Challenges for Inference Companies
Despite the massive growth and huge funding enjoyed by companies operating in the inference sector—such as Baseten, Fireworks AI, and Modal, which raise successive funding rounds with rising valuations—their gross profit margins remain relatively narrow.
This is mainly due to the massive increase in the costs of purchasing or renting the computing power necessary to run these intensive infrastructures, according to sources familiar with the financial affairs of these companies. It is worth noting that Fal was founded in 2021 by Burkay Gur, a former Oracle engineer and former machine learning lead at Coinbase, and Görkem Yurtseven, a former developer at Amazon.