AI infrastructure company Modular has raised $250 million in Series C funding, nearly tripling its valuation to $1.6 billion. The round was led by Thomas Tull’s US Innovative Technology fund, with DFJ Growth joining as a new investor.
The funding brings Modular’s total capital raised to $380 million across three rounds since its founding in 2022. All existing investors participated, including Google Ventures, General Catalyst, and Greylock Ventures.
What Modular Does
Modular builds what it calls “AI’s unified compute layer” – essentially a hypervisor for artificial intelligence. The company addresses a major problem in AI infrastructure: hardware fragmentation.
Today, different AI chips from companies like NVIDIA and AMD require their own specific software. This creates waste and makes it hard for developers to switch between different hardware. Modular’s platform solves this by creating one unified layer that works across all types of AI chips.
Strong Growth Numbers
The company has shown impressive traction since launching its platform in 2023:
- Downloaded tens of thousands of times per month with 75% monthly growth
- Over 24,000 GitHub stars from developers
- Powers trillions of AI tokens served daily in production
- Hundreds of thousands of developers across 100+ countries
- Claims up to 70% latency reduction and 80% cost savings for customers
The Technology Platform
Modular’s platform includes three main components:
Mammoth: A control system designed for large-scale AI serving that can manage multiple AI models at once.
MAX: A high-performance framework that runs AI models with state-of-the-art optimizations, delivering 20-50% better performance than competing solutions.
Mojo: A new programming language that combines Python’s ease of use with the speed of lower-level languages like C++.
The latest version shows significant performance gains over popular alternatives like vLLM and SGLang on next-generation hardware from NVIDIA and AMD.
Market Opportunity
The demand for AI compute power continues to grow rapidly. As companies build more AI applications, they need infrastructure that can efficiently use different types of chips without vendor lock-in.
Notable Customers and Partners
Modular works with major enterprises, cloud providers, and hardware companies, including:
- Enterprises: Inworld, SF Compute
- Cloud providers: Oracle, AWS, Lambda Labs, Tensorwave
- Hardware partners: AMD, NVIDIA
- Research organizations: Jane Street
The company has released over 600,000 lines of open-source code and received thousands of contributions from developers worldwide.
What’s Next
The new funding will help Modular expand its platform across cloud and edge computing environments. The company plans to support more types of hardware and power advanced AI workloads that require maximum performance.
Modular is currently hiring across North America and Europe for various technical roles as it scales to meet growing demand.
Why This Matters
As AI becomes more important to businesses, the infrastructure running these systems becomes critical. Companies need solutions that work across different types of hardware without getting locked into one vendor’s ecosystem.
Modular’s approach could help solve the current fragmentation in AI infrastructure, potentially reducing costs and increasing efficiency for companies building AI applications.
The significant valuation increase and strong investor interest signal confidence in both the company’s technology and the broader market opportunity for unified AI infrastructure platforms.
Want to stay updated on the latest AI startup funding news? Check out our weekly funding roundups for comprehensive coverage of venture capital activity in the artificial intelligence space.