Sarvam’s Token Factory Raises India’s AI Inference Stakes
by Shraddha Goled · Inc42SUMMARY
- Sarvam AI's Token Factory launch has brought India's emerging inference-as-a-service market into focus, with L&T, E2E Networks' Jarvislabs, Utho Labs and Mirror Security also building offerings around token-based AI infrastructure.
- Token factories allow developers and enterprises to access multiple AI models through APIs and pay for the tokens they consume, without having to manage GPU infrastructure or model deployment themselves.
- As AI adoption drives demand for inference, Indian infrastructure players are looking to move beyond GPU rentals and monetise computing capacity through managed services, with an opportunity to serve both domestic and global workloads.
- Added to Saved Stories in Login
Sarvam AI’s latest announcement of its Token Factory has brought a new layer of India’s artificial intelligence (AI) infrastructure ecosystem into focus. The Bengaluru-based startup on November 16 launched a commercial platform that allows developers and enterprises to access multiple AI models through its computing infrastructure.
The launch comes as Indian companies look to capitalise on the growing demand for AI inference, the process through which trained models generate responses to user prompts. While much of the country’s AI infrastructure investments have so far gone into setting up data centres and procuring GPUs, the growing adoption of AI applications is creating demand for infrastructure that can efficiently serve models at scale.
A token factory allows developers and enterprises to access multiple AI models through a common API, without having to procure GPUs, deploy models or manage the underlying infrastructure. It handles model hosting, computing resources and inference optimisation, charging customers for the input and output tokens they consume rather than for GPU capacity or server time.
Unlike GPU-as-a-service providers and neoclouds, which primarily offer the infrastructure on which customers run their own workloads, a token factory sits a layer above, using owned or leased GPU capacity to serve inference requests through APIs. This reduces the operational burden on customers and allows them to switch between models based on their requirements.
Sarvam is not alone in this pursuit. Larsen & Toubro (L&T), E2E Networks through its Jarvislabs business, and AI security startup Mirror Security are among the other players building offerings around token-based inference. The emerging category also has global precedents, with companies such as Together AI, Fireworks AI, DeepInfra, and Nebius operating similar platforms.
Sarvam’s Token Factory and The Sovereignty Debate
Sarvam’s Token Factory hosts the company’s proprietary Sarvam 105B model alongside open-weight models such as DeepSeek V4.1 Flash, Kimi K3.1 Pro, GLM 5.3 and Google’s Gemma 4 31B.
The billing is in Indian rupee. Sarvam has priced its Token Factory on a pay-per-token basis, with separate rates for input, cached input, and output tokens. Its flagship Sarvam 105B model is priced at an introductory ₹10 per Mn input tokens and ₹25 per Mn output tokens. For other models, prices range from ₹14 (per million input tokens) to ₹950 (per Mn output tokens).
The platform has been serving more than 450 Bn tokens daily through DeepSeek V4.1 Flash, highlighting the scale of demand for inference services, the company said in its blog.
However, the launch of the token factory has also brought up two questions for Sarvam from the ecosystem: why a beneficiary of the government’s IndiaAI Mission, which is aimed at developing indigenous AI capabilities, is hosting Chinese-developed models, and whether GPUs subsidised under the mission are powering the service.
The company was selected under the mission to develop homegrown foundation models and received access to 4,096 Nvidia H100 GPUs. The six-month computing allocation was worth around ₹247 Cr, including a government subsidy of ₹98.68 Cr.
Sarvam, however, clarified that its Token Factory does not use GPU capacity subsidised under the IndiaAI Mission. Instead, it runs on GPUs privately procured by the company. It also said that its access to the government-supported GPU capacity ended in March 2026. The company added that there were no commercial arrangements involving licensing fees, data sharing or royalties with the developers of the hosted models. These are open-weight models that can be downloaded and deployed on privately owned infrastructure.
The company has not responded to Inc42’s questionnaire around this.
“Token Factory gives Sarvam a reason to keep its B200 cluster busy between training runs, and income that lets the company breathe while its trillion-parameter model is built,” said Sanchit Vir Gogia, chief analyst of Greyhound Research, told Inc42. “Sarvam’s product team has reason to feel confident and exposed at once. Its founders should show by the end of 2027 that customers who arrived for DeepSeek stayed for Sarvam.”