Indian AI Startup Sarvam Unveils the Future with Sarvam 1: A Multi-Language LLM

In a significant advancement for Indian languages in AI, Bengaluru-based Sarvam AI has launched Sarvam 1, an open-source large language model (LLM) designed specifically to accommodate 10 Indic languages along with English. This ambitious initiative aims to enhance accessibility and utility in the ever-evolving landscape of AI.

Innovative AI solutions for Indian languages

Breaking New Ground in Language Technology

Sarvam 1 boasts an impressive 2-billion-parameter architecture, powered by a custom tokenisation system developed in-house. The training process involved an extensive backing of 4 trillion tokens, leveraging cutting-edge Nvidia H100 Tensor Core GPUs. Additionally, Sarvam AI innovatively used synthetic data generation techniques to craft a robust dataset tailored for various Indian languages, thereby establishing its model as a pioneer developed entirely within India’s tech frontier.

Dr. Pratyush Kumar, the co-founder of Sarvam AI, stated, > “The Sarvam 1 model is the first example of an LLM trained from scratch with data, research, and compute being fully in India. We expect it to power a range of use cases including voice and messaging agents. This is the beginning of our mission to build full-stack sovereign AI, and we are deeply excited to be working together with Nvidia towards this mission.”

Developers are encouraged to explore the base model via Hugging Face, which serves as an open-source platform for creating diverse AI applications aimed at enhancing interactions for users of Indic languages. Potential applications include automated customer support systems, advanced voice recognition, and numerous translation tools—representing a stride towards integrating AI into everyday linguistic experiences.

AI applications transforming user experience

A History of Innovation

The launch follows Sarvam AI’s earlier release of Sarvam 2B, introduced in August 2024, which was trained on the same extensive 4 trillion tokens. This iteration focused on developing voice agents for customer service and sales, making waves in sectors like healthcare and banking by offering these services at a highly competitive rate of Rs 1 per minute. Moreover, the company has added various innovative tools targeted towards legal data processes and audio model functionality for Indic language comprehension.

Before this major announcement, Sarvam also made headlines with the launch of Open Hathi, heralded as India’s first Hindi-focused open-source LLM, based on the Llama 2-7B model from Meta AI. With claims of achieving GPT-3.5-level accuracy on Indic datasets, it showcased the company’s potential to revolutionise language processing in India. The two-phase training included strategies to mitigate the costs associated with tokenization for Hindi, aiming to overcome historical challenges in the field.

Cutting-edge developments in AI language models

Overcoming Obstacles

Despite securing $54 million in funding to propel its initiatives, Sarvam AI faces significant hurdles in penetrating the traditionally established Indian AI ecosystem. Comparison with giants like Google’s Gemini highlights the competitive nature of this space, as Sarvam works diligently to showcase its unique contributions.

However, functionality has been an area of concern: reports indicate low transcription accuracy and difficulties in managing multilingual audio inputs. These challenges need addressing to enhance the model’s practical applications and market acceptance.

Challenges and Opportunities Ahead

As Sarvam continues its ambitious journey, experts express that the Indian AI landscape is in dire need of such indigenous innovations. With smaller AI models gaining traction for certain applications, Sarvam’s push towards larger language models will be tested as they refine their offerings. The integration of capabilities such as speech-to-text and translation in products like Shuka, launched in August, will significantly define the company’s trajectory in an increasingly competitive market.

Reading about industry partnerships can provide insight into how collaborative efforts might shape the future of AI in India. For further details, explore:

• Microsoft partners with Indian startup Sarvam AI: Here’s All You Need to Know from the AI Tour
• AI Digest: New AI Model from Sarvam, Krutrim Integrated EVs and Google’s AI Overviews in India
• Small AI models offer better solutions than LLMs: IndiaAI Mission Advisor

Conclusion

The introduction of Sarvam 1 represents a key moment in the burgeoning Indian AI landscape, illuminating the path for future developments in language technology that harmonise with the nation’s diverse linguistic tapestry. As Sarvam AI continues to innovate and overcome challenges, its roadmap forebodes a rich field of opportunities for growth and advancement in the integration of AI across various sectors.