<\/p>\n
What if artificial intelligence (AI) could fluently communicate in every Indian language?\u00a0<\/p>\n<\/p><\/div>\n
At the Mint Digital Innovation Summit 2024, being held in Mumbai, Pranav Mistry, founder and CEO of Two Platforms Inc., shared his vision for India to become a leader in AI for non-English markets. Mistry emphasized that by developing new multilingual models, which don’t require training from scratch, India can overcome the complexity of its diverse languages and achieve this ambitious goal.<\/p>\n
\u201cLanguage is the interface between people, and the advancement of AI has put it at the centre of communication with machines. Over the past few years, LLMs (large language models) have made tremendous progress by showing human-level performance but only in the English language. In other languages, LLMs have been unable to capture cultural contexts and have often produced incoherent and incorrect answers,” Mistry explained.<\/p>\n
Mistry believes that Indian startups, working on fine-tuning the existing models, can drive this change by rethinking their approach and developing new multi-lingual models that do not need training from the ground up can help it to become the leader of AI in non-English markets.<\/p>\n
\u201cBut the gap in LLMs should not exist, and given India\u2019s diverse language and dialects, we deserve AI with multilingual fluency. But only if we can work around the complexity of Indian languages,” he added.<\/p>\n
Two Platforms, Mistry’s Silicon Valley-based deep tech startup, backed by Mukesh Ambani\u2019s Jio Platforms<\/a> and South Korea\u2019s Naver Corp., recently released Sutra, a multilingual large language model designed specifically for the Indian market.\u00a0<\/p>\n \u201cThe Sutra\u2019s core innovation is separating the concept of learning from language. We at Sutra have our own 256k new tokenizer, a balanced tokenizer that includes all the languages in a very balanced manner along with high-quality data,” Mistry elaborated.<\/p>\n Sutra, he said, is outperforming most of the local Indian LLMs as well as models like GPT3.5,4 and llama, not only in Hindi but also in languages like Gujarati.<\/p>\n \u201cThe English-centric model of large language models cannot solve our problem,” he noted.<\/p>\n Milestone Alert!<\/strong> You are on Mint! India’s #1 news destination (Source: Press Gazette). To learn more about our business coverage and market insights Click Here!<\/strong><\/a>\n<\/p>\n
\nLivemint tops charts as the fastest growing news website in the world \ud83c\udf0f<\/span> Click here<\/strong><\/a> to know more.\n<\/p>\n