
Metaverse
‘We want to fix the language gap in AI language models’, says Two Platforms’ Pranav Mistry – Crypto News
Backed by billionaire Mukesh Ambani’s Jio Platforms and South Korea’s Naver Corp, the artificial reality startup also plans to soon release an artificial intelligence (AI)-powered messaging and social app called Zappy in India, according to Two Platform’s founder and CEO, Pranav Mistry.
“Sutra is our mission to fix the language gap in AI language models. We are committed to pioneering AI solutions for non-English markets. We believe our Sutra models will unlock AI growth opportunities in large economies such as India, Korea, Japan, and the MEA (Middle East and Africa) region,” Mistry said in an interview with Mint.
But there are some basic differences “in our approach to building these models”, he insisted. First, unlike most other startups and companies that are building ‘local’ or ‘Indic’ LLMs for India by fine-tuning global LLMs, “we have built a foundational, and not a fine-tuned model,” he said.
General-purpose foundational models such as Google’s BERT and Gemini, OpenAI’s generative pre-trained transformer (GPT) variants, and Meta’s LlaMA series, have been pre-trained on humungous amounts of data from the internet, books, media articles, and other sources. But most of this training data is in English.
A Transformational Approach
Most companies in India are building their Indic LLMs atop these foundational models (hence they’re called ‘wrappers’) by fine tuning these general-purpose LLMs on a smaller, task-specific dataset (such as regional languages like Hindi, Marathi, Gujarati, Tamil, Telegu, Malayalam, etc., and their dialects), which allows the models to learn the nuances of the language and improves its performance.
Sutra, instead, uses two different transformer architectures. Developed by Google, transformers predict the next word in a sequence of text based on large, complex data sets. Since they process words in a single sequence while understanding their relationships with each other, transformers are very effective for tasks like translating languages.
The multilingual LLM Sutra, according to Mistry, has combined an LLM architecture with a Neural Machine Translation (NMT) one. The reason: while LLMs may struggle due to the lack of specialized training data while translating specific pairs of language, NMT systems are typically better equipped to translate idiomatic expressions and colloquial language.
Second, while “GPT-4 is great in Korean or Hindi, too, its size and cost make it more expensive for a country like India”, argued Mistry. The Sutra architecture “decouples concept learning (we learn concepts by associating new information with existing knowledge, such as learning that both apples and oranges are fruits) from language learning. So, when you use Sutra, the number of the tokens used are similar to using English tokens. This saves almost five to eight times in costs,” he explained.
Third, “our specialized NMT models are significantly smaller in parameter size, requiring much less data for training”, Mistry said. When you add more data, say Korean or some Indian language, you also increase the tokens (loosely, pieces of words and sub-words that an LLM can understand. For example, banana is a word, while homework can be split into two words, home and work). This makes the model bigger, but also slows it down. It increases the costs, too, since similar information content in English, when expressed in a language such as Hindi would need three to four times more tokens.
“Besides, in this approach, the quality of, say Hindi, can never surpass that of English in the original,” Mistry added. For instance, about 80% of a general-purpose foundational model pre-training would typically be from sources such as the internet, books, and media articles, which are mostly in English.
Innovation, Not Fine-tuning
However, if you’re fine-tuning this model with data in Hindi from India, for instance, “most of the data would be about cricket, data found on Twitter, or from people discussing news articles, etc., in Hindi. Hence, a Hindi language model built atop a foundational model that has pre-trained mostly on English will not be able to do full justice to the output in Hindi”.
“As an example, if you want to translate Gujarati to Tamil, most models first translate from Gujarati to English and then from English to Tamil, because that’s the data they have trained on. Our model does not do that, so we also require fewer tokens, which also lowers the cost of running the model,” he explained. Mistry adds that Two Platforms’ model is also aligned to human values, a process technically known as ‘AI alignment’.
Sutra, which is currently available in three versions—Light (56 billion parameters), Online (internet-connected multilingual model with 56 billion parameters), and Pro (150 billion parameters)—supports more than 50 languages, “of which 31 are fully tested”, according to Mistry. He emphasized that Sutra’s architecture and use of “synthetically translated data” not only lowers the computing costs of running these models, but also makes the model more efficient.
“Sutra maintains an impressive performance in English of 77% on the MMLU (massive multitask language understanding) benchmark. It also demonstrates superior and consistent performance in the range of 65-75% across languages. In contrast, many leading language models score closer to 25% on non-English MMLU tasks,” Mistry said.
Two Platforms uses its “in-house GPU (graphics processing unit) cluster and rents top-tier cloud GPUs when needed”. “As we expand, the rising costs of training will require us to create specialized models for different areas like images and video,” Mistry added. His company is also in the process of raising a Series A round “to accelerate the development of Sutra into a model-as-a-service (MaaS)” platform. In February 2022, Jio Platforms had invested $15 million in Two Platforms for a 25% equity stake, while a Naver Corp unit, Snow Corp., had invested $5 million.
Other than Sutra, India has Sarvam AI—a generative AI (GenAI) startup that has launched the Open Hathi series; Tech Mahindra’s Indus Project; the ‘Hanooman’ model that was jointly released this month by SML India and 3AI Holding, an Abu Dhabi-based investment firm; CoRover’s BharatGPT LLM-based chatbot; and Ola Cabs and Ola Electric co-founder Bhavish Aggarwal’s Krutrim AI. Meanwhile, the ‘Nilekani Center at AI4Bharat’ at IIT Madras, too, released ‘Airavata’ an open-source LLM for Indian languages.
In a wider context, the LLM market is projected to grow from $6.4 billion in 2024 to $36.1 billion by 2030, according to a research report released by MarketsandMarkets in March. Moreover, India-specific LLMs are certainly the need of the hour but “we need faster, more affordable, multilingual, and energy-efficient LLMs that can bridge the existing market gaps”, concluded Mistry, who hopes Sutra will be one of those companies that “fills this gap”.
-
others1 week ago
Here’s What Bitcoin Needs To Do To Confirm Bullish Breakout, According to Trader Who Nailed 2024 BTC Correction – Crypto News
-
Blockchain7 days ago
XRP MVRV Ratio Dips Below The 200-Day MA – Trend Shift Underway? – Crypto News
-
others6 days ago
Bybit Shuts Down Its NFT Marketplace As Crypto Sector Struggles To Recover – Crypto News
-
Business1 week ago
Can Pi Coin Price Hit $1 Soon? – Crypto News
-
others1 week ago
Here’s What Bitcoin Needs To Do To Confirm Bullish Breakout, According to Trader Who Nailed 2024 BTC Correction – Crypto News
-
others1 week ago
Here’s What Bitcoin Needs To Do To Confirm Bullish Breakout, According to Trader Who Nailed 2024 BTC Correction – Crypto News
-
others1 week ago
XRP and Three Other Altcoins Could Witness Another Sell-Off Event, According to Crypto Strategist – Crypto News
-
Cryptocurrency6 days ago
Sony Singapore Now Lets Shoppers Pay in USDC Through Crypto.com – Crypto News
-
Blockchain6 days ago
Dogecoin Breaking These Levels Could Be The Catalyst For Next Bull Run, Analyst Says – Crypto News
-
Business1 week ago
XRP, BTC, ETH Price Prediction As Inflation Data Sparks Downturn in U.S. Stocks – Crypto News
-
Blockchain1 week ago
zkLend hacker claims losing stolen ETH to Tornado Cash phishing site – Crypto News
-
others1 week ago
Gold extends bullish trend amid rising trade tensions; fresh record high and counting – Crypto News
-
Blockchain1 week ago
SpaceX flight bankrolled by crypto investor launches first manned polar orbit – Crypto News
-
Blockchain1 week ago
Will Bitcoin Downtrend Continue? This Metric Suggests Yes – Crypto News
-
Blockchain1 week ago
Binance ends Tether USDT trading in Europe to comply with MiCA rules – Crypto News
-
Blockchain1 week ago
Binance ends Tether USDT trading in Europe to comply with MiCA rules – Crypto News
-
others1 week ago
Austria Unemployment fell from previous 347.4K to 316.3K in March – Crypto News
-
Blockchain7 days ago
Analyst Calls Dogecoin Chart A ‘Beauty’ As Key Indicators Align – Crypto News
-
Technology6 days ago
XRP Price Predicted to Reach $10 in April if US Congress Stablecoin Bill Promotes Ripple’s RLUSD – Crypto News
-
Business6 days ago
XRP Price Predicted to Reach $10 in April if US Congress Stablecoin Bill Promotes Ripple’s RLUSD – Crypto News
-
Technology6 days ago
Apple Intelligence debuts on Vision Pro with visionOS 2.4 update: AI-powered features, spatial content and more – Crypto News
-
Cryptocurrency6 days ago
US equities slip after job openings disappointment – Crypto News
-
others6 days ago
Will BNB Price Rally to ATH After VanEck BNB ETF Filing? – Crypto News
-
others6 days ago
Pound Sterling consolidates against US Dollar ahead of Trump’s tariffs announcement – Crypto News
-
Cryptocurrency6 days ago
FLOKI price poised for 20% rally, Here’s why – Crypto News
-
others6 days ago
PENDLE Price Jumps 8% Today Amid Huge Whale Accumulation – Crypto News
-
others6 days ago
Fundstrat’s Tom Lee Calls for Imminent Stock Market Reversal, Says US Has the ‘Right Pieces’ for a Bottom – Crypto News
-
Technology6 days ago
European regulators warn of financial risks from US crypto integration – Crypto News
-
Cryptocurrency1 week ago
Is Bitcoin’s rebound near as key area rises? Assessing… – Crypto News
-
Business1 week ago
Builder.ai Announces Third-Party Audit After Allegations – Crypto News
-
others1 week ago
Will the RBA hint at further interest rate hikes at its policy meeting? – Crypto News
-
Technology1 week ago
Over 60 pc broadband, fiber, DSL users surveyed flag problems with connection: LocalCircles poll – Crypto News
-
Cryptocurrency1 week ago
Tether Boosts Bitcoin Holdings By 8,888 BTC In Q1 2025 – Crypto News
-
Technology1 week ago
Bumper discounts in Amazon Gaming Fest! Up to 70% off on gaming laptops, monitors, vlog cameras and more – Crypto News
-
Blockchain1 week ago
Hayes Predicts $250,000 Bitcoin As Fed Caves To QE Pressure – Crypto News
-
Cryptocurrency1 week ago
XRP, DOGE Shoot up as BTC Price Reclaims $84K Level (Market Watch) – Crypto News
-
Technology7 days ago
Best washing machines under ₹10000 in April 2025 to boost your laundry routine without overspending – Crypto News
-
Blockchain6 days ago
Bitcoin traders are overstating the impact of the US-led tariff war on BTC price – Crypto News
-
Blockchain6 days ago
Bitcoin Price Bounces Back—Can It Finally Break Resistance? – Crypto News
-
Cryptocurrency6 days ago
US equities slip after job openings disappointment – Crypto News
-
Blockchain6 days ago
UK trade bodies ask government to make crypto a ‘strategic priority’ – Crypto News
-
Blockchain6 days ago
Several Altcoins Crash Up To 50% On Binance, What’s Going On? – Crypto News
-
Business6 days ago
What to Expect From XRP Price as Trump’s ‘Liberation Day’ Tariffs Go Into Effect Today – Crypto News
-
Technology6 days ago
Franklin Templeton Eyes Crypto ETP Launch In Europe After BlackRock & 21Shares – Crypto News
-
Technology1 week ago
ChatGPT finally allows free users to create Ghibli-style AI images: Check our step-by-step guide – Crypto News
-
Technology1 week ago
Elon Musk’s Grok AI calls him ‘top misinformation spreader’, sparks debate on ‘AI freedom’ – Crypto News
-
Cryptocurrency1 week ago
Will the $80K Support Level Hold BTC After Recent Rejection? – Crypto News
-
Metaverse1 week ago
Mint Primer | Resistance is futile: AI is now writing code – Crypto News
-
Metaverse1 week ago
The Tools of Tomorrow: What Lies Ahead with the AI Revolution – Crypto News
-
Business1 week ago
MicroStrategy Acquires 22,048 Bitcoin For $1.92 Billion – Crypto News