DeepSeek not ‘miracle,’ but impressive: Report debunks Chinese AI app’s $5million claim – Crypto News – Crypto News
Connect with us
DeepSeek not ‘miracle,’ but impressive: Report debunks Chinese AI app’s $5million claim DeepSeek not ‘miracle,’ but impressive: Report debunks Chinese AI app’s $5million claim

Metaverse

DeepSeek not ‘miracle,’ but impressive: Report debunks Chinese AI app’s $5million claim – Crypto News

Published

2 years ago

on

With the rising popularity of DeepSeek, a report by Bernstein stated that the Chinese AI app looks fantastic but is not a miracle, and it has not been built in $5 million.

The report mentioned that the claim of DeepSeek, which is comparable to ChatGPT by OpenAI, is built at a cost of $5 million is false.

“We believe that DeepSeek DID NOT “build OpenAI for $5M”; the models look fantastic, but we don’t think they are miracles; and the resulting Twitter-verse panic over the weekend seems overblown,” ANI reported, citing the Bernstein report.

The two main families of AI models, such as ‘DeepSeek-V3’ and ‘DeepSeek R1’, have been developed by the Chinese AI app.

The V3 model is a large language model that uses a mixture of expert (MOE) architecture. This architecture combines multiple smaller models to work together, resulting in high performance while using fewer resources than other large models. In total, the V3 model has 671 billion parameters with nearly 37 billion active users at a time.

The includes innovative techniques such as Multi-Head Latent Attention (MHLA), reducing memory usage, and mixed-precision training using FP8 computation for efficiency.

For the V3 model, DeepSeek used a cluster of 2,048 NVIDIA H800 GPUs for nearly two months, 2.7 million GPU hours for pre-training and 2.8 million GPU hours, including post-training.

According to estimates, the cost of this training will be nearly $5 million based on a $ 2 per GPU hour rental rate. The report claims that this amount doesn’t account for other costs incurred for the development of the model.

DeepSeek R1, which majorly competes with OpenAI models, is built on the V3 foundation but uses Reinforcement Learning (RL) and other techniques to improve reasoning capabilities.

The resources required for the R1 model were very substantial and were not accounted for by the company, the report said.

However, the report acknowledged that DeepSeek’s models are impressive, but the panic and exaggerated claims about building an OpenAI competitor for $5 million are incorrect.

Related Topics:
Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Trending