OpenAI has a major competitor whose name starts with the letter “G.” However, we’re not talking about Google. A new company named Groq just burst onto the scene with its powerful AI model. While this company is new to the public eye, it definitely has some notable aspects about it that make it a force to be reckoned with.
This company is new to most people, but it’s actually been around for almost eight years. The company was founded in 2016, the same year that OpenAI was founded. Ever since it was founded, it’s been hard at work developing its model to push AI technology forward. Now that generative AI is over a year in, it’s about time it came to throw in its chips.
Groq is the new AI model on the scene, and it’s powerful
There are a ton of AI tools available nowadays, but there aren’t too many AI models. Google has its AI models along with OpenAI, Elon Musk’s X Corp, Anthropic AI, Amazon, Apple, and Meta. Many AI tools are being powered by these models.
The newest model on the scene is called Groq, and it’s from a company of the same name. The company basically became an overnight success when it posted a quick demo of just how lightning-fast its model is. A video posted by Matt Schumer, CEO of OtherSide AI, showed the Groq model generating several paragraphs of text in the span of one second. This is something that would take ChatGPT around 10-20 seconds to generate.
The company says that Groq can generate up to 500 tokens per second. To put that into perspective, GPT 3.5 can generate around 40 tokens per second, according to the report. That’s a whopping 12.5 times faster.
side by side Groq vs. GPT-3.5, completely different user experience, a game changer for products that require low latency pic.twitter.com/sADBrMKXqm
— Dina Yerlan (@dina_yrl) February 19, 2024
Groq might upset the GPU Market
One of the most notable things about Groq is the special chips that it uses to train its AI model. All of the major AI companies are using powerful GPUs to train their models. This is one reason why Nvidia is not one of the most valuable companies in the world. However, Groq does not use GPUs. Instead, the company uses its own custom chips called LPUs. This stands for Language Processing Unit.
The company developed these chips, so it seems that they’re very much designed around AI. We’re not quite sure how many of these chips the company is using, but if Groq is able to out-match ChatGPT in terms of speed, then the company must be using a fair amount.
If you’re interested in using Groq, you can go to the official Groq website to try it out. Just like with any AI chatbot, you’re going to want to be careful with the information that it produces.
2024-02-20 15:04:16