Groq API - 500+ Tokens/s - First Impression and Tests - WOW!

👊 Become a member and get access to GitHub:
   / allaboutai  

🤖 AI Engineer Course:
scrimba.com/?ref=allabtai

📧 Join the newsletter:
https://www.allabtai.com/newsletter/

🌐 My website:
https://www.allabtai.com

Groq:
www.groq.com

In this video I give my first impression and to multiple test on the Groq API. Like real time speech to speech and comparing Groq to ChatGPT. A new chip design for running inference on AI apps like LLMs. Thanks to Groq for giving me early access!

00:00 Groq API Intro
00:45 Groq LPU
01:45 Groq Real Time Speech to Speech Test
06:07 Groq vs ChatGPT Test
09:33 Groq Chain Prompting Test
11:15 Conclusion