#Groq

Groq is a company formed by ex-Google TPU engineers who have developed an LPU (Language Processing Unit) that can generate outputs at a blistering speed. It can generate over 500 tokens per second while using a 7B model and close to 250 tokens per second while using a 70B model. ChatGPT and Gemini generate responses at a speed of 50 to 60 tokens per second. The Groq LPUs are said to be highly performant with much less latency and minimum energy consumption. With the introduction of LPUs, expect instant interaction with AI models soon.