Groq
Groq's primary software product is built around its innovative LPU™ (Language Processing Unit) inference engine. This hardware-software co-designed solution delivers unparalleled low-latency inference for large language models, enabling real-time conversational AI and generative AI applications. It's designed for developers and businesses seeking to deploy cutting-edge AI with extreme performance and responsiveness.
Groq products (6)
Groq API
An API that allows developers to access Groq's inference capabilities, adhering to OpenAI schema for seamless integration with various tools and frameworks.
API Gateway & Management · LLM / GenAI Platform · Model Serving & Inference
GroqChip
Groq's flagship AI processor, powered by the LPU architecture, designed for extremely fast AI inference and low-latency interactions.
High Performance Computing (HPC) · Processors & AI Accelerators
GroqCloud
A fully managed cloud service providing on-demand access to Groq's LPU clusters via a developer-friendly API for fast and affordable AI inference.
GroqRack
An enterprise-grade on-premise hardware solution optimized for high-density AI workloads, providing dedicated performance powered by Groq LPUs.
LPU Inference Engine
A new category of end-to-end processing unit system designed to provide the fastest inference for computationally intensive applications with sequential components.
Language Processing Unit (LPU)
A custom-built processor architecture designed specifically for accelerating AI inference, particularly for large language models, offering high speed and efficiency.
High Performance Computing (HPC) · Processors & AI Accelerators