Groq, Carahsoft Partner to Offer Inference Capabilities to US Government

Groq announced that it has entered into a partnership with Carahsoft Technology to offer rapid artificial intelligence inference capabilities to government customers. 

Carahsoft President Craig P. Abod, a 2024 Wash100 winner, said that the collaboration enables public agencies to be early adopters of AI while customizing the technology according to their daily operations. 

Available through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement contracts, the Grog LPU Inference Engine is a hardware and software platform that provides several use cases, including analyst velocity, continuous monitoring with visualized graph intelligence and generative AI-accelerated contract search and bid proposal drafting, Groq said.

Accessed through GroqCloud, the platform was designed to be energy efficient and only requires a tenth of the energy at scale compared to equivalent GPU systems.

Through the years, Carahsoft collaborated with various contractors to help the government improve its operations. In April, it tapped Orca Security to start offering the Orca Platform, a cloud security and compliance platform that helps reduce potential blind spots and costs compared to agent-based counterparts.