Keysight Technologies, Inc. introduced Keysight AI Inference Builder (KAI Inference Builder), an emulation and analytics platform designed to validate inference-optimized AI infrastructure at scale. Keysight will demonstrate the solution at NVIDIA GTC, showcasing operation within NVIDIA DSX Air AI factory simulation environments to model and optimize AI data center infrastructure, architectures, and performance.
As the AI industry shifts from training large language models (LLMs) to deploying them, optimizing inference has become a crucial factor for ROI. However, inference behavior is highly dynamic and difficult to emulate. Traditional testing methods like synthetic traffic generation or GPU benchmarks cannot accurately reproduce the latency-sensitive workload behavior of AI inferencing across compute, networking, memory, storage, and security layers.
KAI Inference Builder closes that gap by recreating realistic inference workload patterns and modeling industry-specific usage patterns to validate AI infrastructure, applications, and data center deployments. The platform gives AI cloud providers, hardware vendors, and application developers a scalable solution for measuring, validating, and optimizing real-world inference performance.
Key benefits of KAI Inference Builder include:
- Built for the Inference Era: As part of the Keysight Artificial Intelligence (KAI) portfolio, KAI Inference Builder emulates AI inference workloads at scale and validates full-stack deployments under real-world conditions to optimize performance, scale, and security.
- Industry- and Application-Specific Benchmarking: Instead of generic emulations, KAI Inference Builder emulates industry-specific usage patterns and LLM architectures for AI models seen in finance, healthcare, and other verticals, enabling organizations to model and analyze infrastructure and application behavior across different types of AI data center deployments.
- End-to-End Validation and Optimization: KAI Inference Builder evaluates inference workflows from user request to model response, helping teams reduce costly rework by identifying and resolving bottlenecks early across compute, network, and security layers.
- Subsystem Isolation and Root-Cause Precision: KAI Inference Builder can also do client-only emulation, which identifies where performance bottlenecks emerge across the AI infrastructure stack under load, enabling targeted optimization that reduces overprovisioning, lowers costs, and improves overall efficiency.
- NVIDIA DSX Air Integration and Live GTC Demo: Keysight will showcase KAI Inference Builder’s turnkey integration with NVIDIA Air at NVIDIA GTC, generating realistic inference workloads throughout NVIDIA’s data center simulation environment so operators can validate inference infrastructure before deploying physical equipment.
Ram Periakaruppan, Vice President and General Manager, Network Test & Security Solutions at Keysight, said: “Inference is the key to unlocking AI’s ROI, but that can be challenging to achieve when system resources aren’t optimized for capacity and performance. KAI Inference Builder provides visibility into real-world inference performance across the full stack, enabling customers to validate and optimize deployments before hardware reaches the rack. Showcasing this capability at NVIDIA GTC using NVIDIA’s Air platform demonstrates how organizations can accelerate the path to production while reducing risk and cost.”
Amit Katz, VP of Networking at NVIDIA, said: “As AI data centers scale to unprecedented levels, pre-deployment validation has transitioned from a best practice to a mission-critical requirement. The integration of KAI Inference Builder with NVIDIA DSX Air provides the essential environment needed to eliminate performance volatility, and enables NVIDIA AI Factory partners and customers to emulate real inference workloads and preemptively resolve bottlenecks, ensuring optimized AI services reach the market quickly.”
Keysight will showcase KAI Inference Builder, including the NVIDIA Air AI factory simulation demonstration, in pod C101 at the NVIDIA booth as well as Keysight’s booth (3217) at NVIDIA GTC San Jose, from March 16-19.
