NVIDIA L4

Breakthrough Universal Accelerator for Efficient Video, AI, and Graphics

With NVIDIA's AI platform and full-stack approach, L4 is optimized for video and inference at scale for a broad range of AI applications, including recommendations, voice-based AI avatar assistants, generative AI, visual search, and contact center automation to deliver the best personalized experiences. As the most efficient NVIDIA accelerator for mainstream, servers equipped with L4 enable up to 120X higher AI Video performance over CPU solutions, while providing 2.7X more generative AI performance, and over 4X more graphics performance versus the previous generation. NVIDIA L4's versatility and energy-efficient, single-slot, low-profile form factor make it ideal for global deployments, including edge locations.

As AI and video become more pervasive, the demand for efficient, cost effective computing is increasing more than ever. NVIDIA L4 GPUs deliver up to 99% better energy efficiency and lower total cost of ownership compared to traditional CPU-based infrastructure. This enables enterprises to reduce rack space and significantly lower the overall carbon footprint while making their data centers capable of scaling to many more users. The energy saved by switching from CPUs to NVIDIA L4s in a 2 megawatt (MW) data center can power over 2,000 homes for one year or the carbon offset from 172,000 trees grown over 10 years*.

NVIDIA L4 ADA LOVELACE ARCHITECTURE FEATURES

Fourth-Generation Tensor Cores

• The new Ada Lovelace architecture Tensor Cores are designed to accelerate transformative AI technologies like intelligent chatbots, generative AI, natural language processing (NLP), computer vision, and NVIDIA Deep Learning Super Sampling 3.0 (DLSS 3). Ada Lovelace Tensor Cores unleash structured sparsity and 8-bit floating point (FP8) precision for up to 4x higher inference performance over the previous generation¹. FP8 reduces memory pressure when compared to larger precisions and dramatically accelerates AI throughput.
• 
  

Third-Generation RT Cores

• NVIDIA made real-time ray tracing a reality with the invention of RT Cores, processing cores on the GPU specifically designed to tackle performance-intensive ray-tracing rendering. Ada Lovelace's third-generation RT Cores have twice the ray-triangle intersection throughput, increasing RT-TFLOP performance by over 2x. NVIDIA Shader Execution Reordering (SER) improves performance over 3x, enabling deep immersive experiences for virtual worlds and unprecedented productivity for AI-based neural graphics and cloud gaming.

Advanced Video and Vision AI Acceleration

• With an optimized AV1 stack, NVIDIA L4 takes video and vision AI acceleration to the next level, creating a broad array of new possibilities for use cases like real-time video transcoding, streaming, video conferencing, augmented reality (AR), virtual reality (VR), and vision AI. With four video decoders and two video encoders, combined with the AV1 video format, L4 servers can host over 1,000²concurrent video streams and over 120X more AI video end-to-end pipeline performance than CPU solutions³. On top of this, four JPEG decoders further speed up applications that need computer vision horsepower.

• NVIDIA L4 PCIe with attached low-profile bracket
• Unattached full-height (ATX) bracket