• Add to Compare

NVIDIA L40S

  • NVIDIA Ada Lovelace GPU architecture
  • 48GB GDDR6 memory with ECC
  • 18,176 CUDA Cores
  • 142 RT Cores
  • 568 Tensor Cores
  • Max. Power Consumption: 350W
  • Interconnect Bus: PCIe 4.0 x16
  • Thermal Solution: Passive
  • Form Factor: Full-height full-length, 2-slot
  • vGPU Software Support
  • Secure Boot with Root of Trust
  • NEBS Ready

NVIDIA L40S

Unparalleled AI and graphics performance for the data center.

The Most Powerful Universal GPU

Experience breakthrough multi-workload performance with the NVIDIA L40S GPU. Combining powerful AI compute with best-in-class graphics and media acceleration, the L40S GPU is built to power the next generation of data center workloads—from generative AI and large language model (LLM) inference and training to 3D graphics, rendering, and video.

Powered by the NVIDIA Ada Lovelace Architecture

Fourth-Generation Tensor Cores

Hardware support for structural sparsity and optimized TF32 format provides out of-the-box performance gains for faster AI and data science model training. Accelerate AI-enhanced graphics capabilities with DLSS to upscale resolution with better performance in select applications.

Third-Generation RT Cores

Enhanced throughput and concurrent ray-tracing and shading capabilities improve ray-tracing performance, accelerating renders for product design and architecture, engineering, and construction workflows. See lifelike designs in action with hardware-accelerated motion blur and stunning real-time animations.

CUDA Cores

Accelerated single-precision floating point (FP32) throughput and improved power efficiency significantly boost performance for workflows like 3D model development and computer-aided engineering (CAE) simulation. Use enhanced 16-bit math capabilities (BF16) for mixed-precision workloads.

Transformer Engine

Transformer Engine dramatically accelerates AI performance and improves memory utilization for both training and inference. Harnessing the power of the Ada Lovelace fourth-generation Tensor Cores, Transformer Engine intelligently scans the layers of transformer architecture neural networks and automatically recasts between FP8 and FP16 precisions to deliver faster AI performance and accelerate training and inference.

Efficiency and Security

L40S GPU is optimized for 24/7 enterprise data center operations and designed, built, tested, and supported by NVIDIA to ensure maximum performance, durability, and uptime. The L40S GPU meets the latest data center standards, are Network Equipment-Building System (NEBS) Level 3 ready, and features secure boot with root of trust technology, providing an additional layer of security for data centers.

DLSS 3

L40S GPU enables ultra-fast rendering and smoother frame rates with NVIDIA DLSS 3. This breakthrough frame-generation technology leverages deep learning and the latest hardware innovations within the Ada Lovelace architecture and the L40S GPU, including fourth-generation Tensor Cores and an Optical Flow Accelerator, to boost rendering performance, deliver higher frames per second (FPS), and significantly improve latency.

Universal Performance

Tensor Performance

1,466 TFLOPS1

RT Core Performance

212 TFLOPS

Single-Precision Performance

91.6 TFLOPS

1Peak rates are based on GPU boost clock.

Multi-Workload Acceleration

Generative AI

Develop new services, insights, and original content.

With next-generation AI, graphics, and media acceleration capabilities, the L40S delivers up to 5X higher inference performance than the previous-generation NVIDIA A40 and 1.2X the performance of the NVIDIA HGX™ A100. ‌With breakthrough performance and 48 gigabytes (GB) of memory capacity, the L40S is the ideal platform for accelerating multimodal generative AI workloads.

Learn More About Generative AI

LLM Training and Inference

Accelerate AI training and inference workloads.

Fourth-generation Tensor Cores with support for FP8 deliver exceptional AI computing performance to accelerate training and inference of state-of-the-art LLM and generative AI models.

Explore the Benefits of NVIDIA AI Inference

Rendering and 3D Graphics

Power high-fidelity creative workflows with NVIDIA RTX graphics.

With third-generation RT Cores that deliver up to 2X the real-time ray-tracing performance of the previous generation to power the creation of stunning visual content and high-fidelity creative workflows, from interactive rendering to real-time virtual production.

Learn More About NVIDIA RTX Technology

NVIDIA Omniverse

Create and operate metaverse applications.

NVIDIA Omniverse makes it possible to connect, develop, and operate the next wave of industrial digitalization applications. With powerful RTX graphics and AI capabilities, L40S delivers exceptional performance for Universal Scene Description (OpenUSD)-based 3D and simulation workflows built on Omniverse.

Learn More About NVIDIA Omniverse

Architecture NVIDIA Ada Lovelace
CUDA Cores 18,176
Tensor Cores 568
RT Cores 142
FP32 (TF) 91.6
TF32 Tensor Core (TF) 183 I 366*
BFLOAT16 Tensor Core (TF) 362.05 I 733*
FP16 Tensor Core (TF) 362.05 I 733*
FP8 Tensor Core (TF) 733 I 1,466*
INT8 Tensor Core (TOPS) 733 I 1,466*
INT4 Tensor Core (TOPS) 733 I 1,466*
RT Core Performance (TF) 209
Media Engine 3 NVENC (+AV1)
3 NVDEC
4 NVJPEG
GPU Memory 48GB GDDR6
Memory Bandwidth 864GB/s
Memory Interface 384-bit
Multi-Instance GPU (MIG) No
vGPU Support Yes
NEBS Ready Level 3
Thermal Solution Passive
Display Port 4x DisplayPort 1.4a
Max. Power Consupmtion 350W
Bus Interface PCI-E 4.0 x16
Form Factor 4.4” H x 10.5” L, Dual Slot

* With Sparsity


  • Revised web page of product spec and information won't be noticed, product colorbox printing shows the actual information of the product.
  • Above product spec is for reference only, actual spec rely on the real product and Leadtek keeps the right to alter. Each sales region will impacts the product difference, please contact your supplier for making sure the actual product information.
  • The adapter, cable and software listed on the web page are for reference only and Leadtek keeps the right to alter, revised information won't be noticed.
  • Above brand name and product name are trademark of each corresponding company.