Shanghai Apying Technology Co., Ltd.
Shanghai Apying Technology Co., Ltd.
Add to Cart
FP64 | 5.2 teraFLOPS | ||
FP64 Tensor Core | 10.3 teraFLOPS | ||
FP32 | 10.3 teraFLOPS | ||
TF32 Tensor Core | 82 teraFLOPS | 165 teraFLOPS* | ||
BFLOAT16 Tensor Core | 165 teraFLOPS | 330 teraFLOPS* | ||
FP16 Tensor Core | 165 teraFLOPS | 330 teraFLOPS* | ||
INT8 Tensor Core | 330 TOPS | 661 TOPS* | ||
INT4 Tensor Core | 661 TOPS | 1321 TOPS* | ||
Media engines | 1 optical flow accelerator (OFA) 1 JPEG decoder (NVJPEG) 4 video decoders (NVDEC) | ||
GPU memory | 24GB HBM2 | ||
GPU memory bandwidth | 933GB/s | ||
Interconnect | PCIe Gen4: 64GB/s Third-gen NVLINK: 200GB/s** | ||
Form factor | Dual-slot, full-height, full-length (FHFL) | ||
Max thermal design power (TDP) | 165W | ||
Multi-Instance GPU (MIG) | 4 GPU instances @ 6GB each 2 GPU instances @ 12GB each 1 GPU instance @ 24GB | ||
Virtual GPU (vGPU) software support | NVIDIA AI Enterprise NVIDIA Virtual Compute Server | ||