Microsoft Azure#

Azure Virtual Machine

Launch an Azure VM instance and run RAPIDS.

single-node

Azure Virtual Machine

Azure Kubernetes Service (AKS)

Launch a RAPIDS cluster on managed Kubernetes.

multi-node

Azure Kubernetes Service

Azure Cluster via Dask

Launch a RAPIDS cluster on Azure VMs or Azure ML with Dask.

multi-node

Azure VM Cluster (via Dask)

Azure Machine Learning (Azure ML)

Launch RAPIDS Experiment on Azure ML.

single-node multi-node

Azure Machine Learning

RAPIDS can be deployed on Microsoft Azure in several ways. Azure supports various kinds of GPU VMs for different needs. For RAPIDS users we recommend NC/ND VMs for computation and deep learning optimized instances.

NC (>=v3) series

Size

vCPU

Memory: GiB

Temp Storage (with NVMe) : GiB

GPU

GPU Memory: GiB

Max data disks

Max uncached disk throughput: IOPS / MBps

Max NICs/network bandwidth (MBps)

Standard_ND96isr_H100_v5

96

1900

1000

8

80

32

40800/612

8/80,000

Standard_NC24ads_A100_v4

24

220

1123

1

80

12

30000/1000

2/20,000

Standard_NC48ads_A100_v4

48

440

2246

2

160

24

60000/2000

4/40,000

Standard_NC96ads_A100_v4

96

880

4492

4

320

32

120000/4000

8/80,000

Standard_NC4as_T4_v3

4

28

180

1

16

8

2 / 8000

Standard_NC8as_T4_v3

8

56

360

1

16

16

4 / 8000

Standard_NC16as_T4_v3

16

110

360

1

16

32

8 / 8000

Standard_NC64as_T4_v3

64

440

2880

4

64

32

8 / 32000

Standard_NC6s_v3

6

112

736

1

16

12

20000/200

4

Standard_NC12s_v3

12

224

1474

2

32

24

40000/400

8

Standard_NC24s_v3

24

448

2948

4

64

32

80000/800

8

Standard_NC24rs_v3*

24

448

2948

4

64

32

80000/800

8

* RDMA capable

ND (>=v2) series

Size

vCPU

Memory: GiB

Temp Storage (with NVMe) : GiB

GPU

GPU Memory: GiB

Max data disks

Max uncached disk throughput: IOPS / MBps

Max NICs/network bandwidth (MBps)

Standard_ND96asr_v4

96

900

6000

8 A100 40 GB GPUs (NVLink 3.0)

40

32

80,000 / 800

8/24,000

Standard_ND96amsr_A100_v4

96

1900

6400

8 A100 80 GB GPUs (NVLink 3.0)

80

32

80,000 / 800

8/24,000

Standard_ND40rs_v2

40

672

2948

8 V100 32 GB (NVLink)

32

32

80,000 / 800

8/24,000