device_memory_resource derived class that uses malloc/free for allocation/deallocation. More...

#include <system_memory_resource.hpp>

Inheritance diagram for rmm::mr::system_memory_resource:

Collaboration diagram for rmm::mr::system_memory_resource:

Public Member Functions
	system_memory_resource (system_memory_resource const &)=default
	Default copy constructor.

	system_memory_resource (system_memory_resource &&)=default
	Default copy constructor.

system_memory_resource &	operator= (system_memory_resource const &)=default
	Default copy assignment operator. More...

system_memory_resource &	operator= (system_memory_resource &&)=default
	Default move assignment operator. More...

Public Member Functions inherited from rmm::mr::device_memory_resource
	device_memory_resource (device_memory_resource const &)=default
	Default copy constructor.

	device_memory_resource (device_memory_resource &&) noexcept=default
	Default move constructor.

device_memory_resource &	operator= (device_memory_resource const &)=default
	Default copy assignment operator. More...

device_memory_resource &	operator= (device_memory_resource &&) noexcept=default
	Default move assignment operator. More...

void *	allocate (std::size_t bytes, cuda_stream_view stream=cuda_stream_view{})
	Allocates memory of size at least `bytes`. More...

void	deallocate (void *ptr, std::size_t bytes, cuda_stream_view stream=cuda_stream_view{})
	Deallocate memory pointed to by `p`. More...

bool	is_equal (device_memory_resource const &other) const noexcept
	Compare this resource to another. More...

void *	allocate (std::size_t bytes, std::size_t alignment)
	Allocates memory of size at least `bytes`. More...

void	deallocate (void *ptr, std::size_t bytes, std::size_t alignment)
	Deallocate memory pointed to by `p`. More...

void *	allocate_async (std::size_t bytes, std::size_t alignment, cuda_stream_view stream)
	Allocates memory of size at least `bytes`. More...

void *	allocate_async (std::size_t bytes, cuda_stream_view stream)
	Allocates memory of size at least `bytes`. More...

void	deallocate_async (void *ptr, std::size_t bytes, std::size_t alignment, cuda_stream_view stream)
	Deallocate memory pointed to by `p`. More...

void	deallocate_async (void *ptr, std::size_t bytes, cuda_stream_view stream)
	Deallocate memory pointed to by `p`. More...

bool	operator== (device_memory_resource const &other) const noexcept
	Comparison operator with another device_memory_resource. More...

bool	operator!= (device_memory_resource const &other) const noexcept
	Comparison operator with another device_memory_resource. More...

Friends
void	get_property (system_memory_resource const &, cuda::mr::device_accessible) noexcept
	Enables the `cuda::mr::device_accessible` property. More...

void	get_property (system_memory_resource const &, cuda::mr::host_accessible) noexcept
	Enables the `cuda::mr::host_accessible` property. More...

Detailed Description

device_memory_resource derived class that uses malloc/free for allocation/deallocation.

There are two flavors of hardware/software environments that support accessing system allocated memory (SAM) from the GPU: HMM and ATS.

Heterogeneous Memory Management (HMM) is a software-based solution for PCIe-connected GPUs on x86 systems. Requirements:

NVIDIA CUDA 12.2 with the open-source r535_00 driver or newer.
A sufficiently recent Linux kernel: 6.1.24+, 6.2.11+, or 6.3+.
A GPU with one of the following supported architectures: NVIDIA Turing, NVIDIA Ampere, NVIDIA Ada Lovelace, NVIDIA Hopper, or newer.
A 64-bit x86 CPU.

For more information, see https://developer.nvidia.com/blog/simplifying-gpu-application-development-with-heterogeneous-memory-management/.

Address Translation Services (ATS) is a hardware/software solution for the Grace Hopper Superchip that uses the NVLink Chip-2-Chip (C2C) interconnect to provide coherent memory. For more information, see https://developer.nvidia.com/blog/nvidia-grace-hopper-superchip-architecture-in-depth/.

Member Function Documentation

◆ operator=() [1/2]

system_memory_resource& rmm::mr::system_memory_resource::operator= ( system_memory_resource && )

default

Default move assignment operator.

Returns: system_memory_resource& Reference to the assigned object

◆ operator=() [2/2]

system_memory_resource& rmm::mr::system_memory_resource::operator= ( system_memory_resource const & )

default

Default copy assignment operator.

Returns: system_memory_resource& Reference to the assigned object

Friends And Related Function Documentation

◆ get_property [1/2]

void get_property	(	system_memory_resource const &	,
		cuda::mr::device_accessible
	)

friend

Enables the cuda::mr::device_accessible property.

This property declares that a system_memory_resource provides device-accessible memory

◆ get_property [2/2]

void get_property	(	system_memory_resource const &	,
		cuda::mr::host_accessible
	)

friend

Enables the cuda::mr::host_accessible property.

This property declares that a system_memory_resource provides host-accessible memory

The documentation for this class was generated from the following file:

system_memory_resource.hpp

Public Member Functions