Class RmmCudaAsyncMemoryResource

java.lang.Object
ai.rapids.cudf.RmmCudaAsyncMemoryResource
All Implemented Interfaces:
RmmDeviceMemoryResource, AutoCloseable

public class RmmCudaAsyncMemoryResource extends Object implements RmmDeviceMemoryResource
A device memory resource that uses `cudaMallocAsync` and `cudaFreeAsync` for allocation and deallocation.
  • Constructor Details

    • RmmCudaAsyncMemoryResource

      public RmmCudaAsyncMemoryResource(long size, long releaseThreshold)
      Create a new async memory resource
      Parameters:
      size - the initial size of the pool
      releaseThreshold - size in bytes for when memory is released back to cuda
    • RmmCudaAsyncMemoryResource

      public RmmCudaAsyncMemoryResource(long size, long releaseThreshold, boolean fabric)
      Create a new async memory resource
      Parameters:
      size - the initial size of the pool
      releaseThreshold - size in bytes for when memory is released back to cuda
      fabric - if true request peer read+write accessible fabric handles when creating the pool
  • Method Details