Package | Description |
---|---|
ai.rapids.cudf |
Modifier and Type | Field and Description |
---|---|
HostMemoryBuffer |
HostColumnVectorCore.OffHeapState.data |
HostMemoryBuffer |
HostColumnVectorCore.OffHeapState.offsets |
HostMemoryBuffer |
HostColumnVectorCore.OffHeapState.valid |
Modifier and Type | Method and Description |
---|---|
HostMemoryBuffer |
DefaultHostMemoryAllocator.allocate(long bytes) |
static HostMemoryBuffer |
PinnedMemoryPool.allocate(long bytes)
Factory method to create a host buffer but preferably pointing to pinned memory.
|
HostMemoryBuffer |
HostMemoryAllocator.allocate(long bytes)
Allocate memory, but be sure to close the returned buffer to avoid memory leaks.
|
static HostMemoryBuffer |
HostMemoryBuffer.allocate(long bytes)
Allocate memory, but be sure to close the returned buffer to avoid memory leaks.
|
HostMemoryBuffer |
DefaultHostMemoryAllocator.allocate(long bytes,
boolean preferPinned) |
HostMemoryBuffer |
HostMemoryAllocator.allocate(long bytes,
boolean preferPinned)
Allocate memory, but be sure to close the returned buffer to avoid memory leaks.
|
static HostMemoryBuffer |
HostMemoryBuffer.allocate(long bytes,
boolean preferPinned)
Allocate memory, but be sure to close the returned buffer to avoid memory leaks.
|
static HostMemoryBuffer |
PinnedMemoryPool.allocate(long bytes,
HostMemoryAllocator hostMemoryAllocator)
Factory method to create a host buffer but preferably pointing to pinned memory.
|
static HostMemoryBuffer |
HostMemoryBuffer.allocateRaw(long bytes)
Allocate host memory bypassing the default allocator.
|
HostMemoryBuffer |
HostColumnVectorCore.getData()
Returns the data buffer for a given host side column vector
|
HostMemoryBuffer |
JCudfSerialization.HostConcatResult.getHostBuffer() |
HostMemoryBuffer |
HostColumnVectorCore.getHostBufferFor(BufferType type)
Get access to the raw host buffer for this column.
|
HostMemoryBuffer |
HostColumnVectorCore.getOffsets()
Returns the offset buffer
|
HostMemoryBuffer |
HostColumnVectorCore.getValidity()
Returns the validity buffer for a given host side column vector
|
HostMemoryBuffer |
MultiBufferDataSource.hostRead(long offset,
long amount) |
abstract HostMemoryBuffer |
DataSource.hostRead(long offset,
long amount)
Read data from the source at the given offset.
|
static HostMemoryBuffer |
HostMemoryBuffer.mapFile(File path,
FileChannel.MapMode mode,
long offset,
long length)
Create a host buffer that is memory-mapped to a file.
|
HostMemoryBuffer |
HostMemoryBuffer.slice(long offset,
long len)
Slice off a part of the host buffer.
|
HostMemoryBuffer |
HostMemoryBuffer.sliceWithCopy(long offset,
long len)
Slice off a part of the host buffer, actually making a copy of the data.
|
static HostMemoryBuffer |
PinnedMemoryPool.tryAllocate(long bytes)
Factory method to create a pinned host memory buffer.
|
Modifier and Type | Method and Description |
---|---|
static ContiguousTable |
JCudfSerialization.concatToContiguousTable(JCudfSerialization.SerializedTableHeader[] headers,
HostMemoryBuffer[] dataBuffers)
Concatenate multiple tables in host memory into a contiguous table in device memory.
|
static JCudfSerialization.HostConcatResult |
JCudfSerialization.concatToHostBuffer(JCudfSerialization.SerializedTableHeader[] headers,
HostMemoryBuffer[] dataBuffers) |
static JCudfSerialization.HostConcatResult |
JCudfSerialization.concatToHostBuffer(JCudfSerialization.SerializedTableHeader[] headers,
HostMemoryBuffer[] dataBuffers,
HostMemoryAllocator hostMemoryAllocator)
Concatenate multiple tables in host memory into a single host table buffer.
|
void |
BaseDeviceMemoryBuffer.copyFromHostBuffer(HostMemoryBuffer src)
Copy everything from src to this buffer starting at the beginning of this buffer.
|
void |
BaseDeviceMemoryBuffer.copyFromHostBuffer(HostMemoryBuffer src,
Cuda.Stream stream)
Copy entire host buffer starting at the beginning of this buffer using a CUDA stream.
|
void |
BaseDeviceMemoryBuffer.copyFromHostBuffer(HostMemoryBuffer src,
long srcOffset,
long length)
Copy a subset of src to this buffer starting at the beginning of this.
|
void |
BaseDeviceMemoryBuffer.copyFromHostBuffer(long destOffset,
HostMemoryBuffer src,
long srcOffset,
long length)
Copy a subset of src to this buffer starting at destOffset.
|
void |
HostMemoryBuffer.copyFromHostBuffer(long destOffset,
HostMemoryBuffer srcData,
long srcOffset,
long length)
Copy the contents of the given buffer to this buffer
|
void |
BaseDeviceMemoryBuffer.copyFromHostBuffer(long destOffset,
HostMemoryBuffer src,
long srcOffset,
long length,
Cuda.Stream stream)
Copy a subset of src to this buffer starting at destOffset using the specified CUDA stream.
|
void |
BaseDeviceMemoryBuffer.copyFromHostBufferAsync(HostMemoryBuffer src,
Cuda.Stream stream)
Copy entire host buffer starting at the beginning of this buffer using a CUDA stream.
|
void |
BaseDeviceMemoryBuffer.copyFromHostBufferAsync(long destOffset,
HostMemoryBuffer src,
long srcOffset,
long length,
Cuda.Stream stream)
Copy a subset of src to this buffer starting at destOffset using the specified CUDA stream.
|
void |
HostBufferConsumer.handleBuffer(HostMemoryBuffer buffer,
long len)
Consume a buffer.
|
long |
MultiBufferDataSource.hostRead(long offset,
HostMemoryBuffer dest) |
abstract long |
DataSource.hostRead(long offset,
HostMemoryBuffer dest)
Read data from the source at the given offset into dest.
|
protected void |
DataSource.onHostBufferDone(HostMemoryBuffer buffer)
Called when the buffer returned from hostRead is done.
|
static Table |
JCudfSerialization.readAndConcat(JCudfSerialization.SerializedTableHeader[] headers,
HostMemoryBuffer[] dataBuffers) |
static Table |
Table.readAvro(AvroOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Read Avro formatted data.
|
static Table |
Table.readCSV(Schema schema,
CSVOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Read CSV formatted data.
|
long |
HostBufferProvider.readInto(HostMemoryBuffer buffer,
long len)
Place data into the given buffer.
|
static TableWithMeta |
Table.readJSON(JSONOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Read JSON formatted data and infer the column names and schema.
|
static Table |
Table.readJSON(Schema schema,
JSONOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Read JSON formatted data.
|
static Table |
Table.readJSON(Schema schema,
JSONOptions opts,
HostMemoryBuffer buffer,
long offset,
long len,
int emptyRowCount)
Deprecated.
This method is deprecated since emptyRowCount is not used. Use the method without
emptyRowCount instead.
|
static Table |
Table.readORC(ORCOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Read ORC formatted data.
|
static Table |
Table.readParquet(ParquetOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Read parquet formatted data.
|
static JCudfSerialization.TableAndRowCountPair |
JCudfSerialization.readTableFrom(JCudfSerialization.SerializedTableHeader header,
HostMemoryBuffer hostBuffer) |
static void |
JCudfSerialization.readTableIntoBuffer(InputStream in,
JCudfSerialization.SerializedTableHeader header,
HostMemoryBuffer buffer)
After reading a header for a table read the data portion into a host side buffer.
|
static HostColumnVector[] |
JCudfSerialization.unpackHostColumnVectors(JCudfSerialization.SerializedTableHeader header,
HostMemoryBuffer hostBuffer)
Deserialize a serialized contiguous table into an array of host columns.
|
static void |
JCudfSerialization.writeConcatedStream(JCudfSerialization.SerializedTableHeader[] headers,
HostMemoryBuffer[] dataBuffers,
OutputStream out)
Take the data from multiple batches stored in the parsed headers and the dataBuffer and write
it out to out as if it were a single buffer.
|
Constructor and Description |
---|
HostColumnVector(DType type,
long rows,
Optional<Long> nullCount,
HostMemoryBuffer hostDataBuffer,
HostMemoryBuffer hostValidityBuffer,
HostMemoryBuffer offsetBuffer,
List<HostColumnVectorCore> nestedHcv)
Create a new column vector with data populated on the host.
|
HostColumnVectorCore(DType type,
long rows,
Optional<Long> nullCount,
HostMemoryBuffer data,
HostMemoryBuffer validity,
HostMemoryBuffer offsets,
List<HostColumnVectorCore> nestedChildren) |
HostConcatResult(JCudfSerialization.SerializedTableHeader tableHeader,
HostMemoryBuffer tableBuffer) |
MultiBufferDataSource(HostMemoryAllocator allocator,
HostMemoryBuffer... buffers)
Create a new data source backed by multiple buffers.
|
MultiBufferDataSource(HostMemoryBuffer... buffers)
Create a new data source backed by multiple buffers.
|
ORCChunkedReader(long chunkReadLimit,
long passReadLimit,
long outputRowSizingGranularity,
ORCOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Construct a chunked ORC reader instance, similar to
ORCChunkedReader(long, long, ORCOptions, HostMemoryBuffer, long, long) ,
with an additional parameter to control the granularity of the output table. |
ORCChunkedReader(long chunkReadLimit,
long passReadLimit,
ORCOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Construct the reader instance from read limits, output row granularity,
and a file already loaded in a memory buffer.
|
ParquetChunkedReader(long chunkSizeByteLimit,
long passReadLimit,
ParquetOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Construct the reader instance from a read limit and a file already read in a memory buffer.
|
ParquetChunkedReader(long chunkSizeByteLimit,
ParquetOptions opts,
HostMemoryBuffer buffer,
long offset,
long len)
Construct the reader instance from a read limit and a file already read in a memory buffer.
|
Copyright © 2024. All rights reserved.