Package ai.rapids.cudf

Class ParquetWriterOptions

java.lang.Object

ai.rapids.cudf.ColumnWriterOptions

ai.rapids.cudf.ColumnWriterOptions.StructColumnWriterOptions

ai.rapids.cudf.CompressionMetadataWriterOptions

ai.rapids.cudf.ParquetWriterOptions

public final class ParquetWriterOptions
extends CompressionMetadataWriterOptions

This class represents settings for writing Parquet files. It includes meta data information that will be used by the Parquet writer to write the file

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ParquetWriterOptions.Builder
static enum	ParquetWriterOptions.DictionaryPolicy	Mirror of cudf::io::dictionary_policy.
static enum	ParquetWriterOptions.StatisticsFrequency

Nested classes/interfaces inherited from class ai.rapids.cudf.ColumnWriterOptions

ColumnWriterOptions.AbstractStructBuilder<T extends ColumnWriterOptions.AbstractStructBuilder,V extends ColumnWriterOptions>, ColumnWriterOptions.ByteArrayProducer, ColumnWriterOptions.IntArrayProducer, ColumnWriterOptions.ListBuilder, ColumnWriterOptions.ListColumnWriterOptions, ColumnWriterOptions.NestedBuilder<T extends ColumnWriterOptions.NestedBuilder,V extends ColumnWriterOptions>, ColumnWriterOptions.StructBuilder, ColumnWriterOptions.StructColumnWriterOptions

Field Summary

Fields inherited from class ai.rapids.cudf.ColumnWriterOptions

childColumnOptions, UNKNOWN_PRECISION

Method Summary

Modifier and Type	Method	Description
static ParquetWriterOptions.Builder	builder()
ParquetWriterOptions.DictionaryPolicy	getDictionaryPolicy()
long	getMaxDictionarySize()
long	getRowGroupSizeBytes()
int	getRowGroupSizeRows()
ParquetWriterOptions.StatisticsFrequency	getStatisticsFrequency()

Methods inherited from class ai.rapids.cudf.CompressionMetadataWriterOptions

getCompressionType, getMetadata, getTopLevelChildren

Methods inherited from class ai.rapids.cudf.ColumnWriterOptions

getChildColumnOptions, getColumnName, getFlatBooleans, getFlatColumnNames, getFlatInts, getParquetFieldId, getPrecision, hasParquetFieldId, isBinary, isNullable, isTimestampTypeInt96, listBuilder, listBuilder, listBuilder, mapColumn, mapColumn, mapColumn, structBuilder, structBuilder, structBuilder

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

builder

public static ParquetWriterOptions.Builder builder()

getRowGroupSizeRows

public int getRowGroupSizeRows()

getRowGroupSizeBytes

public long getRowGroupSizeBytes()

getMaxDictionarySize

public long getMaxDictionarySize()

Returns:

the maximum per-column-chunk dictionary size in bytes. Only used when the dictionary policy is ParquetWriterOptions.DictionaryPolicy.ADAPTIVE.

getDictionaryPolicy

public ParquetWriterOptions.DictionaryPolicy getDictionaryPolicy()

Returns:

the dictionary policy in effect for the Parquet writer.

getStatisticsFrequency

public ParquetWriterOptions.StatisticsFrequency getStatisticsFrequency()