Chunked orc writer class writes an ORC file in a chunked/stream form. More...
#include <orc.hpp>
Public Member Functions | |
orc_chunked_writer () | |
Default constructor, this should never be used. This is added just to satisfy cython. | |
~orc_chunked_writer () | |
virtual destructor, Added so we don't leak detail types. | |
orc_chunked_writer (chunked_orc_writer_options const &options, rmm::cuda_stream_view stream=cudf::get_default_stream()) | |
Constructor with chunked writer options. More... | |
orc_chunked_writer & | write (table_view const &table) |
Writes table to output. More... | |
void | close () |
Finishes the chunked/streamed write process. | |
Public Attributes | |
std::unique_ptr< orc::detail::writer > | writer |
Unique pointer to impl writer class. | |
Chunked orc writer class writes an ORC file in a chunked/stream form.
The intent of the write_orc_chunked_ path is to allow writing of an arbitrarily large / arbitrary number of rows to an ORC file in multiple passes.
The following code snippet demonstrates how to write a single ORC file containing one logical table by writing a series of individual cudf::tables.
cudf::io::orc_chunked_writer::orc_chunked_writer | ( | chunked_orc_writer_options const & | options, |
rmm::cuda_stream_view | stream = cudf::get_default_stream() |
||
) |
Constructor with chunked writer options.
[in] | options | options used to write table |
[in] | stream | CUDA stream used for device memory operations and kernel launches |
orc_chunked_writer& cudf::io::orc_chunked_writer::write | ( | table_view const & | table | ) |
Writes table to output.
[in] | table | Table that needs to be written |