cudf::io::orc_chunked_writer Class Reference

Chunked orc writer class writes an ORC file in a chunked/stream form. More...

#include <orc.hpp>

Public Member Functions
	orc_chunked_writer ()
	Default constructor, this should never be used. This is added just to satisfy cython.
	~orc_chunked_writer ()
	virtual destructor, Added so we don't leak detail types.
	orc_chunked_writer (chunked_orc_writer_options const &options, rmm::cuda_stream_view stream=cudf::get_default_stream())
	Constructor with chunked writer options. More...
orc_chunked_writer &	write (table_view const &table)
	Writes table to output. More...
void	close ()
	Finishes the chunked/streamed write process.

Public Attributes
std::unique_ptr< orc::detail::writer >	writer
	Unique pointer to impl writer class.

Detailed Description

Chunked orc writer class writes an ORC file in a chunked/stream form.

The intent of the write_orc_chunked_ path is to allow writing of an arbitrarily large / arbitrary number of rows to an ORC file in multiple passes.

The following code snippet demonstrates how to write a single ORC file containing one logical table by writing a series of individual cudf::tables.

 ...
 std::string filepath = "dataset.orc";
 cudf::io::chunked_orc_writer_options options = cudf::io::chunked_orc_writer_options
options::builder(cudf::sink_info(filepath));
 ...
 orc_chunked_writer writer(options)
 writer.write(table0)
 writer.write(table1)
   ...
 writer.close();

Definition at line 1478 of file orc.hpp.

Constructor & Destructor Documentation

orc_chunked_writer()

cudf::io::orc_chunked_writer::orc_chunked_writer	(	chunked_orc_writer_options const &	options,
		rmm::cuda_stream_view	stream = cudf::get_default_stream()
	)

Constructor with chunked writer options.

Parameters

[in]	options	options used to write table
[in]	stream	CUDA stream used for device memory operations and kernel launches

Member Function Documentation

write()

orc_chunked_writer& cudf::io::orc_chunked_writer::write

(

table_view const &

table

)

Writes table to output.

Note

If an exception is thrown during encoding or compression, the data from the failing call is not written to the sink. Data from previous successful calls is unaffected.

Parameters

[in]

table

Table that needs to be written

Returns

returns reference of the class object

---

The documentation for this class was generated from the following file:

• orc.hpp