JSON#
- cudf._lib.pylibcudf.io.json.chunked_read_json(SourceInfo source_info, list dtypes=None, compression_type compression=compression_type.AUTO, bool keep_quotes=False, bool mixed_types_as_string=False, bool prune_columns=False, json_recovery_mode_t recovery_mode=json_recovery_mode_t.FAIL, int chunk_size=100000000) tuple#
Reads an JSON file into a
TableWithMetadata.- Parameters:
- source_infoSourceInfo
The SourceInfo object to read the JSON file from.
- dtypeslist, default None
Set data types for the columns in the JSON file.
Each element of the list has the format (column_name, column_dtype, list of child dtypes), where the list of child dtypes is an empty list if the child is not a nested type (list or struct dtype), and is of format (column_child_name, column_child_type, list of grandchild dtypes).
- compression: CompressionType, default CompressionType.AUTO
The compression format of the JSON source.
- keep_quotesbool, default False
Whether the reader should keep quotes of string values.
- mixed_types_as_stringbool, default False
If True, mixed type columns are returned as string columns. If False parsing mixed type columns will thrown an error.
- prune_columnsbool, default False
Whether to only read columns specified in dtypes.
- recover_modeJSONRecoveryMode, default JSONRecoveryMode.FAIL
Whether to raise an error or set corresponding values to null when encountering an invalid JSON line.
- chunk_sizeint, default 100_000_000 bytes.
The number of bytes to be read in chunks. The chunk_size should be set to at least row_size.
- Returns:
- tuple
A tuple of (columns, column_name, child_names)
- cudf._lib.pylibcudf.io.json.read_json(SourceInfo source_info, list dtypes=None, compression_type compression=compression_type.AUTO, bool lines=False, size_type byte_range_offset=0, size_type byte_range_size=0, bool keep_quotes=False, bool mixed_types_as_string=False, bool prune_columns=False, json_recovery_mode_t recovery_mode=json_recovery_mode_t.FAIL) TableWithMetadata#
Reads an JSON file into a
TableWithMetadata.- Parameters:
- source_infoSourceInfo
The SourceInfo object to read the JSON file from.
- dtypeslist, default None
Set data types for the columns in the JSON file.
Each element of the list has the format (column_name, column_dtype, list of child dtypes), where the list of child dtypes is an empty list if the child is not a nested type (list or struct dtype), and is of format (column_child_name, column_child_type, list of grandchild dtypes).
- compression: CompressionType, default CompressionType.AUTO
The compression format of the JSON source.
- byte_range_offsetsize_type, default 0
Number of bytes to skip from source start.
- byte_range_sizesize_type, default 0
Number of bytes to read. By default, will read all bytes.
- keep_quotesbool, default False
Whether the reader should keep quotes of string values.
- mixed_types_as_stringbool, default False
If True, mixed type columns are returned as string columns. If False parsing mixed type columns will thrown an error.
- prune_columnsbool, default False
Whether to only read columns specified in dtypes.
- recover_modeJSONRecoveryMode, default JSONRecoveryMode.FAIL
Whether to raise an error or set corresponding values to null when encountering an invalid JSON line.
- Returns:
- TableWithMetadata
The Table and its corresponding metadata (column names) that were read in.
- cudf._lib.pylibcudf.io.json.write_json(SinkInfo sink_info, TableWithMetadata table_w_meta, unicode na_rep=u'', bool include_nulls=False, bool lines=False, size_type rows_per_chunk=numeric_limits[size_type].max(), unicode true_value=u'true', unicode false_value=u'false') void#
Writes a
Tableto JSON format.- Parameters:
- sink_info: SinkInfo
The SinkInfo object to write the JSON to.
- table_w_meta: TableWithMetadata
The TableWithMetadata object containing the Table to write
- na_rep: str, default “”
The string representation for null values.
- include_nulls: bool, default False
Enables/Disables output of nulls as ‘null’.
- lines: bool, default False
If True, write output in the JSON lines format.
- rows_per_chunk: size_type, defaults to length of the input table
The maximum number of rows to write at a time.
- true_value: str, default “true”
The string representation for values != 0 in INT8 types.
- false_value: str, default “false”
The string representation for values == 0 in INT8 types.