replace

pylibcudf.nvtext.replace.filter_tokens(Column input, size_type min_token_length, Scalar replacement=None, Scalar delimiter=None) → Column

Removes tokens whose lengths are less than a specified number of characters.

For details, see filter_tokens()

Parameters:

inputColumn

Strings column to replace

min_token_lengthsize_type

The minimum number of characters to retain a token in the output string

replacementScalar, optional

Optional replacement string to be used in place of removed tokens

delimiterScalar, optional

Characters used to separate each string into tokens. The default of empty string will identify tokens using whitespace.

Returns

——-

Column

New strings column of filtered strings

pylibcudf.nvtext.replace.replace_tokens(Column input, Column targets, Column replacements, Scalar delimiter=None) → Column

Replaces specified tokens with corresponding replacement strings.

For details, see replace_tokens()

Parameters:

inputColumn

Strings column to replace

targetsColumn

Strings to compare against tokens found in input

replacementsColumn

Replacement strings for each string in targets

delimiterScalar, optional

Characters used to separate each string into tokens. The default of empty string will identify tokens using whitespace.

Returns:

Column

New strings column with replaced strings