===================
WordPieceTokenizer
===================
.. currentmodule:: cudf.core.wordpiece_tokenize

Constructor
~~~~~~~~~~~
.. autosummary::
   :toctree: api/

   WordPieceVocabulary
   WordPieceVocabulary.tokenize

.. currentmodule:: cudf.core.subword_tokenizer
.. autosummary::
   :toctree: api/

   SubwordTokenizer
   SubwordTokenizer.__call__