WordPieceTokenizer

Constructor

WordPieceVocabulary(vocabulary)	A vocabulary object used to tokenize input text.
WordPieceVocabulary.tokenize(text[, ...])	Produces tokens for the input strings.