nltk.tokenize.regexp_tokenize()
¶
-
nltk.tokenize.
regexp_tokenize
(text, pattern, gaps=False, discard_empty=True, flags=56)[source]¶ Return a tokenized copy of text. See
RegexpTokenizer
for descriptions of the arguments.