nltk.regexp_tokenize()

nltk.regexp_tokenize(text, pattern, gaps=False, discard_empty=True, flags=56)[source]

Return a tokenized copy of text. See RegexpTokenizer for descriptions of the arguments.