nltk.TweetTokenizer.tokenize

TweetTokenizer.tokenize(text)[source]
Parameters:text – str
Return type:list(str)
Returns:a tokenized list of strings; concatenating this list returns the original string if preserve_case=False