nltk.tokenize.StanfordTokenizer.tokenize

StanfordTokenizer.tokenize(s)[source]

Use stanford tokenizer’s PTBTokenizer to tokenize multiple sentences.