:class:`nltk.MWETokenizer`
==========================
.. currentmodule:: nltk
.. autoclass:: MWETokenizer
   :undoc-members:


Methods
-------
.. autosummary::
   :toctree:


   ~MWETokenizer.__init__
   ~MWETokenizer.add_mwe
   ~MWETokenizer.span_tokenize
   ~MWETokenizer.span_tokenize_sents
   ~MWETokenizer.tokenize
   ~MWETokenizer.tokenize_sents