gensim.utils.upload_chunked()¶

gensim.utils.upload_chunked(server, docs, chunksize=1000, preprocess=None)[source]¶

Memory-friendly upload of documents to a SimServer (or Pyro SimServer proxy).

Use this function to train or index large collections – avoid sending the entire corpus over the wire as a single Pyro in-memory object. The documents will be sent in smaller chunks, of chunksize documents each.