Skip to content

loader, cvsclient: Read files line by line to reduce memory consumption

Antoine Lambert requested to merge generated-differential-D8683-source into generated-differential-D8683-target

Instead of using the readlines method on file objects that retrieve all lines of a file and store them in memory, prefer to read files line by line by using the lazy generator of lines from file objects.

This significantly reduce loader memory consumption when processing a large rlog output stored in a file.

Migrated from D8683 (view on Phabricator)

Merge request reports