Stream::Reader is perl module intended for reading data from streams. It can be used for "on the fly" parsing big volumes data. WWW: https://metacpan.org/release/Stream-Reader