Stream::Reader is perl module intended for reading data from streams.
It can be used for "on the fly" parsing big volumes data.