artemis.io.readers

Generator classes for reading data from various input formats in chunks to pass to Steering for processing.

Module Contents

class artemis.io.readers.BaseReader

Base reader class implented as a generator

Examples

sampler(self)

__iter__(self)

__next__(self)

reset(self)

close(self)

class artemis.io.readers.ReaderFactory

Factory class for readers

Examples

class artemis.io.readers.ArrowReader(filepath_or_buffer, header, header_offset, blocks, rnd, nsamples=4)

Bases: artemis.io.readers.BaseReader

Arrow Record Batch reader class implented as a generator

Examples

sampler(self)

__next__(self)

close(self)

class artemis.io.readers.CsvReader(filepath_or_buffer, header, header_offset, blocks, rnd, nsamples=4)

Bases: artemis.io.readers.BaseReader

Csv reader class implented as a generator

Examples

_prepare(self)

sampler(self)

__next__(self)

close(self)

class artemis.io.readers.LegacyReader(filepath_or_buffer, header, header_offset, blocks, rnd, nsamples=4)

Bases: artemis.io.readers.BaseReader

Flat-width text file reader class implented as a generator

Examples

_prepare(self)

sampler(self)

__next__(self)

close(self)

class artemis.io.readers.Sas7bdatReader(filepath_or_buffer, header, header_offset, rnd, nsamples=4, num_rows=4095)

Bases: artemis.io.readers.BaseReader

Sas7 bdata file format reader class implented as a generator which uses SAS7BDAT reader module under the hood. Serves data up in fixed number of rows.

Examples

_prepare(self)

reset(self)

sampler(self)

Requires reading entire SAS Otherwise, we’ll need to rewrite the underlying reader to sample raw bytes correctly

TODO – Implement random bytes chunk from SASbdat files

__next__(self)

close(self)