Struct BatchDataLoader

pub struct BatchDataLoader<B, I, O>
where
    B: Backend,
{ /* private fields */ }

A data loader that can be used to iterate over a dataset in batches.

Implementations

impl<B, I, O> BatchDataLoader<B, I, O>

where B: Backend,

pub fn new( strategy: Box<dyn BatchStrategy<I>>, dataset: Arc<dyn Dataset<I>>, batcher: Arc<dyn Batcher<B, I, O>>, device: <B as Backend>::Device, rng: Option<StdRng>, ) -> BatchDataLoader<B, I, O>

Creates a new batch data loader.

Arguments

• strategy - The batch strategy.
• dataset - The dataset.
• batcher - The batcher.
• device - The device to use when loading a batch.
• rng - The rng determining if the dataset is shuffled each time a dataloader iterator is created.

Returns

The batch data loader.

Trait Implementations

impl<B, I, O> Clone for BatchDataLoader<B, I, O>

where B: Backend,

fn clone(&self) -> BatchDataLoader<B, I, O>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<B, I, O> DataLoader<B, O> for BatchDataLoader<B, I, O>

where B: Backend, I: Send + Sync + Clone + 'static, O: Send + 'static,

fn iter<'a>(&'a self) -> Box<dyn DataLoaderIterator<O, Item = O> + 'a>

Returns a boxed iterator to iterate over the data loader.

fn num_items(&self) -> usize

The number of items (not the number of batches nor the number of iterations), corresponding to the items_total of the progress returned by the iterator.

fn to_device( &self, device: &<B as Backend>::Device, ) -> Arc<dyn DataLoader<B, O>>

Move the data loader to the given device, ensuring the batches are assigned to the correct device.

fn slice(&self, start: usize, end: usize) -> Arc<dyn DataLoader<B, O>>

Returns a new data loader containing a subset of the data.