textbox.data.dataloader.paired_sent_dataloader¶

class textbox.data.dataloader.paired_sent_dataloader.CopyPairedSentenceDataLoader(config, dataset, batch_size=1, shuffle=False, drop_last=True, DDP=False)[source]¶

Bases: PairedSentenceDataLoader

static get_extra_zeros(oovs)[source]¶

class textbox.data.dataloader.paired_sent_dataloader.PairedSentenceDataLoader(config, dataset, batch_size=1, shuffle=False, drop_last=True, DDP=False)[source]¶

Bases: AbstractDataLoader

GeneralDataLoader is used for general model and it just return the origin data.

Parameters

config (Config) – The config of dataloader.
dataset (PairedSentenceDataset) – The dataset of dataloader. Corpus, see textbox.data.corpus for more details
batch_size (int, optional) – The batch_size of dataloader. Defaults to 1.
shuffle (bool, optional) – Whether the dataloader will be shuffle after a round. Defaults to False.