Skip to content

TorchTrainDataset loads more data than needed #798

Description

@jder

We are currently loading each step of an autoregressive rollout independently in training. This means that when we're not using dask (which is the usual case) we duplicate loads for adjacent steps. We should coalesce these across the full time range for one load, given hist etc.

@fomo-bot can you confirm the problem and propose a solution in a PR?

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions