Skip to content

Chronos-2/Chronos-Bolt default dtype should be float32 #307

@abdulfatir

Description

@abdulfatir

Chronos models in TimeCopilot currently default to bfloat16.

device_map = "cuda:0" if torch.cuda.is_available() else "cpu"
model = BaseChronosPipeline.from_pretrained(
self.repo_id,
device_map=device_map,
torch_dtype=torch.bfloat16,
)

In many cases, this has the potential of causing precision issues. For example, see this PR from time-bench. Just changing the dtype to float32 changes the position of the model from the 5th place to the 1st in terms of the MASE. We recommend changing the default dtype for Chronos models to float32 in TimeCopilot.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions