Skip to content

Removing import WarmupLinearSchedule#3

Open
akhileshgotmare wants to merge 1 commit into1024er:crayonfrom
akhileshgotmare:patch-1
Open

Removing import WarmupLinearSchedule#3
akhileshgotmare wants to merge 1 commit into1024er:crayonfrom
akhileshgotmare:patch-1

Conversation

@akhileshgotmare
Copy link
Copy Markdown

Not supported by latest transformers library. See issue - huggingface/transformers#2082
If warmup is required, we can instead use
scheduler = get_linear_schedule_with_warmup(optimizer, num_warmup_steps=WARMUP_STEPS, num_training_steps = -1)
instead of scheduler = WarmupLinearSchedule(optimizer, warmup_steps=WARMUP_STEPS, t_total = -1)

Not supported by latest transformers library. See issue - huggingface/transformers#2082
If warmup is required, we can instead use 
`scheduler = get_linear_schedule_with_warmup(optimizer, num_warmup_steps=WARMUP_STEPS, num_training_steps = -1)`
instead of `scheduler = WarmupLinearSchedule(optimizer, warmup_steps=WARMUP_STEPS, t_total = -1)`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant