Skip to content

RuntimeError: Error(s) in loading state_dict for TransformerNetwork: Missing key(s) in state_dict: "language_embedding.weight". #4

@gspinelli01

Description

@gspinelli01

Hi,
I tried uploading the weights you provided on the link in the README (this: https://drive.usercontent.google.com/download?id=1USLqOfqYfqIrigx1hkY37SGyrLJuaPwc&export=download&authuser=0) in the colab notebook with your args configuration.
The fact is I get a runtime error saying that the state_dict is missing the weights of the language embedding layer.
Do i have to remove the language embedding layer to try this pre-trained model?
Thank you

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions