Hi,
I tried uploading the weights you provided on the link in the README (this: https://drive.usercontent.google.com/download?id=1USLqOfqYfqIrigx1hkY37SGyrLJuaPwc&export=download&authuser=0) in the colab notebook with your args configuration.
The fact is I get a runtime error saying that the state_dict is missing the weights of the language embedding layer.
Do i have to remove the language embedding layer to try this pre-trained model?
Thank you
Hi,
I tried uploading the weights you provided on the link in the README (this: https://drive.usercontent.google.com/download?id=1USLqOfqYfqIrigx1hkY37SGyrLJuaPwc&export=download&authuser=0) in the colab notebook with your args configuration.
The fact is I get a runtime error saying that the state_dict is missing the weights of the language embedding layer.
Do i have to remove the language embedding layer to try this pre-trained model?
Thank you