ModelTimeoutException: Model has timed out in processing the request. Try your request again.

[anikm1987]

After more less 8 minutes , received the error below

ModelTimeoutException: Model has timed out in processing the request. Try your request again.

I am able to store the chathistory in dynamodb and during the error was trying to do resumption by retrieving the chat history from dynamodb but unable to make that work.

Any workaround for this issue?

[rcmanton]

Hi Aniket, thanks for opening this issue.

Nova Sonic sessions have an 8 minute maximum session length. The path forward is to resume the session and pass in chat history upon initialization. If I remember correctly, the restrictions are

a. maximum 40 messages passed in
b. 1000 bytes per message
c. first message must be from USER role

However, this re-initialization can be challenging to time correctly so you don't cut off generation or the user speaking to the model. I will look into adding this to the repo or another sample at some point.

Please let me know if you get it working as well.

Reference: https://aws.amazon.com/blogs/aws/introducing-amazon-nova-sonic-human-like-voice-conversations-for-generative-ai-applications/