Too many completion requests for auto completion

[AamodThakur]

Hi, I have configured custom model using OpenAI compatible in Auto-complete model. My backend application is receiving multiple requests for each characters I am typing. Number of request is the number of characters I typed.

[mbektas]

@AamodThakur there is currently a 200 ms wait after keystrokes before sending a request. it is not customizable yet unfortunately.

[mbektas]

@AamodThakur I just added a new config option in NBI settings. Can you try that? A higher delay value should help in your situation. Note that you will need to refresh the browser once, after you change this config.

[AamodThakur]

Hi @mbektas,

Thanks for the update. I believe this will work.

By the way, can you check #95? It appears to fix the auto-complete position due to delayed response, as well as resolve multiple requests to the backend server irrespective of the delay set, which will add to the user experience and does not need tweaking for changes in internet bandwidth.