distributed agent creation? #8
-
|
as the app scales to handle many users creating agents simultaneously, the CLI approach may struggle with resource contention. How can we integrate a task queue like Celery to distribute agent creation tasks across workers? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
this is a good problem to solve , we can integrate Celery with Redis as a message broker to queue and process agent creation tasks asynchronously.basically i am thinking of creating a service which could offload agent creation to workers, scaling horizontally by adding more workers also we should monitor task queues and add retry logic for failed tasks. |
Beta Was this translation helpful? Give feedback.
this is a good problem to solve , we can integrate Celery with Redis as a message broker to queue and process agent creation tasks asynchronously.basically i am thinking of creating a service which could offload agent creation to workers, scaling horizontally by adding more workers also we should monitor task queues and add retry logic for failed tasks.