⚡ Bolt: Parallelize folder deletion

.jules/bolt.md

@@ -19,3 +19,7 @@
 ## 2024-05-24 - Avoid Copying Large Sets for Membership Checks
 **Learning:** Copying a large set (e.g. 100k items) to create a snapshot for read-only membership checks is expensive O(N) and unnecessary. Python's set membership testing is thread-safe.
 **Action:** When filtering data against a shared large set, iterate and check membership directly instead of snapshotting, unless strict transactional consistency across the entire iteration is required.
+
+## 2025-02-24 - Parallelize Batch Deletions
+**Learning:** Sequential deletion of resources (folders) via REST API is a major bottleneck when syncing state, as latency accumulates linearly. Since deletions are independent operations, they can be parallelized safely.
+**Action:** Use `ThreadPoolExecutor` to parallelize deletion loops, but limit max_workers (e.g., 5) to avoid rate limits.

main.py

@@ -646,12 +646,23 @@
             existing_folders = list_existing_folders(client, profile_id)
             if not no_delete:
                 deletion_occurred = False
+                folders_to_delete = []
                 for folder_data in folder_data_list:
                     name = folder_data["group"]["group"].strip()
                     if name in existing_folders:
-                        delete_folder(client, profile_id, name, existing_folders[name])
-                        deletion_occurred = True
-
+                        folders_to_delete.append((name, existing_folders[name]))
+
+                if folders_to_delete:
+                    # Parallelize deletion: Use 5 workers to speed up deletions without hammering the API too hard
+                    with concurrent.futures.ThreadPoolExecutor(max_workers=5) as executor:
+                        futures = [
+                            executor.submit(delete_folder, client, profile_id, name, folder_id)
+                            for name, folder_id in folders_to_delete
+                        ]
+                        for future in concurrent.futures.as_completed(futures):
+                            if future.result():
+                                deletion_occurred = True
+
                 # CRITICAL FIX: Increased wait time for massive folders to clear
                 if deletion_occurred:
                     if not USE_COLORS: