Commit 42cf8aa
committed
fix(client/stdio): let callers clean up multiple transports
independently on asyncio (#577)
`stdio_client` wrapped its reader / writer in
`anyio.create_task_group()` inside the async context manager body. The
task group binds its cancel scope to whichever task entered the
generator, and anyio enforces a strict LIFO stack on those scopes
within a single task. If a caller opened two transports from the same
task and then closed them in the order they were opened (FIFO) — which
is what happens in multi-client orchestrators, dependency-injection
containers and pytest fixtures — teardown crashed with:
RuntimeError: Attempted to exit a cancel scope that isn't the
current task's current cancel scope
On the asyncio backend we can spawn the reader / writer with
`asyncio.create_task` instead. The background tasks then live outside
any caller-bound cancel scope, so each transport becomes
self-contained and the cleanup order of two transports no longer
matters. Teardown keeps the documented shutdown sequence (close stdin,
wait for the process with `PROCESS_TERMINATION_TIMEOUT`, escalate to
`_terminate_process_tree`, then close the memory streams) in a shared
`_cleanup_process_and_streams` helper so the two branches can't drift.
On structured-concurrency backends (trio) an anyio task group is still
required — trio intentionally forbids orphan tasks, and cross-task
cleanup is fundamentally incompatible with its model. Those callers
still have to clean up LIFO. The backend dispatch goes through
`sniffio.current_async_library()`.
Regression tests (all asyncio-only):
- `test_stdio_client_supports_fifo_cleanup_on_asyncio` — the exact
scenario from #577. Verified that it FAILS on the pre-fix code
with the original RuntimeError, and passes on the fixed code.
- `test_stdio_client_supports_lifo_cleanup_on_asyncio` — historical
LIFO path must still work unchanged.
- `test_stdio_client_shared_exit_stack_fifo_on_asyncio` — a single
AsyncExitStack around two transports (already LIFO under the hood,
but worth pinning so future refactors cannot silently break it).
All 13 stdio tests pass locally (10 pre-existing + 3 new, 1 Unix-only
sigint test skipped on Windows).
Fixes #5771 parent 3d7b311 commit 42cf8aa
2 files changed
+152
-29
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
1 | 2 | | |
2 | 3 | | |
3 | 4 | | |
| |||
7 | 8 | | |
8 | 9 | | |
9 | 10 | | |
| 11 | + | |
10 | 12 | | |
11 | 13 | | |
12 | 14 | | |
| |||
177 | 179 | | |
178 | 180 | | |
179 | 181 | | |
180 | | - | |
181 | | - | |
182 | | - | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
183 | 194 | | |
184 | | - | |
185 | | - | |
186 | | - | |
187 | | - | |
188 | | - | |
189 | | - | |
190 | | - | |
191 | | - | |
192 | | - | |
193 | | - | |
194 | | - | |
195 | | - | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
196 | 209 | | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
197 | 221 | | |
198 | | - | |
199 | | - | |
200 | | - | |
201 | | - | |
202 | | - | |
203 | | - | |
204 | | - | |
205 | | - | |
206 | | - | |
207 | | - | |
208 | | - | |
209 | | - | |
210 | | - | |
211 | | - | |
| 222 | + | |
| 223 | + | |
| 224 | + | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
| 238 | + | |
| 239 | + | |
| 240 | + | |
| 241 | + | |
| 242 | + | |
| 243 | + | |
| 244 | + | |
| 245 | + | |
212 | 246 | | |
213 | 247 | | |
214 | 248 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
558 | 558 | | |
559 | 559 | | |
560 | 560 | | |
| 561 | + | |
| 562 | + | |
| 563 | + | |
| 564 | + | |
| 565 | + | |
| 566 | + | |
| 567 | + | |
| 568 | + | |
| 569 | + | |
| 570 | + | |
| 571 | + | |
| 572 | + | |
| 573 | + | |
| 574 | + | |
| 575 | + | |
| 576 | + | |
| 577 | + | |
| 578 | + | |
| 579 | + | |
| 580 | + | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
| 586 | + | |
| 587 | + | |
| 588 | + | |
| 589 | + | |
| 590 | + | |
| 591 | + | |
| 592 | + | |
| 593 | + | |
| 594 | + | |
| 595 | + | |
| 596 | + | |
| 597 | + | |
| 598 | + | |
| 599 | + | |
| 600 | + | |
| 601 | + | |
| 602 | + | |
| 603 | + | |
| 604 | + | |
| 605 | + | |
| 606 | + | |
| 607 | + | |
| 608 | + | |
| 609 | + | |
| 610 | + | |
| 611 | + | |
| 612 | + | |
| 613 | + | |
| 614 | + | |
| 615 | + | |
| 616 | + | |
| 617 | + | |
| 618 | + | |
| 619 | + | |
| 620 | + | |
| 621 | + | |
| 622 | + | |
| 623 | + | |
| 624 | + | |
| 625 | + | |
| 626 | + | |
| 627 | + | |
| 628 | + | |
| 629 | + | |
| 630 | + | |
| 631 | + | |
| 632 | + | |
| 633 | + | |
| 634 | + | |
| 635 | + | |
| 636 | + | |
| 637 | + | |
| 638 | + | |
| 639 | + | |
| 640 | + | |
| 641 | + | |
| 642 | + | |
| 643 | + | |
| 644 | + | |
| 645 | + | |
| 646 | + | |
| 647 | + | |
| 648 | + | |
| 649 | + | |
0 commit comments