fix(scrapy): async-thread startup race, shutdown lifecycle, and timeout setting #811

Job	Run time
Checks / Actions lint check	30s
PR title check	6s
Checks / Integration tests (3.14, ubuntu-latest)	4m 16s
Checks / E2E tests (3.11, ubuntu-latest)	4m 58s
Checks / Type check / Type check (3.12)	12s
Checks / Spell check	8s
Checks / Type check / Type check (3.13)	13s
Checks / Package check	20s
Checks / Integration tests (3.11, ubuntu-latest)	4m 37s
Checks / Lint check / Lint check (3.11)	9s
Checks / Type check / Type check (3.14)	13s
Checks / Unit tests / Unit tests (windows-latest, 3.12)	1m 41s
Checks / Unit tests / Unit tests (windows-latest, 3.14)	1m 28s
Checks / Unit tests / Unit tests (windows-latest, 3.13)	1m 45s
Checks / Unit tests / Unit tests (ubuntu-latest, 3.12)	1m 13s
Checks / Type check / Type check (3.11)	12s
Checks / Unit tests / Unit tests (ubuntu-latest, 3.13)	1m 14s
Checks / Doc check / Docs check	1m 1s
Checks / Unit tests / Unit tests (windows-latest, 3.11)	1m 53s
Checks / Lint check / Lint check (3.13)	11s
Checks / Unit tests / Unit tests (ubuntu-latest, 3.11)	1m 8s
Checks / E2E tests (3.14, ubuntu-latest)	5m 12s
Checks / Lint check / Lint check (3.12)	11s
Checks / Lint check / Lint check (3.14)	10s
Checks / Unit tests / Unit tests (ubuntu-latest, 3.14)	1m 13s
	34m 14s

Provide feedback