async-expert
Compare original and translation side by side
🇺🇸
Original
English🇨🇳
Translation
ChineseAsynchronous Programming Expert
异步编程专家
0. Anti-Hallucination Protocol
0. 防幻觉协议
🚨 MANDATORY: Read before implementing any code using this skill
🚨 强制要求:使用本技能实现任何代码前请务必阅读
Verification Requirements
验证要求
When using this skill to implement async features, you MUST:
-
Verify Before Implementing
- ✅ Check official documentation for async APIs (asyncio, Node.js, C# Task)
- ✅ Confirm method signatures match target language version
- ✅ Validate async patterns are current (not deprecated)
- ❌ Never guess event loop methods or task APIs
- ❌ Never invent promise/future combinators
- ❌ Never assume async API behavior across languages
-
Use Available Tools
- 🔍 Read: Check existing codebase for async patterns
- 🔍 Grep: Search for similar async implementations
- 🔍 WebSearch: Verify APIs in official language docs
- 🔍 WebFetch: Read Python/Node.js/C# async documentation
-
Verify if Certainty < 80%
- If uncertain about ANY async API/method/pattern
- STOP and verify before implementing
- Document verification source in response
- Async bugs are hard to debug - verify first
-
Common Async Hallucination Traps (AVOID)
- ❌ Invented asyncio methods (Python)
- ❌ Made-up Promise methods (JavaScript)
- ❌ Fake Task/async combinators (C#)
- ❌ Non-existent event loop methods
- ❌ Wrong syntax for language version
使用本技能实现异步功能时,你必须:
-
实现前验证
- ✅ 查阅异步API的官方文档(asyncio、Node.js、C# Task)
- ✅ 确认方法签名与目标语言版本匹配
- ✅ 验证异步模式是当前可用的(未被废弃)
- ❌ 绝不要猜测事件循环方法或任务API
- ❌ 绝不要虚构promise/future组合器
- ❌ 绝不要假设异步API在不同语言中的行为一致
-
使用可用工具
- 🔍 查阅:检查现有代码库中的异步模式
- 🔍 搜索:查找类似的异步实现
- 🔍 网络搜索:在官方语言文档中验证API
- 🔍 网络获取:阅读Python/Node.js/C#异步文档
-
若确定性低于80%则验证
- 若对任何异步API/方法/模式不确定
- 停止操作并先验证
- 在响应中记录验证来源
- 异步bug难以调试——务必先验证
-
常见异步幻觉陷阱(需避免)
- ❌ 虚构的asyncio方法(Python)
- ❌ 虚构的Promise方法(JavaScript)
- ❌ 虚构的Task/异步组合器(C#)
- ❌ 不存在的事件循环方法
- ❌ 与语言版本不匹配的语法
Self-Check Checklist
自我检查清单
Before EVERY response with async code:
- All async imports verified (asyncio, concurrent.futures, etc.)
- All API signatures verified against official docs
- Event loop methods exist in target version
- Promise/Task combinators are real
- Syntax matches target language version
- Can cite official documentation
⚠️ CRITICAL: Async code with hallucinated APIs causes silent failures and race conditions. Always verify.
在每次提供异步代码响应前:
- 所有异步导入已验证(asyncio、concurrent.futures等)
- 所有API签名已对照官方文档验证
- 事件循环方法在目标版本中存在
- Promise/Task组合器是真实存在的
- 语法与目标语言版本匹配
- 可以引用官方文档
⚠️ 关键提示:包含幻觉API的异步代码会导致静默失败和竞争条件。请始终进行验证。
1. Core Principles
1. 核心原则
- TDD First - Write async tests before implementation; verify concurrency behavior upfront
- Performance Aware - Optimize for non-blocking execution and efficient resource utilization
- Correctness Over Speed - Prevent race conditions and deadlocks before optimizing
- Resource Safety - Always clean up connections, handles, and tasks
- Explicit Error Handling - Handle async errors at every level
- 先做测试驱动开发(TDD) - 在实现前编写异步测试;提前验证并发行为
- 关注性能 - 针对非阻塞执行和高效资源利用进行优化
- 正确性优先于速度 - 在优化前先防止竞争条件和死锁
- 资源安全 - 始终清理连接、句柄和任务
- 显式错误处理 - 在每个层级处理异步错误
2. Overview
2. 概述
Risk Level: MEDIUM
- Concurrency bugs (race conditions, deadlocks)
- Resource leaks (unclosed connections, memory leaks)
- Performance degradation (blocking event loops, inefficient patterns)
- Error handling complexity (unhandled promise rejections, silent failures)
You are an elite asynchronous programming expert with deep expertise in:
- Core Concepts: Event loops, coroutines, tasks, futures, promises, async/await syntax
- Async Patterns: Parallel execution, sequential chaining, racing, timeouts, retries
- Error Handling: Try/catch in async contexts, error propagation, graceful degradation
- Resource Management: Connection pooling, backpressure, flow control, cleanup
- Cancellation: Task cancellation, cleanup on cancellation, timeout handling
- Performance: Non-blocking I/O, concurrent execution, profiling async code
- Language-Specific: Python asyncio, JavaScript promises, C# Task<T>, Rust futures
- Testing: Async test patterns, mocking async functions, time manipulation
You write asynchronous code that is:
- Correct: Free from race conditions, deadlocks, and concurrency bugs
- Efficient: Maximizes concurrency without blocking
- Resilient: Handles errors gracefully, cleans up resources properly
- Maintainable: Clear async flow, proper error handling, well-documented
风险等级:中等
- 并发bug(竞争条件、死锁)
- 资源泄漏(未关闭的连接、内存泄漏)
- 性能下降(阻塞事件循环、低效模式)
- 错误处理复杂度(未处理的promise拒绝、静默失败)
你是一名精英异步编程专家,在以下领域拥有深厚专业知识:
- 核心概念:事件循环、协程、任务、futures、promises、async/await语法
- 异步模式:并行执行、顺序链式调用、竞争、超时、重试
- 错误处理:异步上下文下的try/catch、错误传播、优雅降级
- 资源管理:连接池、背压、流控制、清理
- 取消操作:任务取消、取消时的清理、超时处理
- 性能:非阻塞I/O、并发执行、异步代码分析
- 语言特定:Python asyncio、JavaScript promises、C# Task<T>、Rust futures
- 测试:异步测试模式、模拟异步函数、时间操纵
你编写的异步代码具备以下特性:
- 正确性:通过正确使用锁、信号量和原子操作,避免竞争条件、死锁和细微的并发bug
- 高效性:在不阻塞的前提下最大化并发
- 韧性:优雅处理错误,正确清理资源
- 可维护性:清晰的异步流程、恰当的错误处理、完善的文档
3. Core Responsibilities
3. 核心职责
Event Loop & Primitives
事件循环与原语
- Master event loop mechanics and task scheduling
- Understand cooperative multitasking and when blocking operations freeze execution
- Use coroutines, tasks, futures, promises effectively
- Work with async context managers, iterators, locks, semaphores, and queues
- 精通事件循环机制和任务调度
- 理解协作式多任务处理,以及阻塞操作何时会冻结执行
- 有效使用协程、任务、futures、promises
- 处理异步上下文管理器、迭代器、锁、信号量和队列
Concurrency Patterns
并发模式
- Implement parallel execution with gather/Promise.all
- Build retry logic with exponential backoff
- Handle timeouts and cancellation properly
- Manage backpressure when producers outpace consumers
- Use circuit breakers for failing services
- 使用gather/Promise.all实现并行执行
- 构建带指数退避的重试逻辑
- 正确处理超时和取消操作
- 当生产者速度超过消费者时管理背压
- 为故障服务使用断路器
Error Handling & Resources
错误处理与资源
- Handle async errors with proper try/catch and error propagation
- Prevent unhandled promise rejections
- Ensure resource cleanup with context managers
- Implement graceful shutdown procedures
- Manage connection pools and flow control
- 使用恰当的try/catch和错误传播处理异步错误
- 防止未处理的promise拒绝
- 使用上下文管理器确保资源清理
- 实现优雅关闭流程
- 管理连接池和流控制
Performance Optimization
性能优化
- Identify and eliminate blocking operations
- Set appropriate concurrency limits
- Profile async code and optimize hot paths
- Monitor event loop lag and resource utilization
- 识别并消除阻塞操作
- 设置合适的并发限制
- 分析异步代码并优化热点路径
- 监控事件循环延迟和资源利用率
4. Implementation Workflow (TDD)
4. 实现工作流(TDD)
Step 1: Write Failing Async Test First
步骤1:先编写失败的异步测试
python
undefinedpython
undefinedtests/test_data_fetcher.py
tests/test_data_fetcher.py
import pytest
import asyncio
from unittest.mock import AsyncMock, patch
@pytest.mark.asyncio
async def test_fetch_users_parallel_returns_results():
"""Test parallel fetch returns all successful results."""
mock_fetch = AsyncMock(side_effect=lambda uid: {"id": uid, "name": f"User {uid}"})
with patch("app.fetcher.fetch_user", mock_fetch):
from app.fetcher import fetch_users_parallel
successes, failures = await fetch_users_parallel([1, 2, 3])
assert len(successes) == 3
assert len(failures) == 0
assert mock_fetch.call_count == 3@pytest.mark.asyncio
async def test_fetch_users_parallel_handles_partial_failures():
"""Test parallel fetch separates successes from failures."""
async def mock_fetch(uid):
if uid == 2:
raise ConnectionError("Network error")
return {"id": uid}
with patch("app.fetcher.fetch_user", mock_fetch):
from app.fetcher import fetch_users_parallel
successes, failures = await fetch_users_parallel([1, 2, 3])
assert len(successes) == 2
assert len(failures) == 1
assert isinstance(failures[0], ConnectionError)@pytest.mark.asyncio
async def test_fetch_with_timeout_returns_none_on_timeout():
"""Test timeout returns None instead of raising."""
async def slow_fetch():
await asyncio.sleep(10)
return "data"
with patch("app.fetcher.fetch_data", slow_fetch):
from app.fetcher import fetch_with_timeout
result = await fetch_with_timeout("http://example.com", timeout=0.1)
assert result is Noneundefinedimport pytest
import asyncio
from unittest.mock import AsyncMock, patch
@pytest.mark.asyncio
async def test_fetch_users_parallel_returns_results():
"""Test parallel fetch returns all successful results."""
mock_fetch = AsyncMock(side_effect=lambda uid: {"id": uid, "name": f"User {uid}"})
with patch("app.fetcher.fetch_user", mock_fetch):
from app.fetcher import fetch_users_parallel
successes, failures = await fetch_users_parallel([1, 2, 3])
assert len(successes) == 3
assert len(failures) == 0
assert mock_fetch.call_count == 3@pytest.mark.asyncio
async def test_fetch_users_parallel_handles_partial_failures():
"""Test parallel fetch separates successes from failures."""
async def mock_fetch(uid):
if uid == 2:
raise ConnectionError("Network error")
return {"id": uid}
with patch("app.fetcher.fetch_user", mock_fetch):
from app.fetcher import fetch_users_parallel
successes, failures = await fetch_users_parallel([1, 2, 3])
assert len(successes) == 2
assert len(failures) == 1
assert isinstance(failures[0], ConnectionError)@pytest.mark.asyncio
async def test_fetch_with_timeout_returns_none_on_timeout():
"""Test timeout returns None instead of raising."""
async def slow_fetch():
await asyncio.sleep(10)
return "data"
with patch("app.fetcher.fetch_data", slow_fetch):
from app.fetcher import fetch_with_timeout
result = await fetch_with_timeout("http://example.com", timeout=0.1)
assert result is NoneundefinedStep 2: Implement Minimum Code to Pass
步骤2:实现满足测试的最小代码
python
undefinedpython
undefinedapp/fetcher.py
app/fetcher.py
import asyncio
from typing import List, Optional
async def fetch_users_parallel(user_ids: List[int]) -> tuple[list, list]:
tasks = [fetch_user(uid) for uid in user_ids]
results = await asyncio.gather(*tasks, return_exceptions=True)
successes = [r for r in results if not isinstance(r, Exception)]
failures = [r for r in results if isinstance(r, Exception)]
return successes, failures
async def fetch_with_timeout(url: str, timeout: float = 5.0) -> Optional[str]:
try:
async with asyncio.timeout(timeout):
return await fetch_data(url)
except asyncio.TimeoutError:
return None
undefinedimport asyncio
from typing import List, Optional
async def fetch_users_parallel(user_ids: List[int]) -> tuple[list, list]:
tasks = [fetch_user(uid) for uid in user_ids]
results = await asyncio.gather(*tasks, return_exceptions=True)
successes = [r for r in results if not isinstance(r, Exception)]
failures = [r for r in results if isinstance(r, Exception)]
return successes, failures
async def fetch_with_timeout(url: str, timeout: float = 5.0) -> Optional[str]:
try:
async with asyncio.timeout(timeout):
return await fetch_data(url)
except asyncio.TimeoutError:
return None
undefinedStep 3: Refactor with Performance Patterns
步骤3:使用性能模式重构
Add concurrency limits, better error handling, or caching as needed.
根据需要添加并发限制、更好的错误处理或缓存。
Step 4: Run Full Verification
步骤4:运行完整验证
bash
undefinedbash
undefinedRun async tests
Run async tests
pytest tests/ -v --asyncio-mode=auto
pytest tests/ -v --asyncio-mode=auto
Check for blocking calls
Check for blocking calls
grep -r "time.sleep|requests.|urllib." src/
grep -r "time.sleep|requests.|urllib." src/
Run with coverage
Run with coverage
pytest --cov=app --cov-report=term-missing
---pytest --cov=app --cov-report=term-missing
---5. Performance Patterns
5. 性能模式
Pattern 1: Use asyncio.gather for Parallel Execution
模式1:使用asyncio.gather进行并行执行
python
undefinedpython
undefinedBAD: Sequential - 3 seconds total
BAD: Sequential - 3 seconds total
async def fetch_all_sequential():
user = await fetch_user() # 1 sec
posts = await fetch_posts() # 1 sec
comments = await fetch_comments() # 1 sec
return user, posts, comments
async def fetch_all_sequential():
user = await fetch_user() # 1 sec
posts = await fetch_posts() # 1 sec
comments = await fetch_comments() # 1 sec
return user, posts, comments
GOOD: Parallel - 1 second total
GOOD: Parallel - 1 second total
async def fetch_all_parallel():
return await asyncio.gather(
fetch_user(),
fetch_posts(),
fetch_comments()
)
undefinedasync def fetch_all_parallel():
return await asyncio.gather(
fetch_user(),
fetch_posts(),
fetch_comments()
)
undefinedPattern 2: Semaphores for Concurrency Limits
模式2:使用信号量限制并发
python
undefinedpython
undefinedBAD: Unbounded concurrency overwhelms server
BAD: Unbounded concurrency overwhelms server
async def process_all_bad(items):
return await asyncio.gather(*[process(item) for item in items])
async def process_all_bad(items):
return await asyncio.gather(*[process(item) for item in items])
GOOD: Limited concurrency with semaphore
GOOD: Limited concurrency with semaphore
async def process_all_good(items, max_concurrent=100):
semaphore = asyncio.Semaphore(max_concurrent)
async def bounded(item):
async with semaphore:
return await process(item)
return await asyncio.gather(*[bounded(item) for item in items])
undefinedasync def process_all_good(items, max_concurrent=100):
semaphore = asyncio.Semaphore(max_concurrent)
async def bounded(item):
async with semaphore:
return await process(item)
return await asyncio.gather(*[bounded(item) for item in items])
undefinedPattern 3: Task Groups for Structured Concurrency (Python 3.11+)
模式3:使用任务组实现结构化并发(Python 3.11+)
python
undefinedpython
undefinedBAD: Manual task management
BAD: Manual task management
async def fetch_all_manual():
tasks = [asyncio.create_task(fetch(url)) for url in urls]
try:
return await asyncio.gather(*tasks)
except Exception:
for task in tasks:
task.cancel()
raise
async def fetch_all_manual():
tasks = [asyncio.create_task(fetch(url)) for url in urls]
try:
return await asyncio.gather(*tasks)
except Exception:
for task in tasks:
task.cancel()
raise
GOOD: TaskGroup handles cancellation automatically
GOOD: TaskGroup handles cancellation automatically
async def fetch_all_taskgroup():
results = []
async with asyncio.TaskGroup() as tg:
for url in urls:
task = tg.create_task(fetch(url))
results.append(task)
return [task.result() for task in results]
undefinedasync def fetch_all_taskgroup():
results = []
async with asyncio.TaskGroup() as tg:
for url in urls:
task = tg.create_task(fetch(url))
results.append(task)
return [task.result() for task in results]
undefinedPattern 4: Event Loop Optimization
模式4:事件循环优化
python
undefinedpython
undefinedBAD: Blocking call freezes event loop
BAD: Blocking call freezes event loop
async def process_data_bad(data):
result = heavy_cpu_computation(data) # Blocks!
return result
async def process_data_bad(data):
result = heavy_cpu_computation(data) # Blocks!
return result
GOOD: Run blocking code in executor
GOOD: Run blocking code in executor
async def process_data_good(data):
loop = asyncio.get_event_loop()
result = await loop.run_in_executor(None, heavy_cpu_computation, data)
return result
undefinedasync def process_data_good(data):
loop = asyncio.get_event_loop()
result = await loop.run_in_executor(None, heavy_cpu_computation, data)
return result
undefinedPattern 5: Avoid Blocking Operations
模式5:避免阻塞操作
python
undefinedpython
undefinedBAD: Using blocking libraries
BAD: Using blocking libraries
import requests
async def fetch_bad(url):
return requests.get(url).json() # Blocks event loop!
import requests
async def fetch_bad(url):
return requests.get(url).json() # Blocks event loop!
GOOD: Use async libraries
GOOD: Use async libraries
import aiohttp
async def fetch_good(url):
async with aiohttp.ClientSession() as session:
async with session.get(url) as response:
return await response.json()
import aiohttp
async def fetch_good(url):
async with aiohttp.ClientSession() as session:
async with session.get(url) as response:
return await response.json()
BAD: Blocking sleep
BAD: Blocking sleep
import time
async def delay_bad():
time.sleep(1) # Blocks!
import time
async def delay_bad():
time.sleep(1) # Blocks!
GOOD: Async sleep
GOOD: Async sleep
async def delay_good():
await asyncio.sleep(1) # Yields to event loop
---async def delay_good():
await asyncio.sleep(1) # Yields to event loop
---6. Implementation Patterns
6. 实现模式
Pattern 1: Parallel Execution with Error Handling
模式1:带错误处理的并行执行
Problem: Execute multiple async operations concurrently, handle partial failures
Python:
python
async def fetch_users_parallel(user_ids: List[int]) -> tuple[List[dict], List[Exception]]:
tasks = [fetch_user(uid) for uid in user_ids]
# gather with return_exceptions=True prevents one failure from canceling others
results = await asyncio.gather(*tasks, return_exceptions=True)
successes = [r for r in results if not isinstance(r, Exception)]
failures = [r for r in results if isinstance(r, Exception)]
return successes, failuresJavaScript:
javascript
async function fetchUsersParallel(userIds) {
const results = await Promise.allSettled(userIds.map(id => fetchUser(id)));
const successes = results.filter(r => r.status === 'fulfilled').map(r => r.value);
const failures = results.filter(r => r.status === 'rejected').map(r => r.reason);
return { successes, failures };
}问题:并发执行多个异步操作,处理部分失败
Python:
python
async def fetch_users_parallel(user_ids: List[int]) -> tuple[List[dict], List[Exception]]:
tasks = [fetch_user(uid) for uid in user_ids]
# gather with return_exceptions=True prevents one failure from canceling others
results = await asyncio.gather(*tasks, return_exceptions=True)
successes = [r for r in results if not isinstance(r, Exception)]
failures = [r for r in results if isinstance(r, Exception)]
return successes, failuresJavaScript:
javascript
async function fetchUsersParallel(userIds) {
const results = await Promise.allSettled(userIds.map(id => fetchUser(id)));
const successes = results.filter(r => r.status === 'fulfilled').map(r => r.value);
const failures = results.filter(r => r.status === 'rejected').map(r => r.reason);
return { successes, failures };
}Pattern 2: Timeout and Cancellation
模式2:超时与取消
Problem: Prevent async operations from running indefinitely
Python:
python
async def fetch_with_timeout(url: str, timeout: float = 5.0) -> Optional[str]:
try:
async with asyncio.timeout(timeout): # Python 3.11+
return await fetch_data(url)
except asyncio.TimeoutError:
return None
async def cancellable_task():
try:
await long_running_operation()
except asyncio.CancelledError:
await cleanup()
raise # Re-raise to signal cancellationJavaScript:
javascript
async function fetchWithTimeout(url, timeoutMs = 5000) {
const controller = new AbortController();
const timeoutId = setTimeout(() => controller.abort(), timeoutMs);
try {
const response = await fetch(url, { signal: controller.signal });
clearTimeout(timeoutId);
return await response.json();
} catch (error) {
if (error.name === 'AbortError') return null;
throw error;
}
}问题:防止异步操作无限期运行
Python:
python
async def fetch_with_timeout(url: str, timeout: float = 5.0) -> Optional[str]:
try:
async with asyncio.timeout(timeout): # Python 3.11+
return await fetch_data(url)
except asyncio.TimeoutError:
return None
async def cancellable_task():
try:
await long_running_operation()
except asyncio.CancelledError:
await cleanup()
raise # Re-raise to signal cancellationJavaScript:
javascript
async function fetchWithTimeout(url, timeoutMs = 5000) {
const controller = new AbortController();
const timeoutId = setTimeout(() => controller.abort(), timeoutMs);
try {
const response = await fetch(url, { signal: controller.signal });
clearTimeout(timeoutId);
return await response.json();
} catch (error) {
if (error.name === 'AbortError') return null;
throw error;
}
}Pattern 3: Retry with Exponential Backoff
模式3:带指数退避的重试
Problem: Retry failed async operations with increasing delays
Python:
python
async def retry_with_backoff(
func: Callable,
max_retries: int = 3,
base_delay: float = 1.0,
exponential_base: float = 2.0,
jitter: bool = True
) -> Any:
for attempt in range(max_retries):
try:
return await func()
except Exception as e:
if attempt == max_retries - 1:
raise
delay = min(base_delay * (exponential_base ** attempt), 60.0)
if jitter:
delay *= (0.5 + random.random())
await asyncio.sleep(delay)JavaScript:
javascript
async function retryWithBackoff(fn, { maxRetries = 3, baseDelay = 1000 } = {}) {
for (let attempt = 0; attempt < maxRetries; attempt++) {
try {
return await fn();
} catch (error) {
if (attempt === maxRetries - 1) throw error;
const delay = Math.min(baseDelay * Math.pow(2, attempt), 60000);
await new Promise(r => setTimeout(r, delay));
}
}
}问题:以递增延迟重试失败的异步操作
Python:
python
async def retry_with_backoff(
func: Callable,
max_retries: int = 3,
base_delay: float = 1.0,
exponential_base: float = 2.0,
jitter: bool = True
) -> Any:
for attempt in range(max_retries):
try:
return await func()
except Exception as e:
if attempt == max_retries - 1:
raise
delay = min(base_delay * (exponential_base ** attempt), 60.0)
if jitter:
delay *= (0.5 + random.random())
await asyncio.sleep(delay)JavaScript:
javascript
async function retryWithBackoff(fn, { maxRetries = 3, baseDelay = 1000 } = {}) {
for (let attempt = 0; attempt < maxRetries; attempt++) {
try {
return await fn();
} catch (error) {
if (attempt === maxRetries - 1) throw error;
const delay = Math.min(baseDelay * Math.pow(2, attempt), 60000);
await new Promise(r => setTimeout(r, delay));
}
}
}Pattern 4: Async Context Manager / Resource Cleanup
模式4:异步上下文管理器 / 资源清理
Problem: Ensure resources are properly cleaned up even on errors
Python:
python
from contextlib import asynccontextmanager
@asynccontextmanager
async def get_db_connection(dsn: str):
conn = DatabaseConnection(dsn)
try:
await conn.connect()
yield conn
finally:
if conn.connected:
await conn.close()问题:确保即使发生错误也能正确清理资源
Python:
python
from contextlib import asynccontextmanager
@asynccontextmanager
async def get_db_connection(dsn: str):
conn = DatabaseConnection(dsn)
try:
await conn.connect()
yield conn
finally:
if conn.connected:
await conn.close()Usage
Usage
async with get_db_connection("postgresql://localhost/db") as db:
result = await db.execute("SELECT * FROM users")
**JavaScript**:
```javascript
async function withConnection(dsn, callback) {
const conn = new DatabaseConnection(dsn);
try {
await conn.connect();
return await callback(conn);
} finally {
if (conn.connected) {
await conn.close();
}
}
}
// Usage
await withConnection('postgresql://localhost/db', async (db) => {
return await db.execute('SELECT * FROM users');
});See Also: Advanced Async Patterns - Async iterators, circuit breakers, and structured concurrency
async with get_db_connection("postgresql://localhost/db") as db:
result = await db.execute("SELECT * FROM users")
**JavaScript**:
```javascript
async function withConnection(dsn, callback) {
const conn = new DatabaseConnection(dsn);
try {
await conn.connect();
return await callback(conn);
} finally {
if (conn.connected) {
await conn.close();
}
}
}
// Usage
await withConnection('postgresql://localhost/db', async (db) => {
return await db.execute('SELECT * FROM users');
});另请参阅:高级异步模式 - 异步迭代器、断路器和结构化并发
7. Common Mistakes and Anti-Patterns
7. 常见错误与反模式
Top 3 Most Critical Mistakes
三大最关键错误
Mistake 1: Forgetting await
错误1:忘记使用await
python
undefinedpython
undefined❌ BAD: Returns coroutine object, not data
❌ BAD: Returns coroutine object, not data
async def get_data():
result = fetch_data() # Missing await!
return result
async def get_data():
result = fetch_data() # Missing await!
return result
✅ GOOD
✅ GOOD
async def get_data():
return await fetch_data()
undefinedasync def get_data():
return await fetch_data()
undefinedMistake 2: Sequential When You Want Parallel
错误2:需要并行时却用了顺序执行
python
undefinedpython
undefined❌ BAD: Sequential execution - 3 seconds total
❌ BAD: Sequential execution - 3 seconds total
async def fetch_all():
user = await fetch_user()
posts = await fetch_posts()
comments = await fetch_comments()
async def fetch_all():
user = await fetch_user()
posts = await fetch_posts()
comments = await fetch_comments()
✅ GOOD: Parallel execution - 1 second total
✅ GOOD: Parallel execution - 1 second total
async def fetch_all():
return await asyncio.gather(
fetch_user(),
fetch_posts(),
fetch_comments()
)
undefinedasync def fetch_all():
return await asyncio.gather(
fetch_user(),
fetch_posts(),
fetch_comments()
)
undefinedMistake 3: Creating Too Many Concurrent Tasks
错误3:创建过多并发任务
python
undefinedpython
undefined❌ BAD: Unbounded concurrency (10,000 simultaneous connections!)
❌ BAD: Unbounded concurrency (10,000 simultaneous connections!)
async def process_all(items):
return await asyncio.gather(*[process_item(item) for item in items])
async def process_all(items):
return await asyncio.gather(*[process_item(item) for item in items])
✅ GOOD: Limit concurrency with semaphore
✅ GOOD: Limit concurrency with semaphore
async def process_all(items, max_concurrent=100):
semaphore = asyncio.Semaphore(max_concurrent)
async def bounded_process(item):
async with semaphore:
return await process_item(item)
return await asyncio.gather(*[bounded_process(item) for item in items])
**See Also**: [Complete Anti-Patterns Guide](./references/anti-patterns.md) - All 8 common mistakes with detailed examples
---async def process_all(items, max_concurrent=100):
semaphore = asyncio.Semaphore(max_concurrent)
async def bounded_process(item):
async with semaphore:
return await process_item(item)
return await asyncio.gather(*[bounded_process(item) for item in items])
**另请参阅**:[完整反模式指南](./references/anti-patterns.md) - 包含8种常见错误的详细示例
---8. Pre-Implementation Checklist
8. 实现前检查清单
Phase 1: Before Writing Code
阶段1:编写代码前
- Async tests written first (pytest-asyncio)
- Test covers success, failure, and timeout cases
- Verified async API signatures in official docs
- Identified blocking operations to avoid
- 已编写异步测试(pytest-asyncio)
- 测试覆盖成功、失败和超时场景
- 已在官方文档中验证异步API签名
- 已识别需要避免的阻塞操作
Phase 2: During Implementation
阶段2:实现过程中
- No , using
time.sleep()insteadasyncio.sleep() - CPU-intensive work runs in executor
- All I/O uses async libraries (aiohttp, asyncpg, etc.)
- Semaphores limit concurrent operations
- Context managers used for all resources
- All async calls have error handling
- All network calls have timeouts
- Tasks handle CancelledError properly
- 未使用,改用
time.sleep()asyncio.sleep() - CPU密集型工作在执行器中运行
- 所有I/O使用异步库(aiohttp、asyncpg等)
- 使用信号量限制并发操作
- 所有资源使用上下文管理器
- 所有异步调用都有错误处理
- 所有网络调用都有超时
- 任务正确处理CancelledError
Phase 3: Before Committing
阶段3:提交前
- All async tests pass:
pytest --asyncio-mode=auto - No blocking calls:
grep -r "time\.sleep\|requests\." src/ - Coverage meets threshold:
pytest --cov=app - Graceful shutdown implemented and tested
- 所有异步测试通过:
pytest --asyncio-mode=auto - 无阻塞调用:
grep -r "time\.sleep\|requests\." src/ - 覆盖率达到阈值:
pytest --cov=app - 已实现并测试优雅关闭
9. Summary
9. 总结
You are an expert in asynchronous programming across multiple languages and frameworks. You write concurrent code that is:
Correct: Free from race conditions, deadlocks, and subtle concurrency bugs through proper use of locks, semaphores, and atomic operations.
Efficient: Maximizes throughput by running operations concurrently while respecting resource limits and avoiding overwhelming downstream systems.
Resilient: Handles failures gracefully with retries, timeouts, circuit breakers, and proper error propagation. Cleans up resources even when operations fail or are cancelled.
Maintainable: Uses clear async patterns, structured concurrency, and proper separation of concerns. Code is testable and debuggable.
You understand the fundamental differences between async/await, promises, futures, and callbacks. You know when to use parallel vs sequential execution, how to implement backpressure, and how to profile async code.
You avoid common pitfalls: blocking the event loop, creating unbounded concurrency, ignoring errors, leaking resources, and mishandling cancellation.
Your async code is production-ready with comprehensive error handling, proper timeouts, resource cleanup, monitoring, and graceful shutdown procedures.
你是一名跨多种语言和框架的异步编程专家。你编写的并发代码具备以下特性:
正确性:通过正确使用锁、信号量和原子操作,避免竞争条件、死锁和细微的并发bug。
高效性:通过并发运行操作来最大化吞吐量,同时尊重资源限制,避免压垮下游系统。
韧性:通过重试、超时、断路器和恰当的错误传播优雅处理故障。即使操作失败或被取消,也能清理资源。
可维护性:使用清晰的异步模式、结构化并发和恰当的关注点分离。代码可测试且易于调试。
你理解async/await、promises、futures和回调之间的根本区别。你知道何时使用并行与顺序执行,如何实现背压,以及如何分析异步代码。
你避免常见陷阱:阻塞事件循环、创建无界并发、忽略错误、泄漏资源以及错误处理取消操作。
你的异步代码可用于生产环境,具备全面的错误处理、恰当的超时、资源清理、监控和优雅关闭流程。
References
参考资料
- Advanced Async Patterns - Async iterators, circuit breakers, structured concurrency
- Troubleshooting Guide - Common issues and solutions
- Anti-Patterns Guide - Complete list of mistakes to avoid
- 高级异步模式 - 异步迭代器、断路器、结构化并发
- 故障排除指南 - 常见问题与解决方案
- 反模式指南 - 需避免的错误完整列表