What are some examples of using thread pools in Python?

What are some examples of using thread pools in Python?

Thread pools in Python can be implemented using the concurrent.futures.ThreadPoolExecutor. For example, you can use it to manage multiple threads for tasks like web scraping or handling I/O-bound operations.

Can you show me a simple code example?

Sure! Here's a basic example:

from concurrent.futures import ThreadPoolExecutor
import time

# Function to simulate a task
def task(n):
    time.sleep(1)
    return f'Task {n} completed'

# Using ThreadPoolExecutor
with ThreadPoolExecutor(max_workers=5) as executor:
    results = list(executor.map(task, range(10)))

print(results)

What does this code do?

This code creates a thread pool with a maximum of 5 workers. It runs 10 tasks concurrently, each simulating a delay of 1 second, and collects the results.

Are there any limitations to using thread pools?

Yes, thread pools are best for I/O-bound tasks. For CPU-bound tasks, consider using ProcessPoolExecutor instead, as Python's Global Interpreter Lock (GIL) can limit performance.