Worker Pool Patterns

Also Known As

TL;DR

Explanation

A worker pool maintains N pre-spawned workers ready to accept tasks. Benefits: no per-task spawn overhead (50ms each), bounded resource usage, backpressure. PHP implementations: amphp/parallel for process pools, Laravel Horizon for queue workers.

Common Misconception

Why It Matters

Common Mistakes

• Pool larger than CPU cores for CPU-bound work
• No backpressure
• Not restarting crashed workers
• Shared mutable state between workers

Code Examples

foreach ($images as $img) { $p = new Process(['php','resize.php',$img]); $p->start(); }

$pool = new DefaultPool(8);
$promises = array_map(fn($img) => $pool->enqueue(new CallableTask('resize',[$img])), $images);
await Promise\all($promises);

References

• ↗ https://amphp.org/parallel

Tags

Related Terms