hard20 pts · first answer countspythonperformance

More threads, no extra throughput

A Python service does heavy pure-Python text preprocessing before calling the model. Raising the thread pool from 4 to 32 did not improve throughput on an 8-core machine. Why?

A.Python threads cannot make network callsB.The model is too smallC.The global interpreter lock lets only one thread run Python code at a time, so CPU-bound work needs multiple processesD.Threads are slower than processes for input and output

← Tail latency at low CPU usage State leaking between requests →