How To Build Servers That Don't Crash When Overloaded
kartick.substack.com
A server has a certain capacity, say, 400 requests / sec. What happens if it’s overloaded to 600 rps? Ideally, it should process 400 rps successfully, while erroring out the remaining 200. Unfortunately, overloaded servers often generate fewer successful responses, such as 200 successful responses and 400 failures, as this infographic shows:
How To Build Servers That Don't Crash When Overloaded
How To Build Servers That Don't Crash When…
How To Build Servers That Don't Crash When Overloaded
A server has a certain capacity, say, 400 requests / sec. What happens if it’s overloaded to 600 rps? Ideally, it should process 400 rps successfully, while erroring out the remaining 200. Unfortunately, overloaded servers often generate fewer successful responses, such as 200 successful responses and 400 failures, as this infographic shows: