Problem
How can a service handle normal request loads, peak request loads, and a continuous period of high load without failing?
Solution
Utilize the Decoupled Invocation pattern and separate replies from requests: acknowledge receipt at the service edge, put the request on a reliable queue, and then load-balance and prioritize the handler components that read from the queue.
Comments are closed.