Client–server model: HTTP requests, caching and queues

Computer ScienceNetworks & the InternetAges 17–18

Many clients keep sending HTTP requests to one server. A request that hits the cache is answered instantly, while the rest must queue and wait for the server, which processes them one by one at a rate that depends on page size and bandwidth. Students raise the number of users to watch the queue grow and response time spike once demand outruns capacity, then raise the cache hit rate or bandwidth to bring the system back to normal.