ChatGPT feels like a technology from Star Trek in every way except one: it’s awfully slow. Waiting for ChatGPT 4 to process a query feels like downloading an mp3 on a dial-up modem. ChatGPT is slow because it’s congested. It already has 100 million unique users, making it the fastest-adopted new technology in history. Every time someone queries ChatGPT, a data centre somewhere in the world powers up and runs some calculations.  But then, that's true for every cloud application. Why is ChatGPT particularly slow?  There is congestion because ChatGPT and other large language models (LLMs) use a special type of…

Want to continue reading?

Introductory offer: Sign up today for just €5 for the first month or €200 for the first year.

Subscribe

Cancel anytime.

Are you already a member? .