ChatGPT feels like a technology from Star Trek in every way except one: it’s awfully slow. Waiting for ChatGPT 4 to process a query feels like downloading an mp3 on a dial-up modem. ChatGPT is slow because it’s congested. It already has 100 million unique users, making it the fastest-adopted new technology in history. Every time someone queries ChatGPT, a data centre somewhere in the world powers up and runs some calculations.  But then, that's true for every cloud application. Why is ChatGPT particularly slow?  There is congestion because ChatGPT and other large language models (LLMs) use a special type of…

Want to continue reading?

Introductory offer: Sign up today and pay €200 for an annual membership, a saving of €100.

Subscribe

Cancel anytime.

Are you already a member? .