ChatGPT feels like a technology from Star Trek in every way except one: it’s awfully slow. Waiting for ChatGPT 4 to process a query feels like downloading an mp3 on a dial-up modem. ChatGPT is slow because it’s congested. It already has 100 million unique users, making it the fastest-adopted new technology in history. Every time someone queries ChatGPT, a data centre somewhere in the world powers up and runs some calculations.  But then, that's true for every cloud application. Why is ChatGPT particularly slow?  There is congestion because ChatGPT and other large language models (LLMs) use a special type of…

Want to read the full story?

Unlock this article – and everything else on The Currency – with an annual membership and receive a free Samsonite Upscape suitcase, retailing at €235, delivered to your door.

Subscribe

Cancel at any time.

Are you already a member? .