ChatGPT feels like a technology from Star Trek in every way except one: it’s awfully slow. Waiting for ChatGPT 4 to process a query feels like downloading an mp3 on a dial-up modem. ChatGPT is slow because it’s congested. It already has 100 million unique users, making it the fastest-adopted new technology in history. Every time someone queries ChatGPT, a data centre somewhere in the world powers up and runs some calculations.  But then, that's true for every cloud application. Why is ChatGPT particularly slow?  There is congestion because ChatGPT and other large language models (LLMs) use a special type of…

Want to continue reading?

Join today with an Annual membership and get full access to The Currency for just €200 (68c per day) or try monthly membership for just €5 for your first month.

Subscribe

Cancel at any time.

Are you already a member? .