Why AI Tokens are so Expensive - Computerphile

Computerphile explains that AI tokens are expensive because large language models must repeatedly process every input and output token from scratch (especially in long contexts and autonomous coding tasks) causing computational demands and costs to scale rapidly with usage.