The Economist

AI models make stuff up. How can hallucinations be controlled?

It is an increasingly familiar experience. A request for help to a large language model (LLM) such as OpenAI’s ChatGPT is promptly met by a response that is confident, coherent and just plain wrong.
The New York Times

The Race to Make A.I. Smaller (and Smarter)

Teaching fewer words to large language models might help them sound more human. By Oliver Whang When it comes to artificial intelligence chatbots, bigger is typically better. Large language models ...
Quanta Magazine

How Distillation Makes AI Models Smaller and Cheaper

The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said ...
Wired

Distillation Can Make AI Models Smaller and Cheaper

The original version of this story appeared in Quanta Magazine. The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it ...
The Economist

Researchers are figuring out how large language models work

TO MOST PEOPLE, the inner workings of a car engine or a computer are a mystery. It might as well be a black box: never mind what goes on inside, as long as it works. Besides, the people who design and ...