tech
Using synthetic data for AI training is 'a big mistake,' says AI pioneer Rich Sutton
He said that the AI industry is headed in the wrong direction because of its reliance on synthetic training data.
TL;DR
- Rich Sutton, a pioneer in AI technology, criticizes the AI industry's reliance on synthetic training data.
- He argues that synthetic data, artificially produced by algorithms, is an inadequate substitute for real-world information.
- Sutton emphasizes the importance of real experiential data, which AI agents obtain by interacting with their environment.
- He co-founded Oak Lab to develop AI agents that learn continuously from their own experiences.
- Big Tech companies are increasingly seeking proprietary, real-world datasets to train AI models.