Permalink
Ilya Sutskever – The age of scaling is ending
In this conversation with Dwarkesh Patel, Ilya Sutskever argues we’re transitioning from the “age of scaling” back to an “age of research.” The logic is straightforward: pre-training is running out of data, and simply throwing more compute at the problem won’t get us to superintelligence — that, according to his estimate, is five to twenty years away, if we solve something more fundamental than scaling.