Gerd Leonhard

March 15, 2023

ChatGPT and scaling maximalists

https://www.theatlantic.com/technology/archive/2023/03/openai-gpt-4-parameters-power-debate/673290/

There is no particular reason to assume scaling will resolve these issues. “It hasn’t improved nearly as much as one might hope,” Ernest Davis, a computer-science professor at New York University, told me. “It’s not at all clear to me that any amount of feasible scaling is going to get you there.” It’s not even clear, for that matter, that a purely language-based AI could ever reproduce anything like human intelligence. Speaking and thinking are not the same thing, and mastery of the former in no way guarantees mastery of the latter. Perhaps human-level intelligence also requires visual data or audio data or even physical interaction with the world itself via, say, a robotic body.