“ChatGPT may generate incorrect code because it does not understand the meaning of algorithm problems.” Yutian Tang, University of Glasgow
Confirmation of what I've long suspected based on my own testing. A number of universities are applying a critical eye to otherwise breathless claims by AI companies. The general consensus is that LLM tools are a productivity tool, rather than a replacement for human software developers.