ChatGPT doesn’t actual compile and run it’s code. Yesterday it spit out a function that wouldn’t work because it was trying to reassign a const. I saw this and told it “this won’t work as you can’t reassign a const” and then it said “You are right. You can fix this by changing the const to let like this…”
Far from useful when it literally generates broken code at the very simplest of levels.
Aside from that, someone will have to prompt it to generate the right thing, and in a world of possibilities, this is where much of our time as “programmers” will likely be spent. It will not replace, only supplement us like some kind of cyborg implant in our IDE.