I'm finding that the stronger the LLM, the farther the 'frontier' of obscurity before it hallucinates gets. Mistral-7B-instruct is nice to talk to, but it's pretty easy to come up with a topic that it knows nothing about. ChatGPT4 is a lot better, but past a certain point it'll start going wonky too.

For learning to code I suspect that with a strong enough version of GPT a new user won't hit the limits, and if it goes wrong having to debug isn't a bad thing ;)