Sounds about right, I had a positive experience when I told my local LLM to refactor a function and add a single argument.

I would not dare letting it loose on a whole source file, because it changes random things giving you more code to review.

In my view current LLM’s do a acceptable job with:

• Adding comments
• Writing docstrings
• Writing git commit messages
• Simple tasks on small pieces of code