How to evaluate LLM fine tuning?

[Stealthwriter]

After fine tuning, I want to evaluate the new fine tuned LLM, how to know if its accurate? training loss doesn't give you a clear answer.

I spend a lot of time manually evaluating the model, is there an alternative to that?