To be fair, LLMs do really good translations

Speaking as a multi-lingual person, they really don’t.

but as with everything you use them for, you need to be familiar with the subject so you catch their mistakes.

Yeah, which is precisely why they’re rubbish at translating things. In order to effectively use it to translate things, you need a good grasp on the source and target language, effectively making the tool useless.