Transcript of records is full of grammatical/spelling/formatting mistakes and the issuer gets angry when I inform them Institution in a non-English-speaking country.
I do not speak the native language of that country.
I studied entirely in English language and all of my educational documents are originally issued/generated in English, therefore there is no possibility of receiving the document of interest in a language other than English (Patricia Shanahan's answer is thus absolutely irrelevant [this answer]).

Types of errors in the transcript of records

Grammatical
Incorrect course titles
Initial letters of some of the course names are capitalized, some are not
Margins, line spacing, and the overall format/style of the document (pure chaos, ...)
Incorrect usage of the in course titles (e.g. Introduction to the Mathematics)

I have been dealing this issue for more than a year. My BA degree's transcript of records is full of mistakes, not one or two, but dozens of them.
Last year, when I received the transcript for the first six completed semesters, there were so many errors in the document that I simply could not believe some other student might not have noticed it throughout the years. Thus, I went to discuss this with the person issuing the transcript. I delineated all of the mistakes one by one. However, they were absolutely reluctant to modify any part of the transcript at first, and they even went on to tell me that I am wrong. I then decided to provide examples of transcripts issued in the US and use online resources and dictionaries to prove my point, which all in turn made the said person annoyed and yet more reluctant! More surprisingly for me was their reaction when I explained the margins/line-spacing/style/format issues, their simple reply was whether I have ever been diagnosed with OCD.
Nonetheless, I was able to fix quite many of the mistakes. Now, a year later, I have received my final bachelor's degree with the complete transcript of records encompassing eight semesters. And, there are still a lot of mistakes: grammatical, spelling, and incorrect course names. The format of the document looks terribly unprofessional, with different margin sizes on different pages, inconsistent line spacing, and unnecessary white spaces/blank areas. It looks like a cheap document issued by a 'nobody'. If it was not for the huge seal of the university and the Ministry of Education on each page, anyone would have considered this document to be fake.
The person in charge is so selfish they do not want to admit that their English is insufficient. Their lexicon is extremely limited. Once they were so enraged when I mentioned a simple mistake  that they actually had to call the English Language Center of my university. However, the center affirmed that indeed the version I have provided is correct and the one written on the transcript is wrong. However, even after that incident the person in charge of issuing the transcript were still reluctant to follow many of my corrections.
How should I deal with the incompetence and reluctance of this person?
Should I create the document neatly myself in LaTeX/Word, clearly highlighting all the changes I have made, and then ask him to consider issuing the document that way?
I suggest requesting a copy of the transcript in whatever language the issuer writes best.

For some purposes, such as graduate admission to a foreign university, you may need to pay for a certified translation by a professional translator.