CSV is a plain text file. MS Excel export to CSV in system locale. If such file will be opened on machine with other locale, you could get broken text.
All most popular applications like Notepad, WordPad, MS Word, MS Excel support BOM. They will show the file in correct encoding without additional symbols.