Figured it. If I set my Display Language to en-US then the text displays correctly. If I set it to en-GB it is wrong.
Not sure if that is an error in Windows passing the language to the driver, or the driver processing it wrong. In either case it should fall back to some sort of system default rather than chinese...