I had the same problem using microsoft remote desktop on a mac with OSX Yosemite. My symbol keys did not work correctly, for example the \ became < and @ became *. I opened system preferences on my Mac that was running the RD client, and under keyboard I noticed that my input source was set to Canadian English. I added US English, deleted Canadian English, and restarted the remote desktop session. The special characters were typed correctly after that.