You can change this when you are saving the document as a PDF. When the Save As box pops up, there will be a checked box for Open file after publishing. Uncheck that box to fix the problem. Press Save and the issue should be fixed for any future Save As PDF documents.