Error: when doing an upgrade

When attempting to upgrade your WageEasy to the latest version and you get the following error:
​An error occurred while trying to replace the existing file:
DeleteFile failed; code 5.
Access is denied.
​
The above error occurs because WageEasy is open. You must close WageEasy. When WageEasy is open, the program files cannot be upgraded.