If an application does not require an installer, but was not obtained from the App Store, it's possible it may install components on its own. Check with the developer of that app to find out what the recommended uninstall method is. For the most part, though, such apps should uninstall as easily as an App Store app.