Add an option to archive app (set to "Inactive") in the options window accessed by the button next to edit app.