If you have permission to delete issues in the project you can also delete Goal.

Just move the mouse over the Goal and the "delete" button will show up but if you don't have permission you can't delete Goal either