You will only be able to delete a tag entry that you have previously created. This allows you to tidy up those mis-spelled, or out-dated tags. Please note that deletion will only delete the tag if no other user has tagged something else with it, otherwise deletion will just delete your association of that tag for the course.
Deleting is done by highlighting the tag you wish to delete under 'Select...', then clicking the 'Submit' button below.