So in 'Moderators' you can add groups/individuals as moderators, but there is no way to remove them:
If you edit the 'Moderator' you can change the group, but not just get rid of the row entirely.
Short term workaround would be to create a dummy group or some such- but we need to change the ui in there to allow deleting.