If you want to delete a reply that you've posted to a comment either publicly or privately you can do that within your Comments dashboard.
Go to the sub-menu item 'Comments' and scroll down.
Find the comment that you replied to.
Select the 3 dots attached to the reply to the right hand side. It will open a dropdown box.
Select delete and remove your reply.