You can delete any stamp from your account, when required. Place the mouse pointer on the target stamp and the delete icon appears, as below.
Click on delete icon and Stampery asks you to write DELETE text to confirm your action, as below.
Write DELETE and click on Ok button. The stamp is deleted.