In the Photos app, you can delete them just like any other image taken with your iPhone:
View attachment 32517
It's possible to prevent Whatsapp from saving images to Photos. Open Whatsapp, select Settings - Chats, and disable "Save to Camera Roll":
View attachment 32518