Tap the image to enter the Detail view.
Then, tap on the Republish icon to remove the image from your Collection.
You also have the option to remove the republish from your Collection from the quick view option.
To do this, tap and hold on the image and slide your finger to the republish icon and release.