Do not remove the label. The label not only lets you know what it growing in the pod, but it also prevents algae from growing in the tank and pod. If the plant is young, it should find its way to the centre hole and all should be well.
If your plant is a bit older, then you can attempt to carefully feed it through the hole. Use something like a toothpick or needle to carefully thread it, instead of your fingers. You may apply too much force with your fingers and damage the plant.