If your plant is not growing much yet, do not worry. Let the water set in an open container for a couple days and the chlorine will dissipate. You can fill the gap with an insulating material like Styrofoam, crumpled newspaper, dead leaves, or more potting...