They do no harm and, contrary to folklore, the ants' presences does not speed up the blooming process. You'll be glad you did. While they do need the cold weather, if you live in areas that receive little snow and have long periods of very low temperatures...