It does indeed break down, but unless you have a very wet environment it shouldn't get moldy. The highest quality hay will have few to no seeds, but some are inevitable. Instead, it will start to compost, creating a rich layer of nutrients for your plants.