zucchini flowers post pollination.

Hi all,Intro: I am growing yellow zucchinis and I pollinated a female flower by hand, using pollen from a pumpkin (which seems to work fine based on other female flowers which underwent the same treatment due to lack of male zucchini flowers. I accidentally broke off the flower a couple of days after pollination. Question: Does this affect the growth of the fruit? the fruit is not growing any larger since then - it is becoming more yellow. The tip where the flower was is not turning brown (still has a tinge of green).Thank you in advance :)