If the glue is on and dry, it shouldn't have any effect on the glue joint. Been my experience anyway.
That's why I like gluing the fins onto the rocket BEFORE applying carpenters wood filler (CWF) or anything else, unless of course I'm papering the fins, which is better done first, and uses white glue, which is entirely compatible with the wood glue I use to attach the fins, and adds a LOT of strength, as well as making the fins rediculously easy to finish. I've switched to this method virtually completely.