Not all worms are bad. some are actually pretty good scavengers but ALL of them looks ugly.
You want want to dip everything, be prepared to go through your entire cycling process again......
Else maybe you wanna ping Wilson, Desi & Raydiative to see how they do their worm hunting at night.
If only a few colonies of zoas, you can try dipping them 1st and see if they opens up.
If they do, then you don't have to go through the trouble.