Technically it's competing for resources with the main plant (water, nutrition, space for roots in the pot, leaf space for light), but I don't know whether it's a big drain on those resources or not. I usually pluck out the clover for cosmetic reasons.