Any drawbacks on keeping shutter on continuous?

I don't see any drawbacks on shooting about 4 frames per second. After all we don't keep every single shot we make. Or am I missing something?