Because controls are just specialized tables. Once you create a table or control it sits in memory. If you remove all reference to it, it'll eventually be picked up by the garbage collector.
As always, the smartest thing to do is only create things when you need them, and reuse as much as possible. The three R's go very well with this.
Reduce - Reuse - Recycle