Adam Keys has some thoughts on this. I like this in particular.

Keep a private list for high signal-to-noise follows. Good friends and people whose ideas I don’t want to miss end up here.

— Ideas for Twittering Better by Adam Keys

I'm still not that much into Twitter. It serves it's purpose, but I don't follow or participate that often.