Adding Folders with Team Explorer

When adding files under source control, I was having trouble unchecking a particular file.  It would always highlight everything by default, even though there was nothing highlighted.  So if you were to try to uncheck one, all would suddenly select add all would either uncheck or check (depending on the status of the item you had selected)!!!  Clicking on the right Folder column unselects everything.  How annoying!