I can confirm this happens with at least the latest Mac release (2.5.2) and with the stock parts. It has been bothering me for a while but the workaround I've found is to hide the wrong selections until I can select the thing I want and unhide everything once I'm done with the object I wanted to select.