Sometimes AF selects not the object I need but the one behind it which is really frustrating.

In this video I click on pine trees and AF selects floor tiles which are behind them.

Then without doing anything - moving camera, resizing window - it works correctly.

This uses custom collection (Kay's Halloween kit) but I think I remember it happening with stock meshes too.

I can confirm this happens with at least the latest Mac release (2.5.2) and with the stock parts. It has been bothering me for a while but the workaround I've found is to hide the wrong selections until I can select the thing I want and unhide everything once I'm done with the object I wanted to select.