Shapes such as circles, paths, rectangles, etc are selected when you click inside their fill regions.
This can hinder work when elements are placed inside other elements.

Take inspiration (and code?) from the wireframe mode (activated by pressing F) selection mechanism, where shapes are selected only when you click the stroke boundaries.