Holding the Shift key with the selection arrow will:
Add or subtract entities from your selection
Only add entities to your selection
Only subtract entities from your selection
Deselect all