Ability to exclude known language switchers on pages
Some sights have language switchers, and other links that we would want to avoid following, as they can lead to incomplete scans due to all the links previously scanned becoming invalid. Also the ability to exclude some of the known links could speed up the scan. I envision this as a simple interface where you can enter the URL for the link(s) and a place to remove/edit links.
I agree this would be useful but implementing it would certainly be a challenge. So you would want to skip any page that is a duplicate page of another, the only difference being that it's in a different language?