Remember to use responsibly. This characteristic wasn’t created to the purpose to avoid Google’s limits and motivate users to develop many alternative Homes to get indexing facts for every URL on a web site. Google may well change this Restrict (to area etcetera) if it’s abused. Check out the photographs https://romeotools.com/product/screaming-frog/