| The link extractor addon allows you to extract internal links, external links or both from any given url that you choose. This has a wide variety of applications.
http://www.scrapestuff.com/scrapebox-link-extractor-addon-extract-internal-and-external-links-from-domains-and-urls
Many people try to use the site: operator in google to pull internal urls from a domain, for many reasons. Perhaps they are moving to a new host and need to make sure they duplicate all domains. They could use scrapeboxes alive checker addon after the move to verify all urls they scraped are live for instance.
With the site: operator google may ban your IP, and you would need to deal with proxies etc... However with the link extractor you could simply extract internal urls and then take the results and feed them back into the link extractor. You could do this several times and get all the urls of the domain.
There are other applications as well. The addon automatically removes duplicate domains,... |
No comments:
Post a Comment