The scrapebox dupe remove addon lets you remove duplicate urls and domains for large files.
You can work with files up to 180 million lines.
The addon allows you to merge files together, split them and remove duplicate urls and domains. This is helpful since you can harvest millions of urls with scrapebox. In which case they are stored in the harvester sessions folder.
Then you simply have to filter the files with this addon. Once your done you can split it down to file sizes you can work with in scrapebox.
More videos. New Features. The official iPhone app is here. Get it now.
You were sent this email because you chose to receive updates about new videos uploaded by looplinescrapebox. If you don't want these updates anymore, you can change your preferences by visiting My Subscriptions.
No comments:
Post a Comment