When it comes to web scraping with a real browser,
There are darn few reasons for doing this if you're ethical and want to respect what people wrote in their robots.txt. I'm assuming the worst about you.
There are lots of ethical uses for these sort of scraping tools, a very basic example being the year’s worth of our own transaction data I need to do my family’s taxes each year which an idiot bank only allows me to download via a poorly-formatted PDF, each page of which is a single download using the same file name that contains at most 25 entries.
As my highschool English teacher taught me, don’t assume: it makes an ass out of you and an ass out of me.
When it comes to web scraping with a real browser,
There are darn few reasons for doing this if you're ethical and want to respect what people wrote in their robots.txt. I'm assuming the worst about you.
There are lots of ethical uses for these sort of scraping tools, a very basic example being the year’s worth of our own transaction data I need to do my family’s taxes each year which an idiot bank only allows me to download via a poorly-formatted PDF, each page of which is a single download using the same file name that contains at most 25 entries.
As my highschool English teacher taught me, don’t assume: it makes an ass out of you and an ass out of me.