Web scraping software
Web scraping software
Out of context: Reply #1
- Started
- Last post
- 7 Responses
- vaxorcist0
I'd have to know alot more about what you intend to scrape to know if it's likely to work in pre-existing web scraping systems.... some E-commerce systems are easy, some very hard, depending on alot of things, like search term results, spidering, and code variability....
Note that most web scraping tools may generate data much more complex than you want.... I've written web scraping code for people who have tried packaged solutions but found them generating lots of random stuff, not usefully organized data....
But.... sometimes it's more simple than you intend, sometimes harder... be aware that depending on other sites code may cause hiccups every so often when they change things with no notice...