Scraping-Engine design
Each scrape in Scraping-Engine follows the same set of steps.
- Fetch the configured resource into a Page using a Fetcher
- Parse the Page using a Parser and return a Result
- Store the Result into a configured location
- Notify on success
- If an error occurs, Notify this instead