📄️ Adding a List of URLs
Managing an Extractor's URL List
📄️ Using the URL Generator
The URL generator is the quickest way to generate multiple URLs by using the patterns in the URLs. The following examples show how URL parameters might vary for items like categories, search terms, and page numbers.
📄️ Extracting URLs with Chained Extractors
Many websites, provide a listings of products or a list of search results with links to each product page that has more details. To retrieve the details for all the products you can build two extractors, to create what we call chained extractors. The parent extractor captures a list of URLs (links) to the product pages. The child extractor uses the output from the first extractor to collect data for the individual products. This method is known as chaining extractors.