tool__website-map-and-scrape
★ 6.8 · n8n · medium · 6 nodes
tool__website-map-and-scrape is an n8n automation template that triggers via webhook and uses Firecrawl to crawl and scrape websites — mapping all URLs and extracting page content into a structured output. Reach for it when you need to automatically collect every URL from a site before processing, when manually copying text from dozens of pages is slowing you down, or when you want to snapshot a site's content for further use in a data pipeline. Trigger: Webhook. Integrations: Firecrawl (site map + scrape). The workflow is imported as a JSON file into any n8n instance — cloud or self-hosted — with no additional setup beyond valid Firecrawl credentials. Direction: outbound data collection from web pages, not publishing or pushing content to a site. Use only on sites you own or are authorized to crawl, respecting robots.txt and the target site's terms of service. Works well for content audits, dataset building, and site structure analysis; not suitable where the target platform explicitly prohibits automated access or requires login without permission.
- #Firecrawl