Getting started
Rules Engine Widgets
Apify Scraper
4 min
purpose to scrape, crawl, or extract data from websites and apis using apify’s automation platform this node integrates with the apify api to trigger actors, retrieve datasets, and bring structured data directly into your workflow problem statement collecting real time web data can be challenging and time consuming when done manually developers often need a simple, automated solution to trigger apify scrapers and process their outputs inside workflows the apify scraper node enables seamless integration between your workflow engine and apify’s data scraping infrastructure — without manual api setup requirements must have an apify api token (generated from your apify dashboard) must specify a task id or actor id to run should allow input variables and dataset retrieval must provide real time job status (run, success, error) should output structured json results for downstream processing use cases scrape product details from e commerce sites (amazon, flipkart, etc ) extract real estate or job listing data collect public company information or reviews automate web crawling tasks (social profiles, blogs, etc ) combine scraped data with ai or analytics workflows outcome triggers an apify actor or task, waits for completion, and returns the scraped dataset as a structured json output ready to use in subsequent nodes how to use 1\ add the apify scraper node drag and drop the apify scraper node into your workflow canvas this node connects your workflow directly to the apify platform 2\ authentication enter your apify api token (from your apify account dashboard) 3\ select run mode choose whether to trigger an actor or task 4\ input configuration provide any required input parameters in json format this is passed as the input object to your apify run 5\ output variable name set a variable name to store your scraper results 6\ run & preview once configured click run node to start the apify task or actor the node will execute and fetch the dataset results a preview panel will show the first few records for quick inspection