n8n Web Scraping: Complete Workflow Tutorial

n8n is the leading open-source workflow automation tool. Combined with Tryb's Agent Vision API, you can automate complex web scraping tasks without writing code.

What You'll Build

A workflow that:

1. Monitors a list of competitor URLs daily
2. Extracts pricing and product information
3. Compares changes from previous scrape
4. Sends alerts to Slack when prices change

Prerequisites

• n8n instance (cloud or self-hosted)
• Tryb account with API key
• Slack webhook URL (optional)

Step 1: Create Tryb Credentials

In n8n, go to Credentials → Add Credential → HTTP Header Auth:

• Name: Tryb API
• Header Name: Authorization
• Header Value: Bearer sk_vision_your_key

Step 2: Build the Workflow

// Workflow JSON (import into n8n)
{
  "nodes": [
    {
      "name": "Schedule Trigger",
      "type": "n8n-nodes-base.scheduleTrigger",
      "parameters": {
        "rule": { "interval": [{ "field": "days", "value": 1 }] }
      }
    },
    {
      "name": "URL List",
      "type": "n8n-nodes-base.set",
      "parameters": {
        "values": {
          "string": [
            { "name": "urls", "value": "https://competitor1.com/pricing,https://competitor2.com/pricing" }
          ]
        }
      }
    },
    {
      "name": "Tryb Read",
      "type": "n8n-nodes-base.httpRequest",
      "parameters": {
        "url": "https://api.tryb.dev/v1/batch",
        "method": "POST",
        "authentication": "httpHeaderAuth",
        "body": {
          "urls": "={{ $json.urls.split(',') }}"
        }
      }
    }
  ]
}

Step 3: Process Results

Add a Code node to extract pricing from the markdown:

// Extract prices from markdown content
const results = $input.all();
return results.map(item => {
  const priceMatch = item.json.markdown.match(/\$([\d,]+)/);
  return {
    url: item.json.url,
    price: priceMatch ? priceMatch[1] : 'Not found',
    timestamp: new Date().toISOString()
  };
});

Step 4: Compare and Alert

Store results in a Google Sheet or database, compare with previous values, and send Slack alerts on changes.

Download Template

Get the complete workflow template: Download JSON

More n8n Templates

• Lead Generation from LinkedIn
• News Monitoring Dashboard
• SEO Rank Tracking Automation