Developer & DevOps
Extract multi-page website data and save to Google Drive
16 nodes
305
176
Automatic trigger
Workflow Description
Automated workflow that scrapes multiple webpage URLs using HTTP requests, processes and filters extracted data with conditional logic, then organizes results into Google Drive files in controlled batches to prevent server overload.
How it works
- 1.Receive URL list manually or from external source
- 2.Split links into manageable batches with rate limiting
- 3.Fetch each webpage via HTTP and parse XML content
- 4.Filter and extract required data using custom conditions
- 5.Save processed results as organized files in Google Drive
Use cases
- Monitor product prices across pages and track price changes automatically
- Gather job listings or real estate listings from classified sites
- Collect news articles or blog posts periodically for archival
Requirements
- Valid and accessible URLs from n8n network
- Active Google Drive account with write permissions
- Basic understanding of target website HTML/XML structure
Service Value
Ready-made workflow template for automation delivery and service execution.
Apps Used
Split In Batches
Google Drive
Details
Trigger
Automatic trigger
Nodes
16
Apps
2
Views
305
Downloads
176
How to Use
- 1.Click "Download Template"
- 2.Open your n8n dashboard
- 3.Go to Workflows > Import from File
- 4.Select downloaded file and configure credentials
Nodes Used (16)
/
Sticky Note
Sticky Note
When clicking ‘Test workflow’
Manual Trigger
Loop Over Items
Split In Batches
Wait
Wait
Limit
Limit
Get List of Website URLs
HTTP Request
Convert to JSON
Xml
Create List of Website URLs
Split Out
Filter By Topics or Pages
Filter
Set Website URL
Set
Jina.ai Web Scraper
HTTP Request
Save Webpage Contents to Google Drive
Google Drive
Extract Title & Markdown Content
Code
Sticky Note1
Sticky Note
Sticky Note2
Sticky Note
Sticky Note3
Sticky Note