Detect anomalies and classify data with Qdrant
Workflow Description
Automation loads datasets from Google Cloud Storage, applies classification and anomaly detection algorithms, then stores results in Qdrant for intelligent retrieval and advanced analytics with full audit trails.
How it works
- 1.Trigger workflow manually or when new data arrives in cloud storage
- 2.Load dataset and apply classification algorithms to categorize items
- 3.Execute anomaly detection algorithm and identify outliers in the data
- 4.Store classifications and results in Qdrant vector database
- 5.Send result reports via HTTP requests to downstream systems
Use cases
- Automatically detect anomalies in financial data or customer behavior patterns
- Classify products or documents based on features and store centrally
- Monitor data quality and filter suspicious records before processing pipelines
Requirements
- Active Google Cloud Storage bucket containing raw datasets
- Qdrant instance running and accessible for programmatic connection
- Understanding of classification and anomaly detection algorithms needed
Service Value
Ready-made workflow template for automation delivery and service execution.
Apps Used
Details
How to Use
- 1.Click "Download Template"
- 2.Open your n8n dashboard
- 3.Go to Workflows > Import from File
- 4.Select downloaded file and configure credentials
Nodes Used (25)
When clicking ‘Test workflow’
Manual Trigger
Google Cloud Storage
Google Cloud Storage
Get fields for Qdrant
Set
Qdrant cluster variables
Set
Embed crop image
HTTP Request
Create Qdrant Collection
HTTP Request
Check Qdrant Collection Existence
HTTP Request
Batches in the API's format
Set
Batch Upload to Qdrant
HTTP Request
Split in batches, generate uuids for Qdrant points
Code
If collection exists
If
Sticky Note
Sticky Note
Payload index on crop_name
HTTP Request
Sticky Note1
Sticky Note
Sticky Note2
Sticky Note
Sticky Note3
Sticky Note
Sticky Note4
Sticky Note
Sticky Note5
Sticky Note
Sticky Note6
Sticky Note
Sticky Note7
Sticky Note
Sticky Note9
Sticky Note
Sticky Note11
Sticky Note
Filtering out tomato to test anomalies
Filter
Sticky Note8
Sticky Note
Sticky Note10
Sticky Note