[1/3 - Anomaly detection] [1/2 - Classification algorithm classification] Upload the dataset to Qdrant (set...
Workflow Description
Workflow that detects and classifies anomalies using classification algorithms, uploads processed datasets to Qdrant for storage and retrieval, leveraging Google Cloud Storage for centralized data management and processing pipelines.
How it works
- 1.Trigger workflow manually and retrieve dataset from Google Cloud Storage
- 2.Process data and apply classification algorithm to categorize records
- 3.Execute anomaly detection model on classified dataset
- 4.Filter results based on defined criteria using conditional logic
- 5.Send processed data to Qdrant via HTTP request
- 6.Log detected anomalies and classification outcomes
Use cases
- Identify suspicious transactions and anomalous user behavior in financial systems
- Automatically classify and organize large datasets for improved retrieval and analytics
- Monitor data quality and ensure compliance across big data infrastructure
Requirements
- Active Google Cloud Storage account with full access permissions
- Configured Qdrant instance ready for vector ingestion and similarity search
Service Value
Ready-made workflow template for automation delivery and service execution.
Apps Used
Details
How to Use
- 1.Click "Download Template"
- 2.Open your n8n dashboard
- 3.Go to Workflows > Import from File
- 4.Select downloaded file and configure credentials
Nodes Used (25)
When clicking ‘Test workflow’
Manual Trigger
Google Cloud Storage
Google Cloud Storage
Get fields for Qdrant
Set
Qdrant cluster variables
Set
Embed crop image
HTTP Request
Create Qdrant Collection
HTTP Request
Check Qdrant Collection Existence
HTTP Request
Batches in the API's format
Set
Batch Upload to Qdrant
HTTP Request
Split in batches, generate uuids for Qdrant points
Code
If collection exists
If
Sticky Note
Sticky Note
Payload index on crop_name
HTTP Request
Sticky Note1
Sticky Note
Sticky Note2
Sticky Note
Sticky Note3
Sticky Note
Sticky Note4
Sticky Note
Sticky Note5
Sticky Note
Sticky Note6
Sticky Note
Sticky Note7
Sticky Note
Sticky Note9
Sticky Note
Sticky Note11
Sticky Note
Filtering out tomato to test anomalies
Filter
Sticky Note8
Sticky Note
Sticky Note10
Sticky Note