Insert and retrieve documents
Workflow Description
Automate document insertion and retrieval using intelligent text splitting, OpenAI embeddings, and Milvus vector database, with support for X integration and real-time chat interactions for information extraction and analysis.
How it works
- 1.Trigger the workflow manually, via HTTP request, or through chat interface
- 2.Split documents into manageable text chunks using recursive character splitting
- 3.Generate vector embeddings for all text segments using OpenAI
- 4.Store vector embeddings and document metadata in Milvus database
- 5.Retrieve relevant documents based on semantic similarity queries
- 6.Extract and format relevant information for user delivery
Use cases
- Build an intelligent document search engine for enterprise knowledge bases
- Automate customer and employee support by answering questions from indexed documents
- Analyze contracts, reports, and PDFs to extract critical business information
- Extend Q&A capabilities across X platform for public-facing document queries
Requirements
- OpenAI API key for embedding generation and language model access
- Deployed and running Milvus instance for vector storage and retrieval
- X API credentials if social media integration is required
- Pre-processed documents in text or structured format for initial indexing
Service Value
Ideal as a smart automation service combining integrations and AI to produce ready-to-use results.
Apps Used
Details
How to Use
- 1.Click "Download Template"
- 2.Open your n8n dashboard
- 3.Go to Workflows > Import from File
- 4.Select downloaded file and configure credentials
Nodes Used (25)
When clicking "Execute Workflow"
Manual Trigger
Fetch Essay List
HTTP Request
Extract essay names
HTML Page
Split out into items
Split Out
Fetch essay texts
HTTP Request
Limit to first 3
Limit
Extract Text Only
HTML Page
Sticky Note3
Sticky Note
Sticky Note5
Sticky Note
Recursive Character Text Splitter1
Text Splitter Recursive Character Text Splitter
Generate response
Set
Compose citations
Set
Answer the query based on chunks
Information Extractor
Prepare chunks
Code
Set max chunks to send to model
Set
Embeddings OpenAI2
OpenAI
When chat message received
Chat Trigger
Sticky Note1
Sticky Note
Milvus Vector Store in retrieval
Vector Store Milvus
Milvus Vector Store
Vector Store Milvus
Sticky Note
Sticky Note
Sticky Note2
Sticky Note
Embeddings OpenAI
OpenAI
Default Data Loader
Document Default Data Loader
OpenAI Chat Model
OpenAI