RAG System on Corporate Documents: What the Project Includes and What It Costs
A corporate RAG system (Retrieval-Augmented Generation) is not "upload a PDF to ChatGPT" - it is infrastructure that indexes policies, contracts, instructions, and knowledge bases, finds relevant fragments, and generates answers with source citations. In 2026, this is the standard for internal assistants, support, and compliance queries. Below are project scope, stages, timelines, and realistic budget ranges.
- MVP on one source (Confluence, SharePoint, PDF folder) - $8,000 - $25,000, 4-8 weeks
- Corporate RAG platform (multiple sources, RBAC, audit) - $35,000 - $120,000, 3-5 months
- Enterprise: on-prem, DLP, SLA, multilingual - $120,000 - $350,000+, 6-10 months
- Monthly costs - embeddings, LLM API, vector DB, reindexing: from $300 to $12,000+
- Main price driver - not the model (GPT-5.6 Terra, Claude Sonnet 5, Gemini 3.5 Flash), but retrieval quality and depth of document workflow integrations
What RAG on Corporate Documents Means
RAG augments an LLM with search over your data: the model does not "remember" the vacation policy - it receives relevant paragraphs from a vector index and builds an answer from them. For business, this reduces hallucinations and provides verifiable links to the source.
Typical corporate scenarios:
- an employee asks about contract approval procedure - the system finds the section in Confluence and cites the clause;
- a support agent gets a draft answer from an up-to-date Zendesk knowledge base;
- legal searches precedents in a contract archive with filters by counterparty type and date.
Without RAG, a corporate chatbot either answers in generalities or "invents" internal rules. With RAG, the answer is tied to documents that can be opened and verified.
What the Project Includes
An RAG project splits into eight blocks. Each affects timeline and budget.
| Block | What is done | Typical share |
|---|---|---|
| Discovery | Data sources, user roles, quality KPIs, data constraints | 8-12% |
| Ingestion (ETL) | Confluence, SharePoint, Google Drive, CRM, tickets, ERP exports | 15-25% |
| Chunking and preprocessing | Splitting into fragments, cleaning, metadata, OCR for scans | 10-15% |
| Embeddings and index | Embedding model choice, vector DB, hybrid search (BM25 + vector) | 10-15% |
| Retrieval pipeline | Reranking, role filters, deduplication, query expansion | 15-20% |
| Generation layer | Prompts, citations, guardrails, fallback on low confidence | 10-15% |
| Interface and API | Widget, Slack/Teams, internal portal, headless API | 10-20% |
| Observability and eval | Retrieval metrics, test question dataset, A/B, alerts | 8-12% |
Turnkey means: the system indexes agreed sources, answers in target channels, logs queries, passes pilot, and is handed over with reindexing documentation.
Development Stages
1. Data Audit and Specifications (1-2 weeks)
You define:
- which sources to connect (Confluence, Notion, SharePoint, local PDFs, wiki, CRM);
- volume: number of documents, update frequency, languages;
- access: SSO, RBAC, separate indexes per department;
- metrics: precision@k, share of answers with correct citation, response time, CSAT.
Output: source map, access rights matrix, list of "golden" eval questions (50-200 from real employee practice).
2. Ingestion Prototype (2-4 weeks)
Connect the first source and verify the full cycle:
- export or webhook on document change;
- parsing (HTML, DOCX, PDF, tables);
- chunking: fragment size, overlap, preserving headings and hierarchy;
- write to vector DB with metadata (department, date, author, tag).
Typical stack: LangChain / LlamaIndex, Unstructured, Apache Tika, connectors to SharePoint Graph API and Confluence REST.
3. Retrieval and Search Quality (3-6 weeks)
Core engineering work:
- embedding model: OpenAI text-embedding-3-large, Cohere, local bge-m3 / e5 for on-prem;
- vector DB: pgvector, Qdrant, Weaviate, Milvus, Pinecone;
- hybrid search: keyword + semantic for exact SKUs, contract numbers, article codes;
- reranker: Cohere Rerank, cross-encoder, bge-reranker - improves accuracy by 15-30%;
- filters: user sees only documents for their department.
Without iterations on the eval set, retrieval "almost works" in demo and breaks on real questions.
4. Generation and Guardrails (2-4 weeks)
- system prompt with "answer only from context" rule;
- citations: link to document, page, anchor;
- "don't know" answer on low retrieval score;
- prompt injection protection via documents;
- model routing: Gemini 3.5 Flash / GPT-5.6 Luna for simple queries, Terra / Claude Sonnet 5 for complex ones.
5. Integrations and Interface (2-6 weeks)
- widget on intranet, bot in Slack/Teams/Telegram;
- SSO (SAML, OIDC), query log for compliance;
- admin panel: indexing status, manual reindex, view of "bad" answers;
- API for embedding in CRM, ticket system, IDE.
6. Pilot and Production (2-4 weeks)
- regression on eval dataset after each release;
- pilot on one department (50-200 users);
- latency, token cost, quality drift monitoring;
- runbook: what to do when a source fails, how to add a new wiki section.
Cost Ranges by Project Type
1. MVP - One Source, Internal Pilot
| Parameter | Value |
|---|---|
| Budget | $8,000 - $25,000 |
| Timeline | 4-8 weeks |
| Sources | 1 (Confluence, PDF folder, Notion) |
| Users | up to 100, no complex RBAC |
| Infrastructure | cloud, managed vector DB |
Suitable for testing the hypothesis that "employees will stop searching wiki manually." Limits: one language, basic citations, manual reindex or daily cron.
2. Corporate RAG Platform
| Parameter | Value |
|---|---|
| Budget | $35,000 - $120,000 |
| Timeline | 3-5 months |
| Sources | 3-8 (wiki, CRM, tickets, file storage) |
| Users | 200-5,000, RBAC, SSO |
| Quality | rerank, eval pipeline, hybrid search |
Standard for mid-size and large business: HR, IT, support, sales on one platform but see different document slices.
3. Enterprise
| Parameter | Value |
|---|---|
| Budget | $120,000 - $350,000+ |
| Timeline | 6-10 months |
| Sources | ERP, DMS, contract archives, SIEM logs (read-only) |
| Requirements | on-prem / VPC, DLP, audit trail, GDPR/HIPAA |
| Scale | multilingual, branches, 99.9% SLA |
Banks, telecom, pharma, public sector. A significant share goes to security, pentest, legal approval, redundancy, and self-hosted embeddings when data must not leave the perimeter.
Monthly Costs (OPEX)
| Item | Range / month | Depends on |
|---|---|---|
| Embeddings | $50 - $800 | Volume of new/changed documents |
| LLM API | $200 - $8,000 | Query count, context length, model |
| Vector DB | $70 - $600 | Managed vs self-hosted, index size |
| Rerank API | $30 - $400 | Queries with rerank per question |
| Worker hosting | $100 - $1,500 | Ingestion, queues, cron |
| Support and improvements | $1,000 - $8,000 | Retainer, eval updates, new sources |
Example: 5,000 documents, 3,000 queries/month, Terra + pgvector + rerank:
- Embeddings (10% reindex/month): ~$40
- LLM (2,500 input + 600 output tokens per query): ~$60-90
- Infrastructure: ~$150-250
- Total: ~$250-400/month
At 50,000 queries/month and enterprise SLA, OPEX easily reaches $3,000 - $12,000/month. Plan TCO for 18-24 months, not just one-time development.
Timeline and Team
| Project type | Team | Timeline |
|---|---|---|
| MVP | 1 backend + ML/RAG engineer (part-time) | 4-8 weeks |
| Corporate platform | 2 backend, 1 ML, 1 frontend, PM | 3-5 months |
| Enterprise | 4-7 people + DevOps, QA, security | 6-10 months |
Rates in 2026 (remote, Eastern Europe / CIS): ML/RAG specialist $60-100/h, backend $45-80/h, DevOps $50-90/h. US or Western Europe teams - multiply by 2-3.
Timelines grow not from "connecting OpenAI API" but from dirty data (outdated wiki, scans without OCR, duplicates), access approvals for internal systems, and quality iterations on real employee questions.
What Increases Project Cost
Many formats and legacy. Scanned PDFs without text layer, nested Excel tables, old HTML in Confluence - each format needs a separate parser and tests.
Document-level RBAC. User A must not see a fragment from a closed contract. Index filters, AD/SharePoint rights sync, audit - +20-35% to budget.
Multilingual. Separate indexes or multilingual embeddings, eval per language, local stop words. +25-40% for 3+ languages.
Real-time updates. Webhook on every wiki save vs nightly batch - different queue architecture and ingestion cost.
On-prem and air-gap. Self-hosted LLM (Llama 4, Qwen 3.7), local embeddings, GPU - +$500-3,000/month infrastructure, but mandatory for regulated industries.
How Not to Overpay
- Start with one department and one source - HR or IT support on Confluence, 30-50 reference questions.
- Eval from week one - without a dataset you pay for endless "chunk size tweaks."
- Hybrid search with rerank - cheaper than LLM fine-tuning at start; add fine-tuning when RAG hits a ceiling.
- Model routing - Flash/Luna for FAQ, Terra/Sonnet for complex multi-hop questions.
- Cache frequent queries - semantic cache cuts API by 20-40%.
- Fixed MVP, T&M for new sources - price each new connector (SAP, ERP) separately.
Summary
A RAG system on corporate documents in 2026 costs from $8,000 (MVP on one wiki) to $350,000+ (enterprise with on-prem and compliance). Timelines - from 4-8 weeks to 10 months. Main drivers: number and quality of sources, access rights requirements, retrieval accuracy, and traffic volume. The LLM is only part of OPEX; ingestion and search quality determine whether the system is useful or "a pretty demo with hallucinations."
Start with an eval set of real employee questions, one source, and measurable metrics - that makes it easier to justify budget and scale without rewriting architecture.
Frequently Asked Questions
How does RAG differ from fine-tuning a model on documents?
Fine-tuning embeds knowledge in model weights: expensive to update on every policy change, hard to cite sources. RAG stores documents separately, finds current fragments on query, and injects them into context - knowledge updates via reindexing in minutes or hours. For corporate documents with frequent edits, RAG is almost always better at start; fine-tuning makes sense for a narrow answer format or token savings at millions of similar queries.
Can you build RAG on ChatGPT Enterprise or Copilot without development?
For simple cases - partially. Uploading files to Custom GPT or Microsoft Copilot works for a pilot on hundreds of documents. Limits: weak control over chunking and retrieval, complex RBAC, no custom eval, vendor lock-in, volume and internal DMS integration limits. For production with thousands of documents, SSO, audit, and SLA you need a custom RAG platform or boxed solution with customization - from $35,000 and up.
How many documents can a typical project handle?
MVP comfortably handles 500-5,000 documents (or up to 50,000 pages) on managed vector DB. Corporate platform scales to 100,000+ documents with sharding, hybrid search, and batch ingestion. The bottleneck is less vector storage than parsing quality and rerank latency on a large index. OCR archives at millions of pages are a separate ingestion project with +30-50% budget.
How to measure RAG quality before launch?
Build an eval dataset: 50-200 real questions with reference documents/paragraphs. Metrics: recall@k (was the right fragment in top-k), faithfulness (answer matches context), citation accuracy (link points to the right place). Run the set after every chunking, embedding, or rerank change. Production target: recall@5 above 85% on key topics, faithfulness above 90% on pilot.
What does post-launch support include?
Typical retainer $1,000 - $5,000/month (small/mid project) or 15-25% of development cost per year: quality monitoring, eval updates, connector fixes when source API changes, new wiki sections, prompt tuning, latency and API cost alerts. Reindexing on mass document updates (new policy, Confluence migration) is often a separate sprint. Without support, RAG degrades in 3-6 months: sources change, quality drops unnoticed until user complaints.