Generative AI, Large Language Models (LLMs) & Vector RAG › 13. Multi-Query Generation, Sub-Question Decomposition & Step-Back Prompting for Complex Questions

Course Syllabus

01. Transformer Architecture Deep Dive: Self-Attention Mechanism, Multi-Head Attention & Positional Encoding 02. Autoregressive Generation: Tokenization (BPE, WordPiece, SentencePiece), Sampling (Temperature, Top-K, Top-P) 03. Prompt Engineering Architecture: Few-Shot Prompting, Chain-of-Thought (CoT), ReAct & System Prompt Hardening

04. Vector Embeddings: Dense vs Sparse Vectors (OpenAI text-embedding-3, BGE-Large, BM25) 05. Similarity Metrics: Cosine Similarity, Dot Product, Euclidean Distance & Manifold Geometry 06. Approximate Nearest Neighbor (ANN) Algorithms: HNSW (Hierarchical Navigable Small World) & IVF-PQ Indexes

07. Vector Database Architecture: Comparing Pinecone, Qdrant, Weaviate, Milvus & PostgreSQL with pgvector 08. Metadata Filtering & Payload Indexing for High-Performance Multitenant Vector Search 09. Embedded Vector Stores: ChromaDB, DuckDB & In-Memory FAISS (Facebook AI Similarity Search)

10. Document Chunking Strategies: Fixed Size, Recursive Character, Semantic Chunking & Parent Document Retrievers 11. Hybrid Search Architecture: Combining Keyword Search (BM25) + Dense Vector Search with Reciprocal Rank Fusion (RRF) 12. Cross-Encoder Reranking: Integrating Cohere Rerank / BGE-Reranker for Pinpoint Context Relevance

13. Multi-Query Generation, Sub-Question Decomposition & Step-Back Prompting for Complex Questions 14. Context Compression & Lost-in-the-Middle Mitigation Strategies 15. Graph RAG Architecture: Combining Knowledge Graphs (Neo4j / NetworkX) with Vector Search for Relational Insights

16. RAG Evaluation Framework (RAGAS): Faithfulness, Answer Relevance, Context Precision & Context Recall 17. Guardrails & Safety: NeMo Guardrails, Llama Guard & Prompt Injection Defense Mechanisms 18. Streaming Output Architecture with Server-Sent Events (SSE) & WebSocket RAG Responses 19. Caching in GenAI: Semantic Caching with GPTCache & Redis to Slash API Costs by 70% 20. Production GenAI Deployment: Building an Enterprise PDF/Docs AI Assistant with LangChain & LlamaIndex