Generative AI, Large Language Models (LLMs) & Vector RAG

Tokenization, Vector Embeddings, Pinecone/Qdrant, RAG Pipelines & LangChain

Deep Learning & PyTorch Neural Networks Architecture

Autograd, CNNs, ResNet, LSTMs, Scaled Dot-Product Attention & Transformers

Model Fine-Tuning, Quantization & RLHF (PEFT, LoRA, vLLM)

Instruction Tuning, LoRA/QLoRA (NF4), GGUF/AWQ Quantization, DPO & vLLM Serving

Mathematics, Statistics & Machine Learning (Big Tech Prep)

Linear Algebra, Multivariate Calculus, Probability Distributions, Scikit-Learn & Optimization