arrow_back
Before Starting
Readme
About This Course
Course Curriculum | Pre-requisite
Structured Notes
Download Notes | LLMOps
Lectures
Introduction to LLMOps and its Lifecycle
Tools Stack and MLOps vs LLMOps
Building the RAG Application
RAG Evaluation and its Concepts
What is Golden Dataset and related concepts
Synthesize Golden Dataset using DeepEval
RAG Metrics Part 1
RAG Metrics Part 2
RAG Triad, Custom Metrics(GEval) and Evaluate API
Prompt Management using Langfuse
Prompt Versioning and Prompt Caching in Langfuse
Setting up Parameters Config and Validation using Pydantic
Building the Experiment Tracking Pipeline
Concept of Regression Testing
Building Regression Testing Pipeline and Introduction to Guardrails
Guardrails through Guardrails AI
Adversarial Attacks and Building Custom Guardrails
Implementing Guardrails on RAG Application
Application Serving through Fast API
Implementing CI Pipeline using GitHub Actions
Concepts of Docker for LLMOps
Implementing CD Pipeline and Manual Deployment to EC2
Automated Deployment using AWS Code Deploy
Tracing Application using Langfuse
Implementing Observability and Building Dashboards using Langfuse
Performing Online Evals over Deployed Application
Infrastructure Monitoring using Prometheus
Building Dashboard around Infrastructure Metrics using Grafana
Agentic Application built with LangGraph
LLMOps Agent Project
Prompt Management
Agent Evals Part 1
Agent Evals Part 2
Raw and Uncut
LLMOps Session 1
LLMOPs Session 2
LLMOps Session 3
LLMOps Session 4
LLMOps Session 5
LLMOps Session 6
LLMOps Session 7
LLMOps Session 8
LLMOps Session 9
LLMOps Session 10
LLMOps Session 11
LLMOps Session 12
LLMOps Session 13
LLMOps Session 14
LLMOps Session 15
LLMOps Session 16
LLMOps Session 17
LLMOps Session 18
LLMOps Session 19
LLMOps Session 20
LLMOps Session 21
LLMOps Session 22
LLMOps Session 23
LLMOps Session 24
LLMOps Session 25
LLMOps Session 26
LLMOps Session 27
LLMOps Session 28
Doubt Clearance - LLMOps
Feedback & Certificate
Feedback Form