RAG-LLM Evaluation & Test Automation for Beginners

RAG-LLM Evaluation & Test Automation for Beginners
2025-02-03
MP4 | Video: h264, 1920×1080 | Audio: AAC, 44.1 KHz

Understand, Evaluate & Test RAG – LLM’s (AI based Systems) from Scratch using RAGAS-Python-Pytest Framework

What you’ll learn
How Custom Large Language Models (LLM) are designed using Retrieval Augmented Generation (RAG) Architecture
Common Benchmarks/Metrics used in Evaluating RAG based LLM’s
Introduction to RAGAS Evaluation framework for evaluating/test LLM’s
Practical Scripts generation to automate and assert the Metrics Score of LLM’s.
Automate Scenarios such as Single turn interactions and Multi turn interactions with LLM’s using RAGAS Framework
Generate Test Data for evaluating the Metrics of LLM using RAGAS Framework.
Create RAGAS Pytest Evaluation Framework to assert the Metrics of RAG- (Custom) LLM’s

Requirements
Python, PyTest basics are required. But wait! we have 2 dedicated sections at the end of this course which gives you necessary knowledge on Python & Pytest required to follow the course.
Basic knowledge on API Testing

Description
Who this course is for:
Software Engineers, Quality Assurance Engineers, Software Testers

For More Courses Visit & Bookmark Your Preferred Language Blog