• views: 221
• date: 8 August 2025
• posted by: voska89

What you'll learn
Learn the end-to-end process of evaluating LLM applications. Quality criteria to choosing the right evaluation method, metrics for RAG, Agentic AI.
Learn Evaluation of RAG with RAGAs framework. Understand RAG and what are the component to evaluate of RAG.
Learn how to evaluate RAG with context precision, recall metrics. How to test RAG application with Python and RAGAs.
Learn how to test and evaluate RAG application with Pytest. Learn API automation of RAG application.
Learn how to test and evaluate Agentic AI application using DeepEval. Automation testing of Agentic AI using Pytest.
Learn how to trace RAG application using LangSmith. Create evaluation dataset using Python. Evaluate with Dataset using LangSmith.
Requirements
Very basic idea of Python and Generative AI.
Description
Evaluating Large Language Model (LLM) applications is critical to ensuring reliability, accuracy, and user trust—especially as these systems are integrated into real-world solutions. This hands-on course guides you through the complete evaluation lifecycle of LLM-based applications, with a special focus on Retrieval-Augmented Generation (RAG) and Agentic AI workflows.You'll begin by understanding the core evaluation process, exploring how to measure quality across different stages of a RAG pipeline. Dive deep into RAGAs—the community-driven evaluation framework—and learn to compute key metrics like context relevancy, faithfulness, and hallucination rate using open-source tools.Through practical labs, you'll create and automate tests with Pytest, evaluate multi-agent systems, and implement tests using DeepEval. You'll also trace and debug your LLM workflows with LangSmith, gaining visibility into each component of your RAG or Agentic AI system.By the end of the course, you'll know how to create custom evaluation datasets and validate LLM outputs against ground truth responses. Whether you're a developer, quality engineer, or AI enthusiast, this course will equip you with the practical tools and techniques needed to build trustworthy, production-ready LLM applications.No prior experience in evaluation frameworks is required—just basic Python knowledge and a curiosity to explore.Enroll and learn how to evaluate or test Gen AI application.
Who this course is for
Beginners, Testers, Quality Engineers, SDET, Data Engineers, Data Scientists, Evaluator, Gen AI developer, Students, Researchers, Project managers
Homepage

https://www.udemy.com/course/testgenai/

   
   
   

Forex Trading

Crypto Trading. 20 USD Bonus after KYC

We need your support!
Make a donation to help us stay online
        
Bitcoin (BTC)
bc1q08g9d22cxkawsjlf8etuek2pc9n2a3hs4cdrld
	
Bitcoin Cash (BCH)
qqvwexzhvgauxq2apgc4j0ewvcak6hh6lsnzmvtkem

Ethereum (ETH)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

Litecoin (LTC)
ltc1qt6g2trfv9tjs4qj68sqc4uf0ukvc9jpnsyt59u

USDT (ERC20)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

USDT (TRC20)
TYdPNrz7v1P9riWBWZ317oBgJueheGjATm

0 1 2 3 4 5

| Print version |

	Information
		Users of GUESTS are not allowed to comment this publication.