Trending Courses

Vendors

Skip Navigation Links

Overview

This is your introduction to evaluating and governing generative AI systems. First, you’ll explore the meaning behind and motivation for building evaluation and governance/security systems. Next, we’ll connect evaluation and governance systems to the Databricks Data Intelligence Platform. Third, we’ll teach you about a variety of evaluation techniques for specific components and types of applications. Finally, the course will conclude with an analysis of evaluating entire AI systems with respect to performance and cost.
img-course-overview.jpg

What You'll Learn

  • N/A

Who Should Attend

  • N/A
img-who-should-learn.png

Prerequisites

  • Familiarity with natural language processing concepts
  • Familiarity with prompt engineering/prompt engineering best practices 
  • Familiarity with the Databricks Data Intelligence Platform
  • Familiarity with RAG  (preparing data, building a RAG architecture, concepts like embedding, vectors, vector databases, etc.)
  • Experience with building LLM applications using multi-stage reasoning LLM chains and agents

Learning Journey

Coming Soon...

Importance of Evaluating GenAI Applications

  • Why to Evaluate GenAI Applications
  • Exploring Licensing of Datasets
  • Prompts and Guardrails Basics
  • Implementing and Testing Guardrails for LLMs

Securing and Governing GenAI Applications

  • AI System Security
  • Implementing AI Guardrails

GenAI Evaluation Techniques

  • Evaluation Techniques
  • Benchmark Evaluation
  • LLM-as-a-Judge
  • Domain-Specific Evaluation

End-to-end Application Evaluation

  • AI System Architecture
  • Custom Metrics
  • Offline vs. Online Evaluation

img-exam-cert

Frequently Asked Questions (FAQs)

None

Keep Exploring

Course Curriculum

Course Curriculum

Training Schedule

Training Schedule

Exam & Certification

Exam & Certification

FAQs

Frequently Asked Questions

img-improve-career.jpg

Improve yourself and your career by taking this course.

More Courses By Databricks

Browse All Courses
IBM Analytics3_max4302g-ibm-maximo-7
Data Engineer

Data Engineering with Databricks

Learn to build scalable data pipelines using Databricks, Spark, and Delta Lake. Gain hands-on experience in modern data engineering with Trainocate.
ILT VILT
Course Duration 2 Days
IBM Analytics3_max7600g-ibm-maximo-asset-management-7
Data Analyst

Data Analysis with Databricks

Data Analysis with Databricks
ILT VILT
Course Duration 1 Day
IBM Analytics3_6a522g-ibm-safer-payments-hands-on-sysops-training-(v6
Machine Learning Practitioner

Machine Learning with Databricks

Machine Learning with Databricks
ILT VILT
Course Duration 2 Days
img-get-info.jpg

Ready to Take Your Business from Great to Awesome?

Level-up by partnering with Trainocate. Get in touch today.

Name
Email
Phone
I'm inquiring for
Inquiry Details

By submitting this form, you consent to Trainocate processing your data to respond to your inquiry and provide you with relevant information about our training programs, including occasional emails with the latest news, exclusive events, and special offers.

You can unsubscribe from our marketing emails at any time. Our data handling practices are in accordance with our Privacy Policy.

Stay Connected. Be the first to Know.

Company

Vendors

Services

Customer Service

© Copyright Trainocate 2025. All rights reserved.