Data Engineer

DATB-AD : Automated Deployment with Databricks Asset Bundles

Course Duration

3 Hours

Delivery

ILT/VILT

Overview

Overview Course Curriculum Training Schedule Exam & Certification FAQs

This course provides a comprehensive review of DevOps principles and their application to Databricks projects. It begins with an overview of core DevOps, DataOps, continuous integration (CI), continuous deployment (CD), and testing, and explores how these principles can be applied to data engineering pipelines.
The course then focuses on continuous deployment within the CI/CD process, examining tools like the Databricks REST API, SDK, and CLI for project deployment. You will learn about Databricks Asset Bundles (DABs) and how they fit into the CI/CD process. You’ll dive into their key components, folder structure, and how they streamline deployment across various target environments in Databricks. You will also learn how to add variables, modify, validate, deploy, and execute Databricks Asset Bundles for multiple environments with different configurations using the Databricks CLI.
Finally, the course introduces Visual Studio Code as an Interactive Development Environment (IDE) for building, testing, and deploying Databricks Asset Bundles locally, optimizing your development process. The course concludes with an introduction to automating deployment pipelines using GitHub Actions to enhance the CI/CD workflow with Databricks Asset Bundles.

By the end of this course, you will be equipped to automate Databricks project deployments with Databricks Asset Bundles, improving efficiency through DevOps practices.

What You'll Learn

DevOps and CI/CD Review
Deployment with Databricks Asset Bundles (DABs)
Doing More with Databricks Asset Bundles

Who Should Attend

Data engineers, platform engineers and DevOps practitioners looking to automate deployment of Databricks projects using Asset Bundles.
Professionals managing multi-environment workflows (development ? staging ? production) who need consistent, repeatable and automated deployment processes.
Individuals using Databricks notebooks, jobs, pipelines or DLT who want to integrate CI/CD practices with Databricks CLI/SDK, REST APIs and Git-based workflows.
Practitioners with experience in Python, SQL, PySpark and version control who aim to standardise deployment and release processes on the Databricks platform.
Teams seeking to move away from manual deployments toward governed, scalable and automated deployment frameworks.

Prerequisites

Strong knowledge of the Databricks platform, including experience with Databricks Workspaces, Apache Spark, Delta Lake, the Medallion Architecture, Unity Catalog, Delta Live Tables, and Workflows. In particular, knowledge of leveraging Expectations with DLTs.
Experience in data ingestion and transformation, with proficiency in PySpark for data processing and DataFrame manipulation. Candidates should also have experience writing intermediate-level SQL queries for data analysis and transformation.
Proficiency in Python programming, including the ability to design and implement functions and classes, and experience with creating, importing, and utilizing Python packages.
Familiarity with DevOps practices, particularly continuous integration and continuous delivery/deployment (CI/CD) principles.
A basic understanding of Git version control.
Prerequisite course DevOps Essentials for Data Engineering Course.

Learning Journey

Coming Soon...

Module 1: DevOps and CI/CD Review

DevOps Review
Continuous Integration and Continuous Deployment/Delivery (CI/CD) Review
Course Setup and Authentication

Module 2: Deployment with Databricks Asset Bundles (DABs)

Deploying Databricks Projects
Introduction to Databricks Asset Bundles (DABs)
Deploying a Simple DAB
Deploy a Simple DAB
Variable Substitutions in DABs
Deploying a DAB to Multiple Environments
Deploy a DAB to Multiple Environments
DAB Project Templates Overview
Use a Databricks Default DAB Template
CI/CD Project Overview with DABs
Continuous Integration and Continuous Deployment with DABs
Adding ML to Engineering Workflows with DABs

Module 3: Doing More with Databricks Asset Bundles

Developing Locally with Visual Studio Code (VSCode)
Using VSCode with Databricks
CI/CD Best Practices for Data Engineering
Next Steps: Automated Deployment with GitHub Actions

Frequently Asked Questions (FAQs)

None

Keep Exploring

Course Curriculum

Training Schedule

Exam & Certification

FAQs

Frequently Asked Questions

Improve yourself and your career by taking this course.

Enroll Now

More Courses By Databricks

Browse All Courses

IBM Analytics3_8g102g-ibm-security-guardium-data-protection-foundations-training

Data Engineer

Ready to Take Your Business from Great to Awesome?

Level-up by partnering with Trainocate. Get in touch today.

Name

Phone

I'm inquiring for

Myself

Company

Inquiry Details

By submitting this form, you consent to Trainocate processing your data to respond to your inquiry and provide you with relevant information about our training programs, including occasional emails with the latest news, exclusive events, and special offers.

You can unsubscribe from our marketing emails at any time. Our data handling practices are in accordance with our Privacy Policy.