After successful completion of the Data Engineer Certificate, you will know the basics for Keboola Connection and be able to do common tasks on the platform (download data from external sources, process it in Keboola and send the results outside). Familiarize yourself with components (components are Keboola applications for data processing), advanced usage of transformations (transformations contain structured SQL statements), and debug issues with your data pipelines in Keboola. You will also learn some good practices on how to work with your data in Keboola safely and effectively.

With successful completion of the certificate, you will be ready to build the whole data flow in a project with little to no assistance. 

The certificate requires completion of courses: Introduction, Best Practices, Debug Techniques, Common Components and Processors, and Business Data Model. 

If you have already completed any of the assignments, you will not be required to resubmit in order to qualify for completion of this course. Either if you went through a course outside of the certificate just skip those lessons.

Course curriculum

  • 1

    Certificate Course Introduction

    • Certificate Course Introduction
  • 2

    Introduction

    • Introduction and Architecture Overview

    • Keboola Project

    • Data Extractors

    • Quiz 1

    • Data Writers

    • Storage

    • Transformations and Workspaces

    • Transformations using BigQuery

    • Python transformations

    • Jobs

    • Quiz 2

    • Flows

    • Quiz 3

    • Data Flow Templates

    • Data Apps introduction

    • Data Apps - Hands on

    • Keboola Support

    • Trash

    • Free Tier vs. Enterprise Plan

    • Quiz 4

    • Course Feedback

    • Resources
  • 3

    Best Practices

    • Introduction and Architecture Explanation

    • Storage Introduction

    • Quiz 1

    • Storage Jobs

    • Snapshots

    • Aliases

    • Trash

    • Quiz 2

    • Data Types

    • Table Operations

    • Quiz 3

    • File Storage

    • Input and Output Mapping

    • Variables

    • Shared Code

    • SQL Tips

    • Quiz 4

    • Workspaces

    • Flows

    • Quiz 5

    • Development Branches

    • Quiz 6

    • Keboola Dev Tools

    • Assignment

    • Assignment Overview

    • Course Feedback

    • Resources
  • 4

    Debug Techniques

    • Common Errors

    • Storage and Jobs Events

    • Invalid SQL Queries

    • Output Mapping Errors

    • Quiz 1

    • Missing Records alias Primary Keys Problems

    • Unable to Merge Primary Key

    • Invalid Cipher

    • Quiz 2

    • Dropped Tables

    • Debug Transformation

    • Native Types

    • Quiz 3

    • Assignment

    • Course Feedback

    • Resources
  • 5

    Common Components and Processors

    • Introduction to the Common Components and Processors course

    • Public vs Private ComponentsPuiblic

    • Component Developers

    • Component Configuration

    • Introduction to Processors in Keboola

    • Processors - Introduction

    • JSON to CSV Processors

    • S3 Processors Deep Dive - Decompress Processor

    • Move Files Processor

    • Create Manifest Processor

    • Skip Lines Processor

    • Add File Name Column Processor

    • Add Row Number Processor

    • Common Components introduction

    • FTP Extractor

    • Email Attachments Extractor

    • IMAP Email and Attachment Extractor

    • HTTP Extractor

    • Keboola Storage Extractor

    • Geocoding Augmentation Extractor

    • Apify Extractor

    • Web Robot

    • Generic Extractor

    • Introduction to the text analysis and processing components

    • Google NLP Application

    • Google Translate Application

    • Geneea NLP Application

    • Mailgun

    • Assignment

    • Common Components and Processors presentation

    • Course Feedback
  • 6

    Certificate Submission

    • Certificate Submission
  • 7

    Before you go ...

    • Certificate Feedback