DataOps Engineer is a profession of the future, for which there is already a huge demand and shortage of specialists.
In addition to the standard topics (Hadoop, MLOps, orchestration) we will cover a full set of Data Governance tools and practices – metadata management, data quality, data integration, data discovery, data linage, BI
This course is suitable for you if you:
- already know how to work with data, but want to develop knowledge in the infrastructure on which it works;
- Or you know how to work with the infrastructure, but want to get specific knowledge of working with data.
What we’ll cover in the course:
- Hadoop cluster administration issues (including security issues!
- Features of deploying ETL processes, Spark-jobs, real-time data processing applications;
- The architecture of multiple MPP databases (Vertica, Greenplum, ClickHouse, …);
- Data Governance services and practices (BI, data catalog, data linage, CDC, data injestion, data quality, notebooks);
- MLOps practices (model deployment, experiment monitoring, orchestration).
Required knowledge
- Basic knowledge of SQL
- Excellent knowledge of Linux
- Skills in Docker
Final project
Graduation project is an opportunity to consolidate the skills gained during training. This is a separate work in the last month of training.
In this course a graduation project will be building a data infrastructure for various applications:
- Data integration solution
- ML platform
- CI/CD for data processes
- Data meta-information management solution
- Analytical sandbox
Teaching process
The educational process is ONLINE in the format of webinars. As part of the course students are offered to do homework, which allows you to apply in practice the knowledge gained in the classroom. The instructor gives detailed feedback on each homework assignment. During the whole educational process the teacher is in the common communication space with the group – Slack, i.e. students can ask the teacher qualifying questions about educational materials.
take a full set of training materials: video recordings of all webinars, presentations for classes, as well as solutions of problems and projects in the form of code on github and other additional materials;
Receive a certificate of completion;
receive an invitation to an interview in partner companies (the most successful students get this opportunity).