Senior Data Engineer (Data Science)

TL;DR

Senior Data Engineer (Data Science): Designing, building, and maintaining data warehouses for Data Science and ML tasks with an accent on ETL/ELT processes and data quality monitoring. Focus on optimizing data storage and processing historical data while collaborating with the Data Science team.

Компания

Островок — аккредитованная IT-компания.

What you will do

• Design and maintain data warehouses for Data Science and ML tasks.
• Set up and support ETL/ELT processes.
• Monitor and improve data quality.
• Optimize storage and processing of historical data.
• Collaborate with the Data Science team to formalize and gather technical requirements.
• Support and develop data architecture.

Requirements

• 4+ years of experience as a Data Engineer, including ML/DS projects.
• Deep knowledge of data storage and architecture for ML solutions.
• Practical experience with DBT, Airflow, Trino.
• Good knowledge of Python and SQL.
• Experience with GIT and Docker.
• Skills in Hadoop ecosystem: HDFS, Hive, Spark.
• Experience in setting up ETL process monitoring systems.
• Conversational English at B1 level.