Data Engineer

TL;DR

Data Engineer: Developing and maintaining reliable ETL pipelines and data infrastructure to support business analytics with an accent on data quality, stability, and architecture within a Data Mesh platform. Focus on designing ETL processes, optimizing data storage and query performance, and supporting analytics teams with technical expertise.

Компания

Yandex is a leading technology corporation developing innovative data products and infrastructure in logistics and delivery services.

Что делать

• Design and maintain ETL pipelines for data processing from sources to dashboards within a domain V-team.
• Ensure data quality, stability, and performance of data marts and dashboards.
• Support key data platform components such as ClickHouse, Greenplum, YTsaurus, and ETL services.
• Provide technical support to analysts on data platform tools and usage.

Требования

• Excellent knowledge of Python
• Experience with MPP databases like Greenplum, Vertica, ClickHouse
• Experience working with big data ecosystems such as Hadoop (HDFS, Spark, Hive), YTsaurus
• Understanding of data warehouse design, ETL frameworks, and monitoring systems
• Ability to optimize queries and evaluate computational load

Хорошо, если есть

• Experience building complex high-load ETL/ELT pipelines (Luigi, Airflow)
• Experience with near real-time complex event processing (Kafka Streams, Spark, Flink)
• Familiarity with Python data science tools (Jupyter, pandas, SciPy, Matplotlib, Bokeh)
• Experience developing data quality checks and monitoring stability
• Public contributions or articles demonstrating expertise

Культура и преимущества

• Comprehensive medical insurance including dental, annual checkups, emergency care abroad, and critical illness coverage
• Psychotherapy support in office or online
• Laser eye correction after one year, pregnancy and childbirth support after two years
• Medical insurance for family members with 80/20 cost sharing
• Internal educational platform, mentorship, and conference participation support
• Sports facilities and corporate sports teams with flexible schedules
• Flexible working hours without fixed start/end times
• Housing loans with preferential rates for employees in Russian offices
• Child-related benefits including insurance, office child days, gifts, and checkups