Analyst Developer (AI)

TL;DR

Analyst Developer (AI): Developing and improving the quality assessment and annotation technology for Yandex's Alice voice assistant based on LLM neural networks with an accent on data quality evaluation, bug fixing in LLM training, and crowdsourcing project management. Focus on formalizing product requirements, analyzing annotation quality, and collaborating with ML developers to enhance RLHF training and metrics.

Компания

Yandex is a leading Russian technology company developing AI-driven products including the Alice voice assistant and search technologies.

Что делать

• Formalize fuzzy product requirements into clear instructions for crowdsourcing and neural networks.
• Measure and improve LLM training quality, analyze and fix bugs with ML developers.
• Collect and update gold standard annotation sets aligned with product goals.
• Manage large-scale crowdsourcing projects: recruit, train, test annotators, and develop quality control processes.
• Create dashboards to monitor annotation performance, cost, and quality.

Требования

• Location: Must be based in Russia or able to work in Russian offices.
• Strong Python programming skills and knowledge of algorithms.
• Understanding and application of mathematical statistics for hypothesis testing.
• Experience with data analysis and SQL is a plus.
• Familiarity with crowdsourcing projects and machine learning basics is desirable.

Культура и преимущества

• Extended medical insurance including dental, emergency care abroad, and critical illness coverage.
• Psychotherapy support and laser vision correction after one year.
• Internal educational platform, mentorship, and conference participation support.
• Access to sports facilities and corporate sports clubs with flexible schedules.
• Housing loans with preferential rates for employees in Russian offices.
• Family support including insurance and child-related benefits.
• Flexible working hours without fixed start or end times.