Analyst Developer (Multimodal Models)

TL;DR

Analyst Developer (Multimodal Models): Developing and improving tools for evaluating and enhancing multimodal visual-text generative models with an accent on dataset creation, quality assessment, and identifying model weaknesses. Focus on designing evaluation benchmarks, data annotation processes, and improving model performance in NLP and computer vision tasks.

Компания

Yandex is a leading technology company specializing in AI and software development.

Что делать

• Create tools to evaluate the quality of model responses across diverse task classes.
• Research and identify growth points and weaknesses in the model's performance.
• Develop and improve datasets used for model training and benchmarking.
• Adapt open-source benchmarks and manage data annotation with remote performers.

Требования

• Experience in analytics for more than one year
• Proficiency in Python and SQL with knowledge of main libraries
• Basic understanding of machine learning
• Ability to design data annotation processes for remote performers

Хорошо, если есть

• Familiarity with Toloka or other crowdsourcing platforms
• Experience creating data annotation processes with remote performers
• Experience working with computer vision products

Культура и преимущества

• Comprehensive medical insurance including dental, annual checkups, emergency care abroad, critical illness treatment, and accident insurance.
• Psychotherapy services in office or online, laser vision correction after one year, pregnancy and childbirth support after two years.
• Insurance coverage for relatives with 80/20 cost sharing.
• Internal educational platform, mentorship, and support for professional development and conference participation.
• Sports facilities and clubs in major offices with equipment, trainers, and team activities.
• Flexible working hours without fixed start or end times.
• Preferential housing loans for employees working in Russian offices.
• Child-related benefits including insurance, office children's days, gifts for newborns, and pregnancy planning checkups.