LLM Developer

TL;DR

LLM Developer (AI Engineering): Developing a distributed learning framework for large language models (LLM) at massive computational scales with an accent on state-of-the-art parallel training efficiency and automation for diverse NLP tasks. Focus on designing scalable, extensible frameworks and solving frontier industry challenges in LLM training infrastructure.

Что делать

• Implement and research cutting-edge methods for efficient LLM training on 10k+ GPU clusters.
• Create mechanisms for high utilization across various NLP tasks without complex tuning, leveraging ML for Systems.
• Develop a user-friendly and extensible framework for both experts and product teams integrating LLMs.

Требования

• Location: Must be based in Russia (implied by company and benefits).
• Strong proficiency in Python and best engineering practices.
• Experience with PyTorch; JAX or TensorFlow also acceptable.
• Understanding of modern LLM architectures and typical NLP tasks.
• Knowledge or willingness to learn parallelism approaches in model training.

Хорошо, если есть

• Interest or experience in ML/DL research.
• Understanding of GPU architecture and inter-GPU communication.
• Ability to work with many unknowns and open problems.

Культура и преимущества

• Comprehensive health insurance including dental, annual checkups, emergency care abroad, critical illness coverage, and accident insurance.
• Psychotherapy support in office or online, laser vision correction after one year, pregnancy and childbirth support after two years.
• Insurance coverage for family members (80% paid by company for children and spouses).
• Internal educational platform, mentorship, and leadership development programs.
• Paid participation in professional conferences as speaker or attendee.
• Sports facilities in major offices with equipment, trainers, and corporate sports teams.
• Flexible working hours without fixed start or end times.
• Housing loans with preferential rates for employees in Russian offices.
• Child-related benefits including insurance, office children's days, gifts for newborns, and pregnancy planning checkups.