In our team, we handle tasks across the entire development cycle: from research and hypothesis testing to creating tools and launching them into production.
Responsibilities:
- Developing metrics for evaluating AI tools
You will develop metrics that objectively show the benefits of AI technologies at different stages of creating new features. According to recent research, such tools accelerate development, but not as much as expected.
- Analyzing development optimization
You will use an analytical approach to develop metrics — this will help to more accurately assess the benefits of implementing technologies and find insights.
Requirements:
- You write fast and reliable code in Python
- You are proficient in YQL and optimize queries for large volumes
- You have a good understanding of mathematics and statistics: you correctly assess effects and understand the physical meaning of metrics
- You know how to research and test hypotheses on data (formulation → calculation → conclusions)
- You are interested in modern AI development tools and want to understand exactly what needs to be measured in them
It will be a plus if you:
- Have experience with big data and high-load systems
- Have designed and supported metrics, including dashboards and monitoring
- Have an ML/DS background: you know how to evaluate models and metrics, and understand sources of bias
Conditions:
- Expanded medical insurance starts from the first month at Yandex. It includes dentistry, annual check-ups, emergency care abroad, treatment for critical illnesses, including oncology, and accident insurance.
- Yandex offers everything for continuous development and learning: an internal educational platform, mentorship, and programs for junior and experienced managers.
- All major Yandex offices have gyms with all the necessary equipment: exercise machines, sports equipment, showers, and changing rooms. You can train independently or with a corporate trainer.
- Flexible schedule. We do not have fixed start and end times for the workday — work in a way that is convenient for you and your team.
- Housing loans. Preferential rates for purchasing housing and improving housing conditions — depending on tenure, position, and review results. Available to employees working in Russian Yandex offices.
- Everything for children. Insurance, children's days at the office, gifts for the birth of children, and check-ups when planning a pregnancy.
