ML Browser Team Analyst-Developer

Our team is responsible for integrating and improving Alice in Yandex Browser, developing and enhancing ML in Browser features, enabling the AI assistant to see web pages and interact with them using agents.

We have launched a brief summary of videos and articles, neuro-editing capabilities — text processing based on YandexGPT, and a feature to answer questions about a page.

We are looking for a strong analyst-developer who will work on evaluating and improving the quality of our models.

What tasks await you

Working on Quality Metrics You will improve and develop product quality assessment processes, work on turning product features into measurable aspects of quality, and build evaluation pipelines based on crowdsourcing or LLMs.

Answer Quality You will collect data for training and quality control, build pipelines for working with this data, which will be used to improve the quality of our models' answers; together with the product team, you will identify areas for improving model quality.

Quality Solution Analytics For precise quality control of solutions, constant monitoring of model performance quality is necessary. For this, we conduct regular quality measurements and create tools for them.

Learn more about analytics at Yandex — in the channel Yandex for Analytics

We expect that you

• Have knowledge of mathematical statistics and probability theory
• Can code in Python and SQL
• Know the basics of ML

It will be a plus

• Have experience with Toloka or quality assessment pipelines
• Have experience in ML
• Have worked with LLMs or agents