Description
Our team is integrating the LLM GigaChat into Sber's products with a multi-million user audience. We are making the experience of interacting with advanced large language models accessible to everyone.
Responsibilities
- develop pipelines for model analysis, data collection, and labeling,
- create and implement metrics for evaluating the performance quality of complex systems with LLMs,
- conduct experiments to improve metrics for the base model and other LLM-based systems,
- work with complex labeling pipelines,
- use LLM-as-a-Judge in processes;
Requirements
- Proficient in Python.
- Understands ML metrics and data analysis.
- Applies statistics and probability theory in practice.
Bonus points for:
- Experience working with data for large ML models.
- Experience working with LLM models.
Conditions
- comfortable modern office near Kutuzovskaya metro station
- annual salary review, yearly bonus
- corporate gym and recreation areas
- training system for professional and career development
- extended voluntary health insurance policy from the first day of work and family insurance
- preferential mortgage program for employees
- free SberPrime+ subscription, discounts on products from partner companies
- referral bonus for recommending friends to the Sber team.
