Description
Our team is engaged in assessing and managing model risk. Model risk arises from decisions based on incorrect or misinterpreted models, leading to financial and reputational losses.
We validate all Sber models capable of significantly impacting financial results, develop and automate methods for validating models of various classes. We also build a reporting system for model risk management and a platform for online monitoring and auto-validation of models.
Responsibilities
- understand LLM architectures, as well as solutions based on them (agents, RAG, etc.)
- testing the correctness of models for the correctness of GenAI solutions
- research approaches to modeling and validation of various GenAI solutions, define their methodology, apply advanced technologies, and disseminate developments
- automate the validation process.
Requirements
- higher education in technical / physics and mathematics sciences
- knowledge of classical machine learning and statistical analysis
- knowledge of algorithms and data structures
- knowledge of Python and data analysis libraries: PyTorch, HuggingFace, and Transformers
- knowledge of PySpark, SQL
- experience working with databases
- experience in model analytics and managing the model stack in the business process
- understanding of the principles of operation, training, and quality assessment of large language models (LLM) and generative transformers like GPT
- skills in working with generative AI models; experience in creating AI agents and using them in work will be an advantage
- experience using GigaChat, Kandinsky, and analogues in products, skills in creating and using AI agents
- instrumental proficiency in AI for analysis, generation, and automation.
Conditions
- comfortable modern office near Volgogradsky Prospekt metro station
- hybrid work format
- annual bonus
- corporate gym and relaxation areas
- more than 400 educational programs from SberUniversity for professional and career development
- regular meetups and a well-developed DS community
- extended voluntary health insurance (VHI), preferential insurance for family, and a corporate pension program
- flexible mortgage discount equal to 1/3 of the Central Bank's key rate
- free SberPrime+ subscription, discounts on products from partner companies
- referral bonus for recommending friends to join the Sber team.
