ML Researcher of Generative Personalization Models

We are solving the personalization task using LLM-like technologies: we map users into a specialized token space and process the resulting sequences using generative models. The results of our team's work are applied in all major Yandex recommendation systems.

Research in our team covers the following areas:

Pretraining generative models from random weights
Adaptation of industrial architectural trends such as MoE, quantization, Linear Attention, context compression techniques
Training reward models based on transformer architecture
RL using variations of GRPO
Continuous learning
User tokenization models

We also publish works at international conferences:

Our dream is to build a single-stage generative recommendation system and integrate it into an LLM as a new modality.

What tasks await you

Optimize neural network architecture We are constantly evolving the architecture and training recipes of our models, adapting the latest industrial trends. Our task is not only to ensure high prediction quality but also to handle the load created by Yandex's many millions of users.

Develop tokenization algorithms Tokenization in generative personalization models is an actively developing area. It includes building semantic models, researching quantization algorithms, and continuous learning.

Research Alignment using RL We are building algorithms that adapt to user tastes using GRPO, learning from both reward models and direct feedback.

Integrate into LLM as a new modality We research not only generative personalization models but also the possibilities of combining them with LLMs to build systems with unique properties: the ability to follow instructions and explain recommendations.

More about ML at Yandex — in the channel Yandex for ML

We expect that you

Deeply understand how modern DL works from both scientific and engineering perspectives
Team player: ready to tackle a wide range of tasks that move the team forward
Keep up with trends in areas such as LLM, multimodality, RecSys

Contacts

What tasks await you

We expect that you

Similar vacancies

ML Researcher in Generative Personalization Models

ML Engineer for the Online Learning of Generative Personalization Group

Senior ML Developer for Content System of Product Search Team

ML Developer for the Recommendation Systems Team

ML Developer-Researcher for R&D in Recommendation Systems

ML Developer for Generative Ecom Scenarios (LLM) Team

ML Engineer for the Recommendation Technologies Propagation Team

ML Developer for the Generative Responses Trigger Group

Senior LLM Developer at Neuro

ML Developer for the Search Blender Team

Senior DL Developer for Neuro Team

ML Developer for Ecom Scenarios Team

ML Researcher of Generative Personalization Models

Key Skills

Details