The CDO B2C team is looking for a Data engineer in the field of data management and data products.
Our team is responsible for managing all B2C customer segment data of Sber. We have already transformed the approach to data management, built a unified detailed data layer, and continue to improve its relevance and completeness. We also face ambitious tasks of building a unified layer of B2C aggregates and features, implementing the entire data delivery pipeline in RealTime, and introducing a new technology stack, which will allow us to create a single source of truth for management reporting, models, and front-end systems, as well as capitalize on data through its repeated reuse.
Responsibilities
- DWH/DataLake/LakeHouse development
- Building data delivery in RealTime/NRT/Batch
- Conducting code reviews of other developers
- ETL optimization
- Introducing new technologies/new stacks into existing solutions
- Improving data relevance
- Reducing data access latency
- Developing and validating data architecture
Requirements
- excellent knowledge of SQL (join, CTE, window functions, frames, etc.)
- experience with Hadoop, Spark, Iceberg/Paimon, S3
- experience with Kafka and other brokers
- experience with orchestrators (e.g., Airflow) and CI/CD
- experience in building data architecture (e.g., Data Vault, Inmon, Kimball, etc.)
- experience in multi-fold ETL optimization
- practical knowledge of Python at the ETL development level
- practical knowledge of Java/Scala will be an advantage
- practical experience in creating and defending data architecture will be an advantage
- practical experience in developing solution architecture for data products will be an advantage
- skills in working with generative AI models; experience
- creating AI agents and using them in work will be an advantage
- experience in using GigaChat, Kandinsky, and similar tools in products, skills in creating and using AI agents
- instrumental use of AI for analysis, generation, and automation
Conditions
- office format (Poklonnaya 3k1)
- annual salary review and annual bonus
- extended voluntary medical insurance and preferential insurance for family
- Sber's unique training system for professional and career development
- favorable mortgage for employees
- Prime subscription with the possibility of shared use among three close people
- reward for recommending friends to the Sber team
- corporate pension program.
