We are the B2C Core Data Marts team – we are building a platform that will allow us to collect, process, and provide consumers with clean, high-quality data on products and internal processes of the Sber ecosystem.
Our team is focused on developing data products within the platform. We design, develop, and deploy reliable integrated data preparation pipelines into industrial operation, which will be used by thousands of consumers and business processes of the Sber ecosystem for analytics, ML, and product solutions.
You will gain experience working with real big data, a modern technology stack, and will be able to influence the platform and observe the results of your work.
Responsibilities
- loading, cleaning, and transforming large volumes of data from various sources (RDBMS, Hadoop, Spark, flat files)
- designing and developing analytical data marts
- monitoring and optimizing data loading, transformation, and mart assembly processes. Analyzing and resolving performance issues
- developing automated tools for data quality assessment
- developing, supporting, and optimizing infrastructure and internal services for processing large volumes of data
- developing tools for automating routine tasks related to data processing
- providing expert support to consumers on data-related issues
- skills in working with generative AI models;
- experience in creating AI agents and using them in work will be an advantage
- experience using GigaChat, Kandinsky, and similar tools in products, skills in creating and using AI agents
- instrumental mastery of AI for analysis, generation, and automation.
Requirements
- higher relevant education (engineering/mathematics/IT), technical English language proficiency
- 3+ years of experience as a Data Engineer / ETL Developer
- excellent knowledge of SQL and modern industrial DBMS (PostgreSQL/Greenplum, etc.)
- Java/Scala at middle+ level
- knowledge and experience with the Hadoop ecosystem (HDFS, Hive, Spark, YARN, Hbase, etc.)
- knowledge of basic concepts and principles in the field of DWH design and construction
- ability to use the Linux terminal, knowledge of basic commands and utilities
- experience with CI/CD (Jenkins, GitLab)
- knowledge of Git
Conditions
- annual salary review and annual bonus
- extended voluntary medical insurance and preferential insurance for family members
- Sber's unique training system for professional and career development
- favorable mortgage for employees
- Prime subscription with the possibility of sharing with three close contacts
- reward for recommending friends to the Sber team
- corporate pension program.
