Description
IT B2C is the largest ecosystem within Sber. We have over 8,000 people across 18 cities in Russia. We are engaged in the development and enhancement of retail solutions, helping to make the Bank's services more accessible, secure, and convenient.
We are looking for a Data Mart Engineer to join our team and take on the development and support of data marts based on Hadoop. You will be involved in the full development cycle, starting from requirements analysis through to implementation and solution support.
Responsibilities
- Designing, developing, and maintaining data marts on the Hadoop platform
- Optimizing the performance of existing data marts
- Participating in the development of ETL processes for loading data into data marts
- Supporting and monitoring the operation of data marts
- Interacting with business users to understand their needs and translate them into technical requirements
- Interacting with development and data analytics teams on data collection, processing, and storage matters
- Investigating data quality incidents, developing automated tests (Data Quality)
- Documenting developed solutions
Requirements
- Hands-on experience in developing data marts, building ETL processes
- Proficient knowledge of SQL (analytic functions, subqueries, stored procedures/functions, performance optimization), willingness to create tools for infrastructure and development needs
- Experience with Hadoop (HDFS, YARN, Hive) and Spark
- Knowledge of Java/Scala and development experience in it
- Python development experience
- Understanding of Big Data tools and technologies
- Knowledge of principles for building distributed data storage and processing systems
- Experience in processing and migrating large volumes of data between various sources
- Experience with version control systems (Git)
Will be a plus:
- Experience with Kafka
- Experience with CI/CD tools (Jenkins, GitLab CI).
- Basic knowledge of Docker and other containerization technologies
- Experience with Unix systems (bash)
- Skills in working with generative AI models; experience in creating AI agents and using them in work will be an advantage.
Conditions
- Office/hybrid work format in Moscow
- Annual salary review and annual bonus
- Extended voluntary health insurance and preferential insurance for family
- Sber's unique training system for professional and career development
- Preferential mortgage for employees
- Free SberPrime+ subscription, discounts on partner company products
- Referral bonus for recommending friends to join the Sber team
- Corporate pension program.
