Description
In our SberWorks tribe (Sber), a new team is being created that will be responsible for the development and maintenance of a separate internal data storage component (Data Lake) within the new Productivity Platform.
This component will become the foundation for storing all data from the tools included in the platform and will be used to build analytics of the production process, train AI assistants, and provide prepared data marts to consumers.
The goal of creating the Productivity Platform is to provide a unified and seamless path for Bank teams, reducing production costs through maximum automation and the application of artificial intelligence at every stage of the production process.
The Data Lake is the "lifeblood" of the platform, and your role in this project will be key!
Responsibilities
Your tasks:
- Deploying and maintaining a Data Lake with the Hadoop ecosystem, Hive, PostgreSQL, Ranger, Trino, OpenMetaData, Spark, AirFlow, OpenShift, Prometheus. You will be responsible for setting up and supporting the infrastructure that ensures the reliable operation of all platform components.
- Ensuring the uninterrupted operation of the Data Lake and all its components. Your task is to guarantee the stable and efficient operation of the entire system, minimizing downtime risks and ensuring a high level of data availability.
Requirements
Requirements
- Knowledge of the Hadoop ecosystem. You must be proficient with various Hadoop components and be able to configure and optimize their operation.
- Experience working with Linux systems and their diagnostic tools (from 2 years). You will actively work with Linux-family operating systems, diagnose problems, and find effective solutions.
- Skills with Infrastructure as Code tools: Ansible, Helm. Automating infrastructure configuration and management processes is an important part of your work.
- Experience working with Kubernetes (K8S) or OpenShift orchestrators. Containerization and application management using Kubernetes are key aspects of working on the platform.
- Understanding monitoring principles at all levels. You know how to organize monitoring and logging to promptly detect and resolve issues.
Conditions
Our conditions
- Modern comfortable office near Kutuzovskaya metro station
- Annual salary review and annual bonus
- More than 400 educational programs from SberUniversity. The opportunity to constantly improve and develop professional skills
- An adaptation program and manager support at the start. We will help you quickly integrate into the team and start productive work
- Extended voluntary health insurance, preferential insurance for family, and a corporate pension program. Caring for you and your loved ones is an important aspect of our collaboration
- Corporate gym and relaxation areas
- More favorable mortgage rates of up to 7% for every employee. Special mortgage lending terms will make purchasing a home more accessible
- Subscription to SberPrime+, discounts on products from partner companies
- Reward for recommending friends to the Sber team. By attracting new talented specialists, you can earn additional rewards
Join our team and become part of a large and important project that will change the way the Bank works!
