Description
We are looking for an experienced professional for the Data Engineer position, who will be responsible for creating and maintaining infrastructure for processing large volumes of data. You will be involved in developing efficient processes for data collection, transformation, and storage to provide analysts and developers with the necessary tools for making informed decisions.
The first stage of selection for this vacancy is a conversation with an AI recruiter. After applying, you will receive an invitation via email to have a preliminary interview with GigaRecruiter in Telegram. The dialogue will take approximately 10 minutes. Its goal is to clarify missing details and expedite the review of your candidacy.
GigaRecruiter is just starting its journey, so we ask for your understanding. Your experience and participation will help make it convenient and useful!
Responsibilities
Tasks:
- design and implement ETL processes (Extract, Transform, Load)
- optimize existing data pipelines and improve database performance
- maintain Airflow for automating regular tasks and monitoring workflow status
- work with relational DBMS PostgreSQL and ClickHouse to ensure data warehouse reliability and scalability
- develop in Python for integrating various data sources
- collaborate with analytics and development teams to understand business requirements and implement necessary integrations.
Requirements
We expect from you:
- experience in the role of a data engineer from 1.5 years
- completed higher education
- knowledge of SQL and ability to write efficient queries
- official work experience with Python and the Airflow framework
- proficiency in PostgreSQL and understanding of relational database principles
- understanding of NoSQL system specifics.
Will be a plus:
- experience working with ClickHouse
- ability to solve performance problems and optimize database structure
- basic knowledge of Unix/Linux and working with the terminal.
Conditions
We offer:
- comfortable modern office near Kutuzovskaya metro station
- opportunity to choose a convenient schedule – office/hybrid
- annual salary review and yearly bonus
- corporate gym and rest areas
- more than 400 educational programs from SberUniversity for professional and career development
- extended voluntary health insurance, preferential insurance for family
- flexible mortgage discount, equal to 1/3 of the Central Bank's key rate
- free subscription to SberPrime+, discounts on products from partner companies
- reward for recommending friends to the Sber team.
