Looking for a Data Engineer with at least 2 years of experience

Salary: net 130,000+ monthly bonus + 10,000 + annual bonus 100% of salary

Office only, full-time

Our stack: Yandex Cloud infrastructure (s3, Airflow, ClickHouse, Spark, Kafka, DataLens), Python, SQL, Kafka, Airflow

What you will be doing:

• Integrate data from various sources (Oracle, Yandex Metrica, AppMetrica, third-party databases) into ClickHouse;
• Develop data warehouse architecture, select technologies and approaches considering the specifics of each unit;
• Design and automate the assembly of data marts from raw data via Airflow;
• Be responsible for the stable operation of pipelines: monitoring, logging, support, bug fixing;
• Monitor and optimize the performance of the data storage system.

What is important:

• Advanced knowledge in working with distributed data storage and processing systems (priority ClickHouse, Spark);
• Confident knowledge of SQL (moderate drive for optimal queries and understanding of ways to achieve them);
• Advanced Python level for building EL, ETL, ELT pipelines with data quality assurance guarantees (priority Airflow);
• Accuracy, responsibility, attention to detail;
• Ability to work with code versions (Git).

Will be an advantage:

• Experience with cloud platforms (AWS, GCP, Azure, Yandex.Cloud);
• Understanding of the Iceberg table format and DataLake architecture (successful implementation experience is a significant advantage);
• Experience with the dbt framework (successful implementation experience is a significant advantage);
• Understanding of the concept of data observability and aspects of data catalog work;
• Striving for proactive work with data incidents;
• Understanding of the concept and tools for real-time data transfer (priority - experience with Kafka);
• Understanding of CI/CD (GitLab CI).

We offer:

• Official employment at the accredited IT asset of the company LLC "Er-1", paid vacation, business trips, sick leave;
• Office work in one of the R1 presence cities of your choice - Moscow, St. Petersburg, Perm;
• Voluntary health insurance with dentistry after the probationary period, 100% sick leave compensation;
• Corporate programs from our partners;
• Bonus connection to Dom.ru telecom services under the "Employee" tariff;