Looking for a Data Engineer with at least 2 years of experience
Salary: net 130,000+ monthly bonus + 10,000 + annual bonus 100% of salary
Office only, full-time
Our stack: Yandex Cloud infrastructure (s3, Airflow, ClickHouse, Spark, Kafka, DataLens), Python, SQL, Kafka, Airflow
What you will be doing:
- Integrate data from various sources (Oracle, Yandex Metrica, AppMetrica, third-party databases) into ClickHouse;
- Develop data warehouse architecture, select technologies and approaches considering the specifics of each unit;
- Design and automate the assembly of data marts from raw data via Airflow;
- Be responsible for the stable operation of pipelines: monitoring, logging, support, bug fixing;
- Monitor and optimize the performance of the data storage system.
What is important:
- Advanced knowledge in working with distributed data storage and processing systems (priority ClickHouse, Spark);
- Confident knowledge of SQL (moderate drive for optimal queries and understanding of ways to achieve them);
- Advanced Python level for building EL, ETL, ELT pipelines with data quality assurance guarantees (priority Airflow);
- Accuracy, responsibility, attention to detail;
- Ability to work with code versions (Git).
Will be an advantage:
- Experience with cloud platforms (AWS, GCP, Azure, Yandex.Cloud);
- Understanding of the Iceberg table format and DataLake architecture (successful implementation experience is a significant advantage);
- Experience with the dbt framework (successful implementation experience is a significant advantage);
- Understanding of the concept of data observability and aspects of data catalog work;
- Striving for proactive work with data incidents;
- Understanding of the concept and tools for real-time data transfer (priority - experience with Kafka);
- Understanding of CI/CD (GitLab CI).
We offer:
- Official employment at the accredited IT asset of the company LLC "Er-1", paid vacation, business trips, sick leave;
- Office work in one of the R1 presence cities of your choice - Moscow, St. Petersburg, Perm;
- Voluntary health insurance with dentistry after the probationary period, 100% sick leave compensation;
- Corporate programs from our partners;
- Bonus connection to Dom.ru telecom services under the "Employee" tariff;