By agreement
Moscow · 3–5 years · 5/2 · Permanent contract
We are looking for a Data Engineer to work with HR data within the corporate DWH.
Responsibilities:
- Development and support of HR data loading and transformation pipelines
- Integration of sources (API, Kafka, DB, file storages)
- Building data marts and ensuring their consistency
- Optimization of performance and cost of data processing
- Ensuring stability (handling failures, retries, monitoring)
- Designing architectural solutions;
What we expect:
- Python at a confident development level:
- ETL/ELT pipelines
- working with APIs
- processing large volumes of data
- SQL at an advanced level:
- complex joins, window functions
- query optimization for large volumes
- understanding execution plans
- Practical experience with Greenplum (understanding MPP, data distribution, optimization), ClickHouse (building data marts, working with large tables), MS SQL Server
- Kafka:
- experience with consumer/producer
- understanding message delivery and processing semantics
- Confident work with REST API (pagination, retries, error handling)
- S3-compatible storages: reading/writing, data organization, partitioning
- Knowledge and understanding of data storage architecture: DWH, Data Lake, Lake House, Medallion, Federations, etc.
Bonus points:
- Experience with Trino (federated queries, working with multiple sources)
- Experience building DWH (staging / dds / marts)
- Understanding of data lineage and data quality control
- Orchestration experience (Airflow or similar)
Working with us – is:
- flexible bonus system;
- extended social package: voluntary medical insurance with dental care from the first month of employment, psychologist and life insurance, compensation for meals and mobile communication expenses;
- work in a company with a developed engineering culture;
- autonomy of work, the opportunity to change rules, make mistakes, and create new things;
- opportunities for professional growth, development programs for employees;
- corporate training and access to a knowledge base;
- internal professional communities and events;
- hybrid work format;
- modern office a 2-minute walk from MCC ZIL.
Location
Moscow, Likhachev Avenue, 15
LM Tech
