Holyweb is a service-oriented IT company. For 7 years, we have been creating corporate systems and services for IT holdings, retail, fintech, and logistics companies.
We are dispelling myths about outstaffing and taking care of our employees: we match interesting projects with interested developers, share expertise within the company, and maintain a comfortable working atmosphere.
We are currently looking for a Data Engineer for one of our projects.
Responsibilities
- Design, development, and maintenance of ETL/ELT pipelines;
- Development of data loading and transformation flows between sources, DWH/Data Lake/Lakehouse, and data marts;
- Optimization of SQL queries, database structures, and pipeline performance;
- Working with large volumes of data, storage formats, and raw / processed / curated layers;
- Support of production processes: monitoring, incident analysis, documentation updates.
Requirements
- Data Engineer experience of 3 years for Middle, 5 years for Senior;
- Proficient SQL: complex queries, CTEs, window functions, optimization, working with DDL/DML;
- Experience in developing and maintaining ETL/ELT pipelines in production;
- Experience with Big Data / DWH / Lakehouse stack: Spark, Hadoop, Kafka, S3/S3-like, Airflow;
- Experience with relational and analytical databases: PostgreSQL / Greenplum / ClickHouse / Oracle / MySQL;
- Experience processing large volumes of data, working with Parquet / ORC / Avro formats;
- Proficient Python, experience in developing transformations and automating data processing;
- Experience with Git, Jira/Confluence, understanding of CI/CD.
Will be a plus:
- Experience in banking or enterprise environments;
- Experience with Trino / Presto, Apache Iceberg, Delta Lake, Hudi;
- Experience with CDC and Batch integrations;
- Experience with NiFi, dbt, Cosmos, Flink;
- Experience optimizing Spark: partitioning, shuffle, broadcast joins.
Conditions
- Inevitable development of professional skills;
- Work on high-load, actively developing services with complex business logic and many engineering challenges;
- Opportunity to propose and implement your idea on how to improve the service or a new functionality;
- Work in an accredited IT company;
- Remote work option;
- HolyRelax bonus program;
- Competitive salary.
