🔥 Vacancy Data Engineer (FinTech / Outstaff)

Project: FinTech, high load, industrial landscape. Format: Outstaff (long-term). Income Level: Up to 290,000 RUB net. Company: Brief

Key Tasks: We are looking for a strong engineer who can independently manage projects and advise colleagues on architecture. The role involves working with large volumes of data, optimizing pipelines, and developing the corporate data warehouse.

Stack and Requirements: ✅ Experience: 4–6+ years in building DWH and industrial ETL landscapes. ✅ Greenplum: Deep understanding of data distribution, partitioning, query plan optimization. ✅ Apache Spark: Designing high-performance pipelines. Understanding RDD, DAG, shuffle, bottleneck elimination. Cluster infrastructure tuning. ✅ Languages: Java & Python (hybrid ETL solutions). ✅ ETL/Orchestration: Airflow, Luigi, dbt. ✅ Architecture: Designing logical and physical DWH models. Proficiency in Data Vault 2.0 (HUB/SAT/LINK). ✅ DevOps: CI/CD for ETL (Liquibase, Jenkins, GitLab CI). ✅ Data Quality: Setting up monitoring, quality metrics, alerting, and automatic process recovery.

Will be a plus: 🔹 Migration experience (Oracle → Greenplum). 🔹 Development of a unified ETL framework for the team. 🔹 Mentoring skills and implementation of best practices.

What you will do: — Lead the architecture of data flows and models. — Optimize pipeline performance for large volumes. — Configure monitoring of Spark jobs and SLAs with the business. — Influence the development of the corporate analytical platform.