SENIOR DATA ENGINEER (MICROSOFT FABRIC)

Location: Remote (Timezone: UK / CET) Salary: $5,000 – $9,000 (Gross) Client: BAT (British American Tobacco) — global FMCG leader. Important: Candidates from Russia and Belarus will not be considered.

About the Project: We are building a modern Data Warehouse and Lakehouse on Microsoft Fabric from scratch. You will work with terabytes of data, migrating from legacy ETL processes to a cutting-edge Medallion Architecture (Bronze/Silver/Gold). Full-cycle development: from infrastructure setup to CI/CD.

Tech Stack: Core: Microsoft Fabric (OneLake, Data Factory, Synapse). Processing: Apache Spark (PySpark), Dataflow Gen2. Languages: Python, SQL (T-SQL). Storage: Delta Lake (Parquet), Lakehouse / Data Warehouse. DevOps: Git, Azure DevOps / GitHub Actions, Docker. Visualization (Nice to have): Power BI.

Key Responsibilities:

• Design and build end-to-end DWH architecture from scratch (Medallion Layers).
• Develop robust ETL/ELT pipelines using ADF and Dataflow Gen2.
• Write and optimize high-performance PySpark code for large-scale data transformations.
• Optimize T-SQL queries within Synapse Data Warehouse.
• Configure Fabric Shortcuts for integration with AWS S3 / GCP.
• Implement CI/CD processes for infrastructure and code deployment.

Requirements:

• 5+ years of commercial experience in Data Engineering.
• Deep expertise in Microsoft Azure and the Fabric ecosystem.