🛠Requirements:

• Proficient in the Hadoop ecosystem and PySpark framework;
• Deep knowledge of SQL;
• Experience in configuring and administering the Airflow task scheduler;
• Proficient in Python;
• Understanding of the Data Vault data model;
• Experience with the Git system.

📌Responsibilities:

• Analysis of data sources for subsequent integration;
• Communication with customers (clarifying detailed requirements, acceptance criteria, etc.);
• Creation of data marts prototypes for user reports;
• Description of objects in the data catalog, documentation in Confluence;
• Formation of data quality requirements (DQ checks);
• Acceptance of developed DE objects according to the criteria described in the business requirements.

📲Contact: @Iryn_pnz