#удаленно #remote #Москва #data #engineer #data #analytics

We are looking for a Data Engineer with Data Analyst functions for cooperation through an Individual Entrepreneur structure, in the fintech sector.

Skills expected: • Experience with relational databases • Ability to create and optimize complex SQL queries. • Ability to design and create data models adapted for analytical tasks and efficient DWH operation. • Proficiency in Data Vault methodologies and other modern modeling approaches to ensure transparency, change history, and data recovery. • Experience in documenting data models and maintaining their compatibility with ETL/ELT processes and business metrics. • Ability to manage model changes with growing data volumes and evolving analytical requirements. • Programming language: Python

• object storage: S3
• data streaming: Kafka
• relational DBMS: Postgres, MSSQL
• NoSQL: MongoDB
• analytical DBMS: Clickhouse • Experience in creating and supporting data ETL/ELT pipelines. • Ability to create data models and transformations using dbt, knowledge of SQL and templating in dbt. • Experience in orchestrating processes using Apache Airflow, configuring DAGs, automating and monitoring ETL tasks. • Understanding of DataOps methodology and practices for model version control, testing, monitoring, and secure deployment. • Skills in documenting processes, working with technical documentation.

Tasks: • Analysis of data sources from legacy MSSQL databases: gathering information on content, identifying key business entities and dependencies, regulatory operations. • Design and optimization of data transfer flows from MSSQL to the new storage. • Development and support of data models and transformations in dbt for creating final data marts. • Organization and automation of orchestration processes with Airflow. • Ensuring data quality, testing, and integrity during migration and transformation. • Working with data streams and integrating with Kafka for real-time event exchange and transmission.

Compensation is discussed depending on experience. Remote work format. Full-time.