Gathering requirements and analyzing data sources. Developing and supporting integration flows and data marts.
Maintaining documentation and production data pipelines.
Requirements
With Big Data / Lakehouse experience. Stack: Greenplum, Trino, Apache Airflow, ClickHouse, Python, Spark, SQL/dbt, S3, Hadoop, Kafka, Iceberg, Flink.
Spark / Airflow / Trino / S3 / Iceberg. SQL optimization and working with relational databases.
Worked with dbt, Cosmos, NiFi, Spark and a modern Lakehouse stack.
Benefits
Location: 📍Remote.
Требования:
С опытом Big Data / Lakehouse. Стек: Greenplum, Trino, Apache Airflow, ClickHouse, Python, Spark, SQL/dbt, S3, Hadoop, Kafka, Iceberg, Flink. Сбор требований и анализ источников данных. Разработка и поддержка интеграционных потоков и витрин. Spark / Airflow / Trino / S3 / Iceberg. SQL optimization и работа с реляционными БД. Поддержка документации и production data pipelines. Работали с dbt, Cosmos, NiFi, Spark и современным Lakehouse-стеком.
