Senior Data Engineer

Requirements: Tech Stack: Greenplum, Trino, Apache Airflow, ClickHouse, Python, Spark, SQL (dbt), S3, Hadoop. General understanding of Lakehouse technology stack. Understanding the difference in operation between BigData/Lakehouse and regular-sized data. Knowledge of SQL (indexes, functions, optimization, performance profiling). Knowledge of programming languages (JAVA, Python). Experience with relational databases (Oracle, Postgres, MySQL, MsSQL, etc.). Ability to work with Git (knowledge of git pull/commit/push commands). Experience with DBT, Cosmos, Ni-Fi. Experience developing on Spark. Skills in using Hadoop ecosystem components: Yarn, Ranger, Zookeeper, Hive metastore. Understanding Trino specifics. Understanding of data formats Iceberg, Parquet, Avro. Understanding how to work with minio or any other S3-based storage. Experience using project management and documentation systems. Experience developing non-standard integrations (including SAP systems). Experience developing near-realtime streams (Flink, Debezium). Experience optimizing high-load streams (billions of incremental records) using Observability tools (grafana, victoria metrics, zabbix).

Contact for application: linkedin.com/in/татьяна-т-3700b8218