#vacancy #job #Senior #Data #engineer #BigData/#Lakehouse #Java #Python #Spark

❤️Senior Data engineer Salary: 280k - 300k RUB net Format: Remote work from RF, RB. Company: Omega Solutions Project: Retail

☀️Requirements:

• General understanding of the Lakehouse technology stack;
• Understanding the difference in operation between BigData/Lakehouse and data of ordinary size;
• Knowledge of SQL (indexes, functions, optimization, performance profiling);
• Knowledge of programming languages (JAVA, Python);
• Experience with relational databases (Oracle, Postgres, MySQL, MsSQL, etc.);
• Ability to work with Git (knowledge of git pull/commit/push commands);
• Experience with DBT, Cosmos, Ni-Fi;
• Experience in Spark development;
• Skills in using Hadoop ecosystem components: Yarn, Ranger, Zookeeper, Hive metastore;
• Understanding of Trino specifics;
• Understanding of data formats Iceberg, Parquet, Avro;
• Understanding of working with Minio or any other S3-based storage;
• Experience using project management and documentation systems;
• Experience in developing non-standard integrations (including SAP systems);
• Experience in developing near-realtime streams (Flink, Debezium);
• Experience in optimizing high-load streams (billions of increment records) using Observability tools (grafana, victoria metrics, zabbix).

👁Tasks:

• Development, implementation, and support of integration flows, as well as data mart assembly flows using the technology stack adopted by the team: Trino, Iceberg, S3, Spark, Apache Airflow, Kafka, Cosmos, Flink;
• Development of non-standard integrations (including SAP);
• System development of data processing tools (reusable templates);
• Development of system design for complex solutions (C2/DD);
• Prompt response to information about problems in the area of responsibility, execution of standard tasks within the established timeframe;
• Maintaining up-to-date documentation of standard integration solutions for the big data platform;
• Providing reports on activities to the manager.

🤩Conditions Employment via Sole Proprietor (IP) Friendly atmosphere within the company Development through real tasks, not formal courses Opportunity to offer ideas and see them implemented Flexible working hours and remote work option Payment for actual hours worked Participation in interesting projects without unnecessary micromanagement

❤️Contact: @TatiSolar Catching your signals!