#vacancies #job #Data #Engineer #Инженер #Russia #RF #Java #Groovy #BigData #Hadoop #ETL #DWH #remote #Senior
Senior Data Engineer
Hourly rate: 2000-2700 RUB gross.
Location: remote work from RF, RB.
Project: retail
Company: Omega Solutions
Requirements
- Proficiency in one of the programming languages (Java, Groovy), knowledge of OOP principles, ability to read others' code;
- Experience in building projects, compiling, and deploying in Rancher (Docker);
- Experience in designing, implementing, developing, and supporting integration solutions using BigData technologies;
- Knowledge of SQL (indexes, functions, ability to read query plans, query optimization);
- Experience with any relational database (Oracle, Postgres, MySQL, MsSQL, DB2, etc.);
- Ability to work with Git in the console;
- Knowledge of ETL tools specifics (Apache Nifi, Airflow, SAP BW integration buses, Talend, Informatica, SAS, etc.);
- Experience with Hadoop;
- Understanding of HDFS structure, data formats;
- Experience with Hive or any other Hadoop-based storage;
- Experience using project management and documentation systems;
- Ability to work with architectural diagrams;
- Understanding of DWH and DataLake principles for data construction and storage.
Additional Requirements
- Desirable experience in administering Unix/Linux or Hadoop (HDFS, Yarn, Ranger, Spark, Zookeeper), Zabbix, Ansible;
- Understanding of SAP HANA diagnostic and trace files: structure, purpose, basic event interpretation;
- Confident Python/Go/Java/C++/Rust for parsing logs and binary formats, experience in writing utilities for file parsing;
- Experience with SAP HANA as a data source: HANA SQL dialect, data types, export formats (CSV/binary), basic administration is useful;
- Ability to transform parsed data into Iceberg/Paimon format (tables, events, JSON) and export to Apache Kafka (or any other suitable source);
- Practice in data engineering/observability/SRE: automation of log/trace analysis, investigation of performance incidents and errors.
Tasks:
• Development and support of integrations
• Technology selection and complex problem-solving
• Quality and documentation control
• Architecture and process development (CI/CD)
Conditions
- оформление по ИП (Registration as an Individual Entrepreneur)
- Friendly atmosphere within the company
- Development through real tasks, not formal courses
- Opportunity to propose ideas and see them implemented
- Flexible working hours and remote work option
- Payment for time actually worked
- Participation in interesting projects without excessive micromanagement
Contact: @CodeVal
