Data Engineer

❕Accredited IT company "Systems and Algorithms" is looking for a Data Engineer!❕

Role: Data Engineer Salary: 270,000 - 295,000 RUB gross Work Format: remote within Russia Employment Type: full-time Location: any city in Russia Citizenship: RF

✨Position Advantages: • Participation in a large-scale digital transformation project, impacting key production processes. • Opportunity to see the results of your work in real production, including real systems, terminals, and integrations. • Access to a team of experienced developers and project support: Team Lead, Product Owner, Project Manager. • Space for initiatives, development, and expansion of responsibility.

✨Role Description: We are looking for a data engineer with strong data and database architecture competencies who can take on the planning and implementation of data storage and processing tools. Must have proven experience with our technology stack (Postgres, MSSQL, Kafka, Flink, Airflow, Iceberg, Trino/StarRocks), be able to design target storage architecture, analyze data flows, and select relevant tools. Critical skills include working with modern data tools, pipeline design experience, ensuring data quality, and confident Python proficiency for writing DAGs, custom operators, and integrations.

🔹 What we expect from you: • At least 4 years of experience as a Data Engineer in software development. • Experience with the key components of our stack:

• ODBMS/DBMS & Warehouses: confident work with Postgres and MSSQL; experience in setting up and optimizing OLAP engines (Trino, StarRocks) and modern storage systems (Cassandra, Redis).
• Data Flow Tools: practical experience with Apache Airflow (writing DAGs, custom operators); experience using Apache Kafka (producer/consumer) and Apache Flink (developing streaming jobs, state, checkpoints).
• Data Lake / Lakehouse: experience with Apache Iceberg, understanding of lakehouse architecture, using Lakekeeper for metadata management, working with S3 object storage.
• CDC: experience implementing Change Data Capture patterns for data synchronization between systems. • Deep knowledge in data and database architecture: understanding of normalization and denormalization principles, designing relational and columnar models, data management strategies (lifecycle, retention, versioning). • Confident Python proficiency: writing scripts, modules, working with asynchronous operations when needed; experience writing DAGs in Apache Airflow, including custom operators, hooks, sensors. • Optimization skills: ability to profile processes, identify bottlenecks, optimize SQL queries, and tune cluster resources under load. • Proficient user of Jira and Confluence (page structure, templates, macros, linking tasks and documentation). • Experience organizing data storage for subsequent OLAP / OLTP tasks, considering requirements (consistency / integrity). • Experience organizing data processing within OLAP / OLTP tasks using various patterns (batch processing, CDC). • Understanding of key features and application scenarios for different integration flow patterns (batch processing, CDC) considering their characteristics (3V+). • Experience creating and supporting requests in Service-Desk. • Ability to structure information, work with requirements, and document technical solutions. • English – at a level sufficient for reading and writing technical documentation.

🔹 Will be a plus: • Experience with Timeseries databases (InfluxDB, TimescaleDB, TDengine, etc.). • Deep experience operating clusters (Hadoop, YARN, Kubernetes) in a production environment. • Advanced SQL knowledge (optimizing complex queries, window functions, CTE). • Experience with CI/CD for data pipelines. • Understanding of DDD, event-driven architecture principles. • Experience with Apache NiFi.

📲 Contact Information:

• +7 969 865 43 07