Data Engineer at X5 Tech for developing streaming data on Apache Flink. Tasks include designing stream architecture and developing Java applications for Big Data.
Tasks:
- Development of data stream templates based on Flink DataStream
- Implementation of data stream architecture
- Writing and refining Java applications for Big Data
Requirements:
- Java Core: deep understanding of OOP, multithreading, collections, exceptions, and generics
- Spring Boot: experience in developing microservices and REST APIs, including Spring Data, Security, Actuator, and AOP
- Apache Flink: experience in stream processing, including DataStream API, state management, checkpoints, and Flink CDC
- Data Engineering: experience with ETL/ELT, streaming and batch processes; Airflow and Temporal tools
- Framework Design: understanding of framework and library design principles
- Big Data: knowledge of Big Data principles (Spark, Dask, pandas — a plus)
- Databases: experience with PostgreSQL, ClickHouse; knowledge of Iceberg and Paimon formats
- CI/CD and DevOps: skills in working with CI/CD, Docker, Kubernetes (a plus)
- Code Quality: ability to write unit and integration tests, maintain code quality and maintainability
- Python programming experience: scripts, microservices, applications
Conditions:
- Work format: remote or hybrid or office
- Full-time employment
- Schedule: 5/2
Skills:
- Java
- Spring Boot
- Apache Flink
- ETL
- ELT
- Airflow
- Temporal
- Spark
- Dask
- pandas
- PostgreSQL
- ClickHouse
- Iceberg
- Paimon
- CI/CD
- Docker
- Kubernetes
- Python
