The team is developing the data integration domain for a major bank.
The team is involved in building and developing the Unified Integration Layer and custom data marts, which ensure the operation of analytical systems, application services, and internal bank products.
Responsibilities:
- Develop ETL processes and data integration flows.
- Design and create standard ETL application modules.
- Participate in the design of data flow architecture.
- Develop and implement corporate development standards.
- Conduct code reviews and control solution quality.
- Prepare technical documentation.
- Participate in the testing and maintenance of ETL solutions.
- Assist the support team in investigating and resolving defects in the production environment.
- Interact with architects, analysts, and related teams.
Requirements:
- Commercial Big Data development experience of 3+ years.
- Proficient knowledge of Python and SQL.
- Experience with Apache Spark / PySpark.
- Experience in developing and maintaining ETL processes.
- Practical experience with Apache Airflow.
- Experience with Hadoop/HDFS.
- Experience with S3 or S3-compatible storage.
- Knowledge of Parquet and ORC formats.
- Experience with Git and CI/CD tools.
- Experience using Jira and Confluence or similar systems.
- Understanding of system analysis and testing principles.
- Basic understanding of Kafka operation.
- Practical experience with Data Vault architecture.
- Ability to write technical documentation.
Will be an advantage:
- Experience with Apache Kafka.
- Experience with Apache Iceberg.
- Experience in the banking sector or large corporate projects.
- Mentoring and code review experience.
