Developer Wanted
Details:
Vacancy for DA/DE at Alfa-Insight. Vendor rate.
Requirements:
• 2+ years of experience in DA/DE positions within DWH/BI.
➡️Mandatory Hard Skills:
- Hands-on experience with Apache Spark — key requirement
- Advanced SQL knowledge: complex joins, window functions, CTEs, aggregations, subqueries, and query optimization.
- Experience optimizing Spark tasks and SQL queries on large data volumes.
- Experience with S3
- Experience with Apache Iceberg or understanding of its key capabilities
- Understanding of data warehouse (DWH) construction principles, ETL/ELT processes, data normalization, and data flow organization.
- Experience working with technical documentation (BRD, FSD), ability to write it clearly and structured.
- Data testing experience
- Experience with version control systems, including Git.
➡️Key Soft Skills:
- Systematic analytical thinking
- Communication skills
- Independence and responsibility
- Attention to detail and accuracy
➡️Will be a plus:
- Understanding of working principles with Oracle and Greenplum.
- Experience in the financial sector (banking, insurance, fintech).
- Basic Python knowledge for scripting and data analysis.
- Understanding of project management methodologies (Agile, Scrum, Kanban).
- Experience with ClickHouse, Airflow, Superset, FineBI.
- Understanding of data lake and lakehouse architecture organization principles.
☑️Responsibilities:
• Requirements Analysis:
- Receiving and analyzing incoming documentation from clients
- Detailed breakdown of requirements, their formalization, clarifying ambiguous points.
- Assessing implementation feasibility considering the technology stack used
- Analyzing the impact of changes on current processes, data models, tables, and related components.
• Design and Prototyping:
- Development and approval of conceptual and logical solutions.
- Designing data processing and transformation flows using Apache Spark.
- Working with data located in S3 and organized using Apache Iceberg.
- Writing SQL code within the Apache Spark environment to create prototypes, test hypotheses, and confirm the correctness of proposed calculation logic or data models.
• Testing and Release of Changes:
- Acceptance and testing of patches from developers on test/pre-production/production environments.
- Verifying the correctness of Spark tasks, SQL logic, S3 loads, and Iceberg table operations.
- Preparing and controlling the deployment of enhancements to the production environment.
To apply: recruiter contact
Contacts: recruiter contact
