Data Engineer — 2GIS
2GIS CDP is an internal Customer Data Platform that forms the foundation of 2GIS's development strategy for the coming years.
CDP integrates data from dozens of sources, builds unified user profiles, calculates metrics, interests, and behavioral models, helps launch real-time personalization directly within the product, and manages personalized advertising and communication.
This is a startup within a large company — with freedom in architecture and technologies, highload tasks, and real impact on business results.
About the Team
We bring together engineers, analysts, and ML specialists who are building a system that is changing the approach to data in 2GIS.
We work with large volumes of events, consider architecture for scale and reliability, and value simple and elegant solutions.
Everyone on the team influences the architecture, approaches, and direction of CDP development.
Our Stack
- Backend: Go, gRPC
- Frontend: TypeScript, React
- Autotests: Python, Playwright, Allure
- Infrastructure: Kubernetes, Kafka, ClickHouse, Spilo/PostreSQL, Spark, Airflow
The stack is still being formed — you can influence its development and architecture.
Your Responsibilities
- Improve the efficiency of pipelines for calculating daily features based on batch processing.
- Create an efficient pipeline for calculating real-time features based on Kafka topics.
- Design and develop services that process billions of user events.
- Solve complex engineering problems: metric calculations, building data marts.
- Work with data streams and integrations between CDP and other 2GIS systems.
- Influence architectural decisions and code quality.
- Work in a distributed team, interacting with analysts, product managers, and engineers from other departments.
What We're Looking For
- Experience with highload systems.
- Experience in designing data architecture or platform code.
- Experience with Kafka, ClickHouse, or other streaming and analytical data processing systems.
- Good understanding of how Spark works and ability to use it effectively.
- Proficiency in one of the programming languages (e.g., Python or Scala).
- Independence and proactivity — you don't wait for assignments, you propose solutions.
- Desire to understand business logic and create a product, not just write code.
Will be a plus:
- Experience with Airflow.
- Experience in data analysis using SQL.
- Knowledge of monitoring tools and automated data quality control (Data Quality, Data Contracts).
- Experience in building Data Lineage and working with Data Catalogs.
- Understanding of personalization, segmentation, or real-time analytics approaches.
- Understanding of how S3 storage works.
Why It's Cool
- Scale: millions of users, billions of events, hundreds of integrations.
- Growth: CDP is a strategic direction, we are growing rapidly and enabling the team to grow.
- Freedom: minimum bureaucracy, maximum responsibility.
- Visible Results: everything you do impacts 2GIS product, communications, and advertising.
