- Databases
- From 3 years
- Moscow
- Hybrid/Remote/Office
United company Wildberries and Russ is an international technology company formed by the merger of two market leaders – IT company Wildberries and outdoor advertising operator Russ. Pricing builds and develops an analytical data warehouse for the "Pricing Platform" product. The team is responsible for 4 products with different focuses: analytics, backend, ML.
Your tasks will include
- Designing and developing data loading pipelines. Doing it optimally depending on the needs of consumer teams;
- Designing data loading, layering, and views in ClickHouse: choosing table engines, sort and partitioning keys, sharding and replication keys;
- Optimizing queries and storage: understanding why a query is slow or a table is growing faster than expected, and fixing it;
- Developing and maintaining DAGs in Airflow: idempotency, retries, backfills, task dependencies;
- Ensuring data quality: checks for completeness and consistency, reconciliations between systems, alerting and monitoring of pipelines;
- Working directly with product teams and analysts: understanding requirements, agreeing on data contracts, explaining limitations and proposing solutions.
We expect from you
- Experience with ClickHouse (this is a key skill for this position. You need to be able to identify problems on the cluster, understand how to work with a distributed database, how to optimally build pipelines without crashing the cluster);
- Proficient SQL, working with large volumes (we have tables of 50+ Tb);
- Proficiency in Python for developing pipelines, and sometimes even backend using FastAPI;
- Experience with Apache Airflow (experience developing and operating DAGs in production, understanding idempotency and backfills);
- Experience with Apache Kafka (understanding the model (topics, partitions, consumer groups, offsets, delivery semantics), experience building loading from Kafka into the data warehouse)
- Experience integrating data from REST APIs and relational databases (PostgreSQL and similar), including incremental loading and working with data changes.
What we offer
- Training and development: language clubs, our own corporate university, management skills development programs, and much more;
- Employee well-being: corporate medical insurance package with dental care, corporate sports, psychological consultations, and additional benefits as an accredited IT company;
- Numerous communities: speaker club, football, yoga, chess, etc.;
- Care for families: we create conditions that make it easy to combine career and caring for loved ones – from a flexible approach to large-scale projects for employees' children;
- Discounts and partner programs: for education, insurance, purchases, and more;
- Comfortable working environment: free meals in the office, modern offices near metro stations, corporate equipment, and an employee portal.
