Data Engineer in Ecom DWH

Our data helps a hundred analysts daily and monthly receive up-to-date information about advertising and the provision of e-commerce related information in Search. A number of projects important for e-commerce live on our data — from ranking ecom-search results in Search to distribution.

Possible upcoming projects you will participate in:

• Building a new DWH with features for fast user analytics
• Increasing data reliability with metrics and implementing data anomaly detectors
• Building a fast data delivery circuit so that analysts can receive data much earlier

What tasks await you

Pipeline Development You will have to maintain and develop existing data processing pipelines, as well as design and implement new ones.

Optimization Task You will need to figure out how to survive with large volumes of data. The weight of data is growing faster than the amount of hardware on which it can be processed and stored, so the task of optimizing everything that exists and writing new code taking into account realities is extremely important in our work.

We expect that you

• Confidently program in Python and are familiar with SQL
• Know basic algorithms and data structures
• Are familiar with the MapReduce paradigm
• Are able to dive into data, find how different sources relate to each other