C++ Developer for the Stream Processing Team for E-commerce Scenarios and Advertising

C++ Developer for the Stream Processing Team for E-commerce Scenarios and Advertising

Any data, no matter how much, is practically useless in its raw form. At Yandex, data is transformed during ingestion into databases, enrichment, offline ML model calculations, and many other cases. We are developing a real-time technology that will make data processing efficient, convenient, and easy to maintain. We are looking for a person who will help bring it to life.

Currently, our system processes hundreds of thousands of messages per second and is one of the most high-load real-time processings in Yandex. In the future, we plan to turn it into a universal RT processing platform for Ecom, make the system more user-friendly, increase resource accounting transparency, and reliability.

What tasks await you

Stateless and stateful processing You will write code for the asynchronous core of the technology, work with DB transactions, order message processing, and correctly handle errors.

Processing optimization You will improve processing in terms of throughput, configure databases, and increase hardware efficiency.

Improving system support You will need to supplement existing metrics, logging, and tracing. In addition, you will improve the viewer and debugging tools.

More about backend at Yandex — in the channel Yandex for Backend

We expect you to

• Be well familiar with multithreaded programming
• Devise flexible solutions suitable for diverse tasks
• Know C++
• Be capable of writing reliable code, researching complex problems, working in a team

It will be a plus if you

• Are familiar with Apache Beam, Apache Flink, and other stream processing systems
• Have worked with distributed systems