Developer for the REX Team

REX is a system for fast delivery of data and resources to Yandex services. The search crawler finds new pages on the internet, forms updates to the search database, and publishes them to external storage. REX microservices notify the core about these changes, and the core delivers them to the search servers. This ensures that users see up-to-date search results.

Our goal is to make REX the primary mechanism for fast and reliable data delivery at Yandex. The system must withstand extreme loads, provide an intuitive API, and give full control over the delivery process.

What tasks await you

Building architecture and developing the system core You will develop and improve the core of a high-load data delivery system, design an intuitive and flexible API for system users, as well as manage the data delivery process and control it.

Working with data and reliability It is important to ensure fast, reliable, and fault-tolerant delivery of data and resources (ML models, search database shards, configs, secrets). Create and control reliability metrics (SLO/SLI) for individual subsystems.

System programming and low-level optimization You will work with process isolation mechanisms (cgroups, namespaces), use Linux kernel mechanisms for tracking RAM consumption. Develop algorithmically complex subsystems where performance is critically important.

Operations and support (DevOps) You will need to be on-call for service runtime and support, improve the efficiency of solutions and optimize them, work with legacy code and gradually eliminate it.

Product development Another important task is to participate in making not only technical but also product decisions, study and enhance the 'user happiness' of our service.

We expect you to

• Have a good knowledge of C++ and an interest in system programming
• Be ready to work on building a complex distributed system
• Value not only the result but also high-quality architecture

Will be a plus

• Have worked with Linux at the system level
• Are familiar with Java, Python, or Go
• Understand the principles of DevOps and microservices architectures