Warden is an internal platform for incident management that ensures the stability of various Yandex services, from Kinopoisk and Advertising to Taxi, Alice, and others. We are actively expanding, with our DAU growing by 25% in the last six months. Our goal is to enter the external market as an independent product.

We automate incident management during the hot phase and create tools for post-incident review. We influence how quickly an incident is resolved, responsible parties are notified, and downtime and losses are calculated. Warden consists of 10 microservices, including a chatbot used daily by over 3000 Yandex employees. Join us if you are interested in working on a project that impacts the entire company. In our team, you will be the first to know about all technical failures at Yandex.

What tasks await you

Build a reliable distributed service that can survive the failure of two data centers You will develop a system used by Yandex services with millions of instances. We have tens of thousands of realtime graphs for processing each incident scenario.

Work with consensus algorithms The core of our distributed system uses the Raft algorithm. We have tasks to improve the reliability of our services.

Work not only on infrastructure tasks We provide a unified tool for stability management for absolutely different classes of services: Search, Music, Taxi. We help all services be available 99.9999% of the time, and developers to learn about a problem within 30 seconds of its occurrence. We help monitor both the overall availability of services and the operation of specific user scenarios: for example, that radio works in Music.

We expect you

• Have more than three years of development experience in Python
• Have experience in classical web development (cache, queues, asynchronous tasks)
• Have worked with PostgreSQL
• Test your code
• Can work both independently and in a team

Will be a plus

• Have worked with distributed systems
• Have worked with asyncio, threading, gRPC

Working conditions

• Work in a strong team where you can grow
• Opportunity to influence the process and results
• Market-level and above-market salary
• Bonuses every six months for everyone who successfully passes the review
• Extended voluntary health insurance (VHI) program, reimbursement of 80% of VHI costs for spouses and children
• Flexible work schedule