Go Developer for the Analytical Infrastructure Team
About the Team
We are the Avito Data Warehouse infrastructure team. We make working with our infrastructure efficient and help maximize the utilization of available resources for analytical engines.
Our goal is to provide an interface for interacting with the analytical infrastructure that guarantees operational stability and shields the user from the need to delve deeply into this layer.
Examples of Future Tasks:
- ensure efficient utilization of storage resources;
- facilitate the support and scaling of data warehouse system nodes;
- make our components fault-tolerant, improve infrastructure observability, develop a transparent and flexible infrastructure resource management mechanism, and reduce the number of incidents.
You will be responsible for:
- optimizing the Ceph sharding mechanism for fast data access and flexible management of the number of shards;
- guaranteeing a stable read speed from the caching layer of at least 3 Gb/s;
- ensuring flexible scaling of the throughput channel between Trino and Storage;
- ensuring flexible distribution of resources between Trino clusters.
We expect you to:
- have at least 4 years of experience in software development, system architecture on Go or Python;
- design or be responsible for components of distributed systems;
- enjoy research tasks with a high degree of uncertainty and technical complexity;
- be able to take responsibility for your decisions and results;
- plan your project work, identifying milestones and coordinating with neighboring teams.
It would be great if you:
- have experience working with Linux;
- have experience debugging components written by other engineers;
- have experience with proxy/gateway/client protocols for DBMS;
- have experience writing k8s operators and understand how k8s works.
Working with us means:
- the opportunity to implement your ideas in a project with a multi-million user base;
- a talented team ready to support your initiatives;
- powerful hardware, additional monitors, and everything needed for productive work;
- a transparent bonus system, a competitive salary — the amount will be discussed during the interview;
- a personal training budget that can be spent on books, courses, and conferences;
- care for your health: from day one, you will have VHI with dental coverage, a therapist and a masseuse are available at the office;
- remote work and a wonderful office two minutes from the Belorusskaya metro station: panoramic views of the city center, spaces for focused work, and relaxation areas.
