About the team
We are building a data streaming platform that powers Avito's critical real-time systems: anti-bot, anti-fraud, advertising analytics, marketing triggers, and CDC pipelines.
We work in two directions: product tasks (new detection algorithms, event enrichment) and platform (Flink operator on Kubernetes, deployment infrastructure, migrations).
Server infrastructure, hardware support, and OS updates are the responsibility of a separate infrastructure team with whom we closely collaborate.
What tasks await you:
- Develop real-time anti-bot and anti-fraud: detect bots and fraud using streaming heuristics, develop new signals;
- Develop event enrichment: build operators for enriching clickstream events (geolocation, categories, user attributes, advertising metrics);
- Develop CDC and data ingestion: develop pipelines for capturing changes from databases and delivering data to DWH in Apache Paimon format;
- Develop advertising analytics: calculate CTR impressions, auction withdrawals, and marketing conversions in real-time;
- Develop Flink Platform: manage Flink Kubernetes Operator, Helm charts, deployments across multiple data centers and regions;
- Provide technical leadership to the team: set architectural standards and help the team grow.
We expect you to have:
- Deep expertise in Apache Flink or another data streaming framework (Spark Streaming, Kafka Streams);
- Experience leading a development team for over 4 years;
- A systematic approach to working with people (motivation, development, adaptation);
- Experience with high-load production systems;
- Ability to decompose tasks and build a technical roadmap;
- Understanding of Apache Kafka and distributed systems principles.
It would be great if you have:
- Experience leading a platform team without a product manager and system analyst.
Working with us means:
- The opportunity to implement your ideas in a project with a multi-million audience;
- A talented team ready to support your initiatives;
- Powerful hardware, additional monitors, and everything you need for productive work;
- A transparent bonus system, a decent salary — the amount will be discussed at the interview;
- A personal training budget that can be spent on books, courses, and conferences;
- Health care: from day one, you will have voluntary medical insurance with dental care, and a therapist and massage therapist are available at the office;
- Remote work and offices in different cities.