Mayflower is a technology company that alters the entertainment industry to a new level of perception and engagement. We are building the future of live entertainment. We believe that by providing people with the best and high-quality live streaming experience in entertainment, we can tackle the world’s “problems” better, together!
Job Responsibilities
- Cluster Management: deploy, administer, and scale Apache Kafka and Kafka Debezium clusters in high-load production environments;
- Infrastructure as Code: fully automate provisioning and configuration management processes using Terraform and Ansible;
- Reliability Engineering: configure monitoring and alerting, design Disaster Recovery (DR) strategies, and ensure High Availability (HA) for stateful services;
- Performance Tuning: deep optimization of Kafka configurations (producers, consumers, brokers) and OS (Linux) kernel parameters tailored to specific load profiles;
- Troubleshooting: investigate incidents, analyze logs, and identify bottlenecks in distributed data processing systems.
Requirements
- Experience: 3+ years as a DBRE, DevOps, or System Administrator with a focus on databases and message brokers;
- Apache Kafka: in-depth understanding of internal architecture (Brokers, Controller, KRaft/Zookeeper, Partitioning, Replication protocols). Experience operating production clusters under high load;
- CDC / Debezium: hands-on experience configuring Change Data Capture (CDC) pipelines and a solid understanding of Kafka Connect;
- IaC & Automation;
- Strong proficiency in Terraform (writing modules, managing state files);
- Experience writing complex Ansible roles and playbooks;
- Linux: deep knowledge of OS internals (CPU, Memory, Disk I/O, Network tuning) for database performance optimization;
- Observability: experience with Prometheus, Grafana, and the ELK/EFK stack;
- Scripting: proficiency in Python or Bash for automation tasks.
