Analytics: DE
Our analytics infrastructure team helps analysts do their jobs. We ensure data delivery to a unified data warehouse for analytics and support tools for its processing and presentation.
There are many self-sufficient teams in the company. Each team has its own services, its own developers, and analysts. So, we have quite a few data streams of the most diverse formats and volumes. This includes booking data, which the entire company looks at, and every record is checked almost manually, as well as ticket data with a volume of over a terabyte per day. This requires different approaches from our side.
- Our platform is based on the principles of LakeHouse architecture. Our stack: Spark, Trino, AWS S3, DeltaLake format, DBT, Kafka, Airbyte, Apache Airflow, DataHub.
- Testing and building are done on a CI server (Jenkins). Terraform is also present. Deployment is to Kubernetes (EKS in AWS). We do not handle server configuration or database deployment. A separate infrastructure team does that.
We need one more data engineer for our friendly team, who in the near future will be focused on tasks for one of the product teams.
What needs to be done
- connect new sources and develop/modernize data pipelines;
- configure and maintain the analytical environment;
- send and exchange data with external and internal services;
- modernize the current data platform together with the core data engineering team;
- work in pairs with another product data engineer.
What we expect from you
- at least 2 years of experience as a data engineer;
- excellent knowledge of Python, SQL;
- experience in developing processes for data testing;
- ability to build high-load streaming and batch pipelines;
- experience with our stack: Apache Spark, Apache Airflow, Trino will be a plus;
- experience with Kubernetes, Terraform, and AWS is welcome;
- independence and responsibility, ability to communicate with different teams and people;
- desire to grow and build processes around yourself;
- skills in working with AI agents (Claude Code, Codex, etc.).
How we work
- from anywhere in the world: we are not tied to a location, we pay in dollars, we love to travel;
- no bureaucracy: convenient, human-centric processes, horizontal and open communication, quick discussion of ideas and decision-making;
- compensation: voluntary medical insurance, psychotherapy or foreign languages, sports activities, and sick leave;
- on a paradise island: you can work from Phuket with an ocean view.