Product Analyst/Data Analyst — Remote | Ostrovok!Tech
Our product teams launch new A/B experiments daily, and to enable them to test their hypotheses with maximum accuracy and speed, we are developing our own A/B platform. The goal is to make this platform not just a "calculator," but a full-fledged product. Therefore, the A/B testing team works not only on the platform and its features but also on the processes, methodologies, and culture surrounding experiments.
What you will do:
- Develop methodology for pricing experiments (switch-back, query level split) and help teams launch them;
- Build an A/B testing pipeline for the API business with hundreds of millions of requests per day;
- Implement CUPED in the auto-calculation service - write code in Python, maintain Airflow DAG;
- Develop tools for experiment design;
- Research best practices and find ways to speed up tests;
- Validate experiment designs and post-analyses, understand complex cases of CI approaches.
You are a good fit if:
- 2+ years in analytics, including hands-on A/B testing experience (20+ tests per year) - design, launch, analysis - it would be great if you mention in your cover letter how many tests you conducted in your last role;
- You confidently write code in Python (not just notebooks) and understand what a Docker container is;
- You can readily explain CUPED and understand the advantages of the Bayesian approach;
- You can optimize SQL queries that run on billions of rows without lagging (using LLM is sufficient);
- Conversational English - B1 or higher;
- You use LLM assistants in your work (Claude Code, ChatGPT, etc.).