Reach out directly about this role
Offline Ranking Metrics Analyst-Developer in Search
The primary Proxima page quality metric is built from assessor ratings on individual signals — relevance, source authority, and others. Proxima sets the target for search algorithms ranking documents for a query. We are constantly improving the key metrics of Search, and the offline metrics team currently faces numerous challenges.
Improving offline metrics You will need to understand the structure of offline metrics and help improve their quality across the entire pipeline — from assessor ratings of individual signals to the form of the final metric. You will research, formulate, and quantify problems in the metric and the final ranking, devise ways to fix them, and implement those fixes.
Optimizing offline metrics on important product slices You will research what users need and how the Search product should look on specific slices (for example, on product queries), and adapt metrics to improve search results for users.
Evaluating the quality of the metric and its changes Together with the team, you will seek answers to questions on how to correctly measure improvements in the metric or its individual components, as well as how to assess how far the current metric is from ideal.
3-5 years
Experience
Full-time
Employment
Hybrid, Remote, Onsite
Work Format
Middle
Grade
Data Analytics
Specialization
IT & Tech
Industry
Corporation
Company Type
By company
Data Analytics
Specialization
IT & Tech
Industry
Corporation
Company Type