Alice AI LLM Analyst-Developer

Alice AI LLM Analyst-Developer

Our team is engaged in analytics of the core technology powering Alice, Neurosearch, Neurobrowser, and many other products — the large language model Alice AI. Here are some of our work questions:

• How do we determine which tasks the model handles well and which ones it doesn't?
• What data should be added to finetuning to teach the model a new task?
• Where to get this data and how to control its quality?
• How to build a crowdsourced labeling process?

Let's search for answers together!

What tasks await you

Model Development This task includes proactive search for model errors and correction of problematic slices, evaluation of the effectiveness of changes, and subsequent implementation of improvements.

Database Formation You will gather data for the development and integration of new features.

Training of Performers You will select and train qualified performers, develop a motivation system for them, control labeling quality, and implement processes to improve results.

More about analytics at Yandex — in the channel Yandex for Analytics

We expect that you

• Enjoy working with textual data
• Know mathematical statistics and probability theory
• Can code in Python and SQL
• Are independent and ready to take on new tasks for which there is no ready-made solution

Will be a plus

• Have worked with Toloka or other crowdsourcing platforms