Data Annotator / Data Labeler (with SQL)
We are looking for an experienced specialist to join the development team of the ICSI chatbot — an intelligent assistant that provides analytics and reporting on key company metrics.
What you will do:
- Analyze complex user requests via the admin panel and Langfuse (analysis of the entire request processing pipeline).
- Identify bot errors: numerical "hallucinations", incorrect summarization, dialogue loops, data filtering errors.
- Refine and correct existing SQL queries that the bot uses for data extraction.
- Formulate few-shot prompts and test datasets for measuring response quality.
- Provide feedback on improving the internal admin panel.
We expect from you:
- Experience as a data / content / dialogue annotator/labeler — 3+ years.
- SQL at Junior+ / Middle level: you don't just know SELECT, but can understand someone else's query, fix a JOIN, or filtering conditions.
- Ability to work with monitoring tools (experience with Langfuse will be a huge plus).
- Structured thinking: the ability to understand why the bot produced an incorrect analytical report.
- Attention to detail (numbers in reports do not tolerate errors).
Will be a plus:
- Understanding of LLM principles and their quality evaluation.
- Experience with ML products or complex chatbots.
Conditions:
- Full-time, remote work.
- Opportunity to work with a cutting-edge tech stack in the AI field.
- Details about schedule and interview stages will be discussed on the first call.
To apply on Telegram: Lena_Smartbrainio
