Description
We are the GigaChat Data team, preparing data for training the entire GigaChat LLM model line (GigaChat, GigaChat Vision, GigaChat Audio, etc.). We specialize in creating and improving prompts (prompt engineering) that will help us develop our products by enhancing the quality of interaction between models and users.
Responsibilities
Tasks:
- development and optimization of complex system and user prompts
- integration of LLMs via API into product scenarios
- testing prompts, conducting experiments and optimizing them based on quality metrics
- performing fact-checking and reviewing model responses, eliminating hallucinations and improving style
- analyzing datasets, identifying and eliminating bottlenecks
- working in tandem with AI trainers, ML engineers, analysts, and the product team.
Requirements
We expect from you:
- experience working with LLM APIs (GigaChat, OpenAI, Anthropic, local models, etc.)
- practical experience in creating and optimizing system and user prompts using various methods (few-shot, zero-shot, chain-of-thought, self-consistency, etc.), configuring generation parameters (temperature, top_p, max_tokens, etc.), and adapting prompts for different model use cases
- experience in testing and evaluating prompts
- confident command of Python for automation (pandas, requests/httpx, working with JSON, data processing)
- understanding of RAG and tool-calling principles – ability to design and implement retrieval-augmented generation pipelines; knowledge of approaches to integrating tools (tool-calling) for executing external functions, working with APIs
- understanding of how LLMs work, model training stages, and basic statistical metrics used in ML.
Will be a plus:
- experience working with LangChain, GigaChain, or equivalents
- skill in writing prompt generation and validation pipelines
- knowledge of English at a level sufficient for reading technical documentation.
Conditions
We offer:
- remote work format for residents of Saint Petersburg and Leningrad Region, including from cities without a district coefficient
- more than 400 educational programs from SberUniversity for professional and career development
- extended VHI (voluntary health insurance), preferential family insurance, and a corporate pension program
- free SberPrime+ subscription, discounts on partner company products
- referral bonus for recommending friends to the Sber team.