Description
We are looking for an experienced engineer who will focus on developing LLM applications: from agent architecture to service layer integration. Your task will be to create a "digital analyst" capable of not only reading reports but also identifying the root causes of changes in business metrics.
Responsibilities
- Developing Agent Core: Designing the architecture of a multi-agent system, implementing role interaction scenarios (orchestration), and configuring reasoning chains (Chain of Thought).
- Creating Tooling (Tools): Developing and connecting external tools for agents: web search, metric calculators, integration with the bank's internal systems.
- Diagnostic Analysis (Causal Inference): Implementing logic for finding causal relationships to identify drivers of deterioration in client operational and financial performance.
- Quality Control Automation (Auto-Eval): Developing a system for automatic evaluation of agent performance: creating benchmarks, implementing the LLM-as-a-Judge approach, configuring quality metrics.
- Data Engineering: Building pipelines for processing unstructured data (PDFs, scans, IFRS/RAS) and working with knowledge bases.
Requirements
- Strong Python: Deep understanding of OOP, design patterns, and asynchronous programming (asyncio). Ability to write clean, maintainable code.
- API Work: Understanding API design principles and experience integrating external services.
- LLM Application Architecture: Understanding principles for building agentic systems (ReAct, Plan-and-Solve), experience with orchestration frameworks (LangChain, LangGraph, or AutoGen).
- Data Science Stack: Proficient use of pandas/numpy for data manipulation.
- SQL: Writing complex queries (Window functions, CTE, optimization).
- Domain (a plus): Interest in financial analysis or experience working with financial statements.
Conditions
- Comfortable, modern office near Kutuzovskaya metro station.
- Hybrid work format.
- Annual salary review. Annual bonus.
- Corporate gym and relaxation areas.
- Over 400 educational programs from SberUniversity for professional and career development.
- Onboarding program and manager assistance at the start.
- Extended private health insurance, preferential family insurance, and a corporate pension program.
- Flexible mortgage discount equal to 1/3 of the Central Bank's key rate.
- Free SberPrime+ subscription, discounts on products from partner companies.
- Referral bonus for recommending friends to the Sber team.
