NeoFamily is an EdTech company developing web solutions for effective preparation for the Unified State Exam (EGE). We create digital products that help students achieve high results in exams. We are currently looking for an LLM Backend Engineer / AI Developer who can support and develop an LLM-based homework checking service, as well as implement AI into the company's workflows.
Responsibilities:
- Implement AI into company processes;
- Support and develop FastAPI service;
- Work with PostgreSQL, RabbitMQ, Docker/Docker Compose;
- Develop an asynchronous task processing pipeline: task queuing, relay service, workers, retries, and error handling;
- Integrate LLM providers via OpenAI-compatible API;
- Configure fallback models, retries, timeouts, and error handling;
- Improve prompts and the homework checking pipeline;
- Launch and analyze benchmarks for model quality, cost, and speed;
- Analyze model errors and find ways to improve checking quality.
Requirements:
- Experience developing backend services in Python;
- Experience with PostgreSQL;
- Skills in working with Docker, Docker-Compose, and Git;
- Understanding of principles for writing readable, maintainable, and scalable code;
- Experience with message brokers like RabbitMQ;
- Understanding of backend service fault tolerance and scalability principles;
- Ability to perform LLM integrations;
- Ability to write prompts for LLM;
- Understanding of LLM internal workings;
- Experience building benchmarks for ML models: how to collect a dataset, how to calculate quality metrics, how to determine latency;
- Ability to work with unstable external APIs: understand how rate limits work, how fallback mechanisms can be built, etc.
Will be a plus:
- MLflow or similar tools for experimenting with ML models;
- Experience with OCR / vision models / image processing;
- Experience deploying services.
What we offer:
- Mentorship: code review, regular feedback
- Opportunity to influence decisions and suggest improvements
- Experienced and friendly team
- Work on real tasks and participation in production
- Support for professional growth
Employment options:
- Employment under the Labor Code of the Russian Federation in an IT-accredited company (deferment from conscription, IT mortgage)
- Through providing services as a sole proprietor (IP)
