Senior QA Automation Engineer (AI)

REMOTE GLOBAL | RAFT DIGITAL SOLUTIONS

Hi! We are the Raft Digital Solutions team, developing AI-based solutions. We contributed to the Langchain framework, created our own innovative product for analyzing voice communication using GPT, and conducted extensive research and development in the field of LLM security. We operate in both the Russian and international markets.

We are currently looking for a Senior QA (Auto) with knowledge and experience in LLM/GenAI to join our AI agents for users team.

What you will be doing:

• Participating in projects to develop AI assistants with text and voice interfaces
• Organizing and establishing the testing process for AI agents
• Organizing and conducting various types of testing (requirement testing, manual, functional, E2E, load testing) of AI agents throughout the development cycle
• Conducting load testing, preparing test scenarios and data
• Actively using tools like Copilot in your work
• Monitoring the status of systems and agents in the production environment, setting up alerting

What we expect from candidates:

• Understanding of LLM operating principles (tokenization, prompts)
• Knowledge of AI agent architectures (ReAct, Tool Use, RAG, Multi-Agent)
• Experience with LangChain or similar frameworks
• Understanding of the non-deterministic nature of AI systems and methods for their control
• Experience in forming the testing process for a high-load product
• Writing autotests in Python for 3+ years
• Experience with CI/CD setup
• Experience in load testing using k6 or another tool

What we offer:

• Remote work format
• Flexible working hours, full-time (40 hours per week)
• Tasks at the intersection of business and modern AI technologies
• A friendly team of experts, knowledge sharing, and technical growth
• We conclude a b2b contract (with an individual entrepreneur)

CONTACT

lana_schein