Kake
2 months ago
Reach out directly about this role
Grade
Senior
Experience
from 5 years
English Level
B2 - Upper-Intermediate
By job title
AI writes it from your resume. You only have to send it.
Core Requirements:
5+ years of professional software engineering experience in a backend, fullstack, or systems role.
Strong proficiency in at least one core programming language, ideally Python, NodeJS + TypeScript, and FastAPI.
Hands-on experience with Terminal-Bench, with the ability to evaluate AI agent performance on terminal-based tasks including compiling code, running tests, managing environments, and completing multi-step software engineering workflows.
Comfortable working with Linux, Docker, and Git, command line/terminal, and common development workflows.
Strong experience writing functional and integration tests. Hands-on practitioners, not reviewers.
Nice to Have:
Experience working on AI, machine learning, or LLM-related projects
Familiarity with software quality assurance methodologies or technical evaluation frameworks
Experience working with distributed systems or large-scale applications
Other Traits:
We are looking for a Senior Software Engineer to contribute to the development and evaluation of AI training data for a leading expert human data platform for AI agents and LLMs.
In this role, you will work at the intersection of software engineering and artificial intelligence, helping AI labs and companies build better, safer, and more capable models. You will leverage your deep technical expertise to write prompts, produce reference-quality code solutions, evaluate model outputs, and provide the structured human signal that makes AI systems smarter.
This is not a traditional engineering role - it is a unique opportunity for senior engineers who want to shape how the next generation of AI understands, generates, and reasons about code.