We are looking for a Senior Software Engineer to contribute to the development and evaluation of AI training data for a leading expert human data platform for AI agents and LLMs.

In this role, you will work at the intersection of software engineering and artificial intelligence, helping AI labs and companies build better, safer, and more capable models. You will leverage your deep technical expertise to write prompts, produce reference-quality code solutions, evaluate model outputs, and provide the structured human signal that makes AI systems smarter.

This is not a traditional engineering role - it is a unique opportunity for senior engineers who want to shape how the next generation of AI understands, generates, and reasons about code.

Key Responsibilities

• Create and review coding tasks based on real-world software engineering scenarios, including debugging, refactoring, code generation, API usage, automated tests, performance, security, and edge cases.
• Write high-quality reference solutions that are correct, clear, testable, and aligned with task requirements.
• Evaluate AI-generated code and responses using structured rubrics, assessing correctness, clarity, security, performance, maintainability, and instruction-following.
• Compare multiple model responses, select the strongest answer, and justify your decision with clear technical reasoning.
• Identify bugs, hallucinated APIs, missing edge cases, weak explanations, and poor engineering decisions in AI-generated outputs.
• Work with terminal-based development workflows when needed, including running tests, debugging issues, managing dependencies, and navigating repositories.
• Follow detailed guidelines consistently and participate in calibration activities to ensure high-quality, reliable evaluations.

Core Requirements

• 5+ years of professional software engineering experience in a