Senior Python Engineer – AI Agents Evaluation

About the Role

We are looking for experienced Python Engineers to work with leading AI research labs on evaluating and improving next-generation AI coding agents. You will review agentic coding trajectories, assess technical correctness, debug and validate outputs, and use coding agents such as Claude Code, Codex, or Cursor as part of your workflow.

What You'll Do

• Review agentic coding trajectories, including prompts, tool calls, intermediate actions, code changes, execution results, and final outputs.
• Evaluate whether AI agents correctly understand and execute software engineering tasks.
• Analyze agent behavior to identify technical errors, inefficient approaches, and opportunities for improvement.
• Read, debug, test, and validate Python code produced or modified by AI agents.
• Work with LLM-powered agents, workflows, and development environments to evaluate model capabilities.
• Use coding agents such as Claude Code, Codex, Cursor, or similar tools to accelerate analysis, debugging, and validation.
  
  Requirements
• 5+ years of professional software engineering experience, with strong hands-on expertise in Python.
• At least 6 months to 1 year of practical AI/LLM engineering experience building agents, agent loops, LLM-powered applications, data pipelines, or similar systems.
• Hands-on experience using AI coding agents such as Claude Code, Codex, Cursor, or equivalent tools as part of regular software development workflows.
• Ability to understand and evaluate agentic workflows, including tool usage, intermediate execution steps, code modifications, and resulting outputs.

Selecionamos as principais informações da posição. Para conferir o descritivo completo, clique em "acessar"