GDM Staff Software Engineer, Agent Data Quality, DeepMind

Job description

Construct rigorous quantitative benchmarks and automated evaluation frameworks (including LLM-as-a-judge) to measure agent capabilities in reasoning, planning, and tool use. Develop end-to-end data flywheel on agent evalset curation, and automate and productionize the flywheel with agentic data pipelines. Develop a dedicated platform for \ Minimum Qualifications: Bachelor's degree in Computer Science or Engineering, or equivalent practical experience. Experience with Large Language Models (LLMs), NLP, or Generative AI. Preferred Qualifications: MBA or Master's degree in Computer Science.