Technical Program Manager, Human Data Annotation (Code)

• 5+ years of relevant experience, with a blend of software engineering and technical program management

• Strong technical foundation in Python

• Highly organized, detail-oriented, and able to work well under pressure - excellent project management skills, with the ability to successfully manage multiple projects simultaneously

• Great communication skills, capable of engaging effectively with both technical and non-technical stakeholders

• Autonomous and proactive problem-solver with a continuous improvement mindset

• Experience leading a team, with a low ego and team spirit mindset

• Embraces hands-on, operational work in a fast-paced and dynamic environment

Nice to have criteria/ would be ideal if you have/are

• Proficiency in JavaScript/TypeScript and experience in modern web frameworks (FastAPI, Django, React,...)

• Experience with operations around data collection, annotation, and/or quality assurance

• Experience with vendor and/or contractor management

• Understanding of and interest in LLMs

We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.

For the most up-to-date details on benefits available in your location, please refer to our Benefits page.

We are seeking a highly skilled and motivated Technical Program Manager to lead and scale human data annotation operations for our Code team. In this pivotal role, you will collaborate closely with researchers to define and drive data strategies. This role is a critical link between research, product, engineering, and annotation teams, and will be key in accelerating research at Mistral AI.

• Partner closely with code research team to develop data strategies and translate research needs into operationalizable human data annotation campaigns

• Drive human data annotation campaigns, from scoping through delivery, balancing data needs, budget, delivery timeline

• Manage a data quality assurance team that designs and implements rigorous and scalable quality control processes, including running automated and manual checks, synthesizing actionable insights, and driving continuous improvement

• Establish and maintain strong relationships with annotation teams (e.g. contractor, vendor) to generate high quality data, spanning phases across sourcing, contracts, onboarding / training, performance monitoring, etc.