Code Data Annotation Quality Specialist at Mistral — task breakdown

Code Data Annotation Quality Specialist

Classified Tasks (8)

Automate 0%Augment 88%Human-Only 13%

Augment (7)

AI assists, human decides

Review code annotations against rubrics to assess correctness and consistency

analytical

Audit annotated datasets to detect, document, and escalate annotation errors and inconsistencies

analytical

Validate that data used for training and evaluating AI models meets defined quality standards

analytical

Build internal tooling to support annotators' day-to-day workflows

technical

Maintain and update internal annotation tooling to ensure reliability and performance

technical

Troubleshoot tooling issues and provide technical support to annotators

technical

Contribute to refining annotation guidelines and data production processes

operational

Human-Only (1)

Requires human judgment

Collaborate with annotators, technical program managers, and engineering stakeholders to resolve quality and tooling issues

communication

Job description

About Mistral At Mistral we are on a mission to democratize AI, producing frontier intelligence for everyone, developed in the open, and built by engineers all over the world. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation, with teams distributed between Europe, the USA and Asia. We are creative, low-ego and team-spirited.At Mistral, we develop models for the enterprise and for consumers, focusing on delivering systems which can really change the way in which businesses operate and which can integrate into our daily lives. All while releasing frontier models open-source, for everyone to try and benefit. Mistral is hiring experts in the training of large language models and distributed systems. Join us to be part of a pioneering company shaping the future of AI. Role Summary We’re seeking highly motivated Data Quality Specialists with strong analytical skills and a keen eye for detail to join our Human Data Annotation team within the Science organisation. This is a hybrid quality reviewing and tooling role: you'll spend the majority of your time reviewing and auditing code annotations against rubrics to ensure data used for training and evaluating AI models meets a high bar, and the remainder building, maintaining, and troubleshooting the internal tooling that annotators rely on day-to-day. You'll collaborate closely with the annotators, technical program manager, and engineer stakeholders, and contribute to refining the guidelines and processes that shape how our data is produced.

Source: Mistral careers · scraped 2026-05-22

Apply at Mistral