Senior Manager, Data Quality & Evaluation

About the role

This senior position is based in Portugal and leads the quality foundation for advanced AI data programs. You will design and operate evaluation frameworks, quality standards, and scalable workflows that ensure reliable human‑data pipelines for next‑generation intelligent systems.

Key responsibilities

• Design, implement and manage quality frameworks, acceptance criteria, review processes and performance metrics for AI data and evaluation programs.
• Translate customer requirements into scalable workflows covering data collection, annotation, evaluation, calibration and reporting.
• Identify quality risks early, work with delivery teams to resolve issues and maintain program timelines.
• Build repeatable processes for QA sampling, adjudication, reviewer performance tracking and customer reporting.
• Lead quality operations across multilingual evaluation, speech/audio review, transcription, annotation, human‑preference evaluation and AI model assessment.
• Develop rubrics, task instructions, reviewer guidelines, golden datasets, scorecards and reporting templates.
• Monitor quality indicators such as reviewer agreement, error trends and root‑cause analysis, turning insights into actionable improvements.
• Partner with internal teams to embed quality success from planning through production delivery.
• Coach and develop Quality Managers, Leads, Specialists and reviewers, fostering a culture of ownership and continuous improvement.

Required profile

• 5+ years of experience in quality operations, data operations or AI‑related quality management.
• Proven ability to lead cross‑functional teams and drive operational excellence in fast‑moving AI environments.
• Strong analytical and problem‑solving skills with a focus on building scalable processes.
• Excellent communication skills to translate complex requirements into effective quality solutions.

Required skills