English-Speaking AI Data Evaluation Specialist (LLM)

About the role

We are looking for an English‑speaking AI Data Evaluation Specialist to support the development of next‑generation Large Language Models. You will work on an innovative AI project in Lisbon, reviewing and improving AI‑generated responses to ensure safety, accuracy and relevance for millions of users.

Key responsibilities

• Review and evaluate AI‑generated responses using detailed annotation and quality guidelines.
• Label and annotate language model outputs with accuracy and consistency.
• Assess content for relevance, factual accuracy, safety and policy compliance.
• Apply complex annotation guidelines across diverse scenarios and content types.
• Identify inconsistencies, edge cases and potential model issues, escalating when appropriate.
• Analyze structured text, datasets and AI‑generated content to support model improvement.
• Deliver high‑quality work while meeting productivity, quality and accuracy targets.
• Maintain strict confidentiality and comply with all project requirements.

Required profile

• Fluent English communication skills.
• Passion for AI, language technology and data quality.
• Strong attention to detail and ability to follow detailed guidelines.
• Commitment to confidentiality and data security.

Required skills