LLMOps / MLOps Engineer – Remote (Portugal)

About the role

You will join as a nearshore LLMOps Engineer, owning the infrastructure layer for AI solutions. Your focus will be on making AI systems reliable, observable, and maintainable in production, bridging the gap between demo and long‑term operation.

Key responsibilities

• Design, build, and maintain CI/CD pipelines for LLM‑based systems, including testing, versioning, deployment, and rollback.
• Manage prompt versioning across multiple client deployments.
• Develop evaluation infrastructure for automated quality scoring, hallucination detection, and latency tracking.
• Implement model monitoring in production: drift detection, cost alerts, and output‑quality dashboards.
• Orchestrate containers and cloud infrastructure for AI workloads on Azure (AKS, Terraform, Helm).
• Create tooling that accelerates and safeguards the broader engineering team.

Required profile

• 3+ years of experience in MLOps, DevOps, or platform engineering, preferably with recent LLM projects.
• Strong hands‑on skills with Docker, Kubernetes, and Azure cloud services.
• Experience using MLflow, Weights & Biases, or LangSmith for experiment tracking and evaluation.
• Proven ability to build evaluation pipelines for LLM outputs beyond simple accuracy.
• Comfortable writing Python scripts; full‑stack development not required.
• Commitment to reliability and clean engineering practices.
• Fluent English for direct collaboration with Dutch teams.

Required skills

• Docker
• Kubernetes (AKS)
• Microsoft Azure (Azure DevOps, Azure API Management, Azure AI Content Safety)
• Terraform
• Helm / Kubernetes manifests
• Python
• MLflow
• Weights & Biases
• LangSmith
• Prometheus
• Grafana
• Git‑based workflows
• Vector databases (Weaviate, Milvus, Pinecone)
• Azure OpenAI Service

What we offer

• Competitive compensation benchmarked to the Dutch AI consultancy market.
• Direct exposure to high‑growth AI projects for established Dutch companies.
• Fully remote work from Portugal with occasional travel to Amsterdam for onboarding and key milestones.