AI Data Engineer – Distributed Cloud

About the role

We are looking for an AI Data Engineer to design and maintain scalable data solutions that power AI applications and advanced analytics within our Distributed Cloud practice. You will work with cross‑functional teams to translate business needs into reliable data products and drive innovation across the organisation.

Key responsibilities

• Design, build and optimise semantic data models and metric definitions for AI and analytics consumption.
• Develop integrations between data platforms, semantic layers and LLM‑powered solutions.
• Apply causal inference and advanced analytical techniques to generate business insights.
• Support AI initiatives through LLM integration, prompt engineering and Retrieval‑Augmented Generation (RAG).
• Provide technical leadership through mentoring, code reviews and architectural guidance.
• Collaborate with Data Engineers, Analytics Engineers, Product Managers and AI teams to deliver scalable solutions.
• Promote modern data engineering, AI and analytics best practices across the organisation.

Required profile

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Mathematics or a related technical field.
• 5+ years of experience in senior Data Engineering, AI Engineering or Analytics Engineering roles.
• Strong hands‑on experience with modern data platforms such as Databricks and Google Cloud Platform.
• Proven ability to build and leverage semantic layers and metric definitions for advanced analytics.
• Experience with causal inference techniques.

Required skills

• Databricks (Delta Lake, Unity Catalog, MLflow, Databricks Apps)
• Google Cloud Platform services (BigQuery, Cloud Run, Pub/Sub, Vertex AI)
• Python programming
• FastAPI for API development
• LLM frameworks such as LangChain or Anthropic
• SQL
• Causal inference techniques