Senior Data Engineer (Databricks)

About the role

Join Anova's R&D Software team as a Senior Data Engineer focused on Databricks. You will design, build, and operate data pipelines that turn real‑time telemetry and platform data into reliable, governed data assets used across reporting, analytics, and machine‑learning initiatives.

Key responsibilities

• Develop end‑to‑end Databricks ETL pipelines, from requirements gathering to production deployment.
• Transform business goals into scalable data solutions and guide stakeholders on data choices.
• Maintain and monitor pipelines, ensuring reliability, freshness, and clear data lineage.
• Integrate real‑time telemetry from global industrial IoT sensors into unified data streams.
• Create BI aggregations that consolidate data across platforms into reusable assets.
• Support internal natural‑language query tools by publishing high‑quality master data.
• Utilise AI‑assisted coding tools (e.g., Claude Code, Copilot, Cursor) while upholding code quality standards.
• Promote best practices for data engineering, testing, and pipeline operations.

Required profile

• Bachelor’s degree in Computer Science, Data Engineering, Data Science, or a related quantitative field, or equivalent experience.
• 5+ years of data engineering experience with hands‑on production work in Databricks (6–8 years preferred).
• Proven ability to build and manage data workloads in Databricks, with strong knowledge of PySpark and Delta Lake.
• Excellent SQL skills and experience working with real‑time telemetry data.

Required skills

• Databricks
• PySpark
• Delta Lake
• SQL
• Python