Senior Data Engineer (Databricks)

About the role

As a Senior Data Engineer specializing in Databricks, you will join Anova's R&D Software team to build reliable, governed data assets that power reporting, analytics and machine learning worldwide. The role is hybrid, based in Porto, with most work done remotely and occasional office collaboration.

Key responsibilities

• Design, develop and operate Databricks pipelines that transform real‑time telemetry and platform data into master data assets.
• Deliver end‑to‑end ETL projects, translating business goals into scalable data solutions.
• Build the “One Anova” data stream, integrating IoT sensor data from global industrial deployments.
• Create BI aggregations that unify data across platforms into reusable assets.
• Publish and maintain master data, ensuring freshness, clarity and trust for internal natural‑language queries.
• Leverage AI coding assistants (e.g., Claude Code, Copilot, Cursor) while upholding code quality standards.
• Maintain clear data lineage, documentation and testing to support both human and AI consumers.
• Champion best practices, data quality testing and monitoring to pre‑empt issues.

Required profile

• Bachelor’s degree in Computer Science, Data Engineering, Data Science or a related quantitative field, or equivalent experience.
• 5+ years of professional data engineering experience, with hands‑on production work in Databricks.
• Strong expertise in PySpark, Delta Lake and advanced SQL (window functions, complex joins, query tuning).
• Experience building streaming data workloads and working with real‑time IoT telemetry.

Required skills

• Databricks
• PySpark
• Delta Lake
• SQL
• Python