Data Pipeline Specialist – Distributed Cloud

About the role

We are seeking versatile and experienced Senior Data Engineers to join our growing data teams in Lisboa or Porto. In this role you will design, build, and optimise mission‑critical data pipelines and ETL/ELT solutions.

Key responsibilities

• Design, build and optimise robust ETL/ELT pipelines for batch and real‑time processing.
• Work with Big Data technologies and distributed computing frameworks such as Spark to process large datasets efficiently.
• Develop, test and deploy code primarily using Python and, ideally, Scala, focusing on high performance and data integrity.
• Manage and maintain data environments on platforms including Cloudera and traditional data warehouses like Teradata.
• Collaborate with Data Architects and Analysts to translate complex requirements into technical data models and solutions.
• Ensure scalability, performance, and reliability of data assets across diverse platforms.

Required profile

• 5+ years of experience as a Data Engineer, ETL Developer or Big Data Engineer.
• Strong expertise in building data pipelines and extensive knowledge of ETL/ELT methodologies.
• Proficiency in SQL and programming in Python; Scala experience is highly valued.
• Experience with at least one Big Data ecosystem such as Spark or the Cloudera platform.
• Familiarity with cloud environments (AWS, Azure or GCP) is a plus.
• Good level of English, both written and spoken.

Required skills

• Python
• Scala
• SQL
• Apache Spark
• Cloudera
• Teradata
• AWS
• Azure
• Google Cloud Platform