Big Data Platform Administrator – Banking Sector

About the role

We are seeking a Big Data Platform Administrator to operate and maintain large‑scale Hadoop‑based data lake environments for a leading financial services organization. The role focuses on ensuring platform stability, performance, and security while supporting data engineering teams in a regulated banking environment.

Key responsibilities

• Operate, monitor, and support Hadoop‑based data lake platforms, including HDFS clusters.
• Provide incident response, deep troubleshooting, and performance tuning across big‑data components such as YARN and Kafka.
• Manage data integrity, replication, capacity planning, and resource allocation.
• Develop and automate monitoring, alerting, and health‑check scripts for platform services and node health.
• Apply patches, upgrades, and configuration changes to maintain cluster stability and security.
• Handle authentication, authorization, and encryption mechanisms (Kerberos, Ranger/Sentry, TLS).
• Collaborate with storage, network, and security teams to optimise throughput, access controls, and backup strategies.
• Maintain comprehensive platform documentation and share knowledge with cross‑functional teams.

Required profile

• Minimum 5 years of experience in Big Data/Hadoop platform administration.
• Bachelor’s degree in Computer Science or equivalent.
• Strong knowledge of Hadoop ecosystem components such as Cloudera, YARN, and Kafka.
• Solid expertise in Linux system administration, JVM tuning, and distributed environments.
• Experience with PostgreSQL or other SQL databases.
• Automation skills using Ansible, Python, or Java.
• Deep understanding of Kerberos, cryptography, and access‑control policies.
• Fluency in English; experience in banking or regulated environments is a plus.

Required skills

• Hadoop, Cloudera, YARN, Kafka
• Linux, JVM tuning
• PostgreSQL, SQL
• Ansible, Python, Java
• Kerberos, Ranger, Sentry, TLS
• Microservices architectures, on‑premise deployments