Job Summary:

We are seeking an experienced Senior Data Platform Engineer with over 15 years of expertise in managing and administering complex data and compute infrastructure across on-premises and cloud environments. The ideal candidate will have deep hands-on experience with Kubernetes (on-prem & Azure), Spark Clusters, and CI/CD pipelines using Azure DevOps, with a strong background in modern data platform tools including Apache Ranger, Kafka, Airflow, Trino, Iceberg, and Datahub.

Key Responsibilities:

Administer and maintain on-prem Kubernetes environments using in-house Kubernetes packages, as well as Azure Kubernetes Service (AKS) clusters.
Provision, configure, monitor, and manage Apache Spark clusters for large-scale data processing.
Implement and support CI/CD pipelines using Azure DevOps (ADO) for data platform components and infrastructure.
Ensure secure and governed data access using Apache Ranger and other security tools.
Support and manage distributed data systems such as Kafka, Trino, Airflow, Iceberg, and Datahub.
Monitor system health, identify performance bottlenecks, and perform root cause analysis for infrastructure and platform issues.
Collaborate with DevOps, Data Engineering, and Cloud teams to optimize the scalability, performance, and resilience of the platform.
Maintain infrastructure as code (IaC) practices and participate in platform automation initiatives.
Ensure compliance with internal and regulatory security standards.

Required Skills & Experience:

Minimum 15 years of overall IT experience with at least 5–7 years in data platform administration.
Strong hands-on experience in:
- On-prem Kubernetes clusters (in-house distributions)
- Azure Kubernetes Service (AKS)
- Apache Spark cluster administration
- Apache Ranger for data governance and access control
- Apache Kafka, Apache Airflow, Trino, Iceberg, Datahub
- Azure DevOps (ADO) – pipelines, repos, artifacts
Proven experience with CI/CD for data platforms and infrastructure automation.
Strong Linux administration and scripting skills (Bash, Python preferred).
Deep understanding of networking, container orchestration, and cloud infrastructure (Azure preferred).
Experience in implementing monitoring and alerting systems for distributed environments.

Nice to Have:

Experience in highly regulated industries such as banking or financial services.
Familiarity with data lakehouse architectures.
Certifications in Azure, Kubernetes, or Big Data technologies.

When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the Tech Aalto Privacy Policy, a copy of which is published at Tech Aalto’s website (https://www.techaalto.com/privacy/)
Confidentiality is assured, and only shortlisted candidates will be notified for interviews.

Data platform administration-( ) years
- On-prem Kubernetes clusters (in-house distributions)-( ) years
- Azure Kubernetes Service (AKS)- ( ) years
- Apache Spark cluster administration-( ) years
- Apache Ranger for data governance and access control-( ) years
- Apache Kafka, Apache Airflow, Trino, Iceberg, Datahub-( ) years
- Azure DevOps (ADO) – pipelines, repos, artifacts-( ) years
CI/CD for data platforms and infrastructure automation-( ) years
Strong Linux administration and scripting skills (Bash, Python)- ( ) years
Networking, container orchestration, and cloud infrastructure (Azure preferred)- ( ) years
Experience in implementing monitoring and alerting systems for distributed environments-( ) years

Nice to Have:

Experience in highly regulated industries such as banking or financial services.
Familiarity with data lakehouse architectures.
Certifications in Azure, Kubernetes, or Big Data technologies.