Our opportunity

We are seeking an Engineer to join our Enterprise Data Analytics & Architecture (EDAA) organization within Group Operations Business Transformation.

Your role, As a Big Data Engineer your main responsibilities will involve -

Development of data processing pipelines using Spark/Scala.
Development of tests using Spark/Scala.
Hands on development and monitoring of the Azure cloud Platform and various associated components for data ingestion, transformation and processing.
Effectively diagnosing, isolating, and resolving complex problems pertaining to data infrastructure, including performance tuning and optimization.
Designing and program writing according to functional and non-functional requirements. Developing and maintaining technical documentation.
Follows established configuration/change control processes

Your Skills and Experience -

Nice to have -

Python.
Scala.
Experience in R programming.
Experience with Hadoop technologies (i.e. Sqoop, Hive, Flume etc.).
Continuous Integration / Continuous Deployment (Azure DevOps).
Experience in data exploration using notebooks (Databricks notebooks).
Experience in automation of regular tasks(e.g. data refreshes) using bash and python scripting.
Experience with Azure cloud.
Experience with Databricks.

*Working hours can be either UTC+02:00 or UTC+05:30*