Client: It's one of the world's leading automobile manufacturer.

Job Description

What we do as DA4AD (Data Analytics for Automated Driving) team @MBRDI: Real-world
data rarely comes clean and we have tons of real world data measurement data being collected
over time across the globe from our Mercedes vehicles. We work in an ecosystem where
massive amount of complex data being processed everyday (volume, variety, & velocity). We
focus on statistical analysis to unleash different aspects of data to solve research problems of
the future mobility business (driver-less cars). The data analytics team builds end-end data
processing pipelines. These pipelines are deployed on our On-prem clusters to generate the
much needed business value from the measurement data.
In summary, our goal is to democratize data and enable data driven development for the automated driving group.

Key Skills:

Deep understanding of Spark architecture
Excellent programming skills with PySpark, Python
Experience with optimizing data processing solution on Spark
Experience with deploying big data computing solutions
Working know-how on Apache Airflow is an added advantage
Time series data processing skills are an added advantage

Key Responsibilities:

Design and develop data lake/mart (Re-design, re-develop) solution
Optimization of existing data processing pipelines for execution time and resources
Design and develop monitoring for data processing pipeline
Optimize deployment strategies for data pipelines

Senior Data Scientist