The selected candidate will be working alongside a leading multinational pharmaceutical company on critical projects. This work is a great opportunity to work long term on a valuable project.

Responsibilities:

Design and implement the data modeling, data ingestion and data processing for various datasets
Design, develop and maintain ETL Framework for various new data source
Ability to migrate the existing Talend ETL workflow into new ETL framework using AWS Glue/ EMR, PySpark and/or data pipeline using python.
Develop and Execute adhoc data ingestion to support business analytics.
Proactively interact with vendors for any questions and report the status accordingly
Explore and evaluate the tools/service to support business requirement
Ability to learn to create a data-driven culture and impactful data strategies.
Aptitude towards learning new technologies and solving complex problem.

Requirements:

Minimum of bachelor’s degree. Preferably in Computer Science, Information system, Information technology.
Minimum 5 years of experience on cloud platforms such as AWS, Azure, GCP.
Minimum 5 year of experience in Amazon Web Services like VPC, S3, EC2, Redshift, RDS, EMR, Athena, IAM, Glue, DMS, Data pipeline & API, etc.
Minimum of 5 years of experience in ETL and data engineering using Python, AWS Glue, AWS EMR /PySpark and Talend.
Minimum 5 years of experience in SQL, Python, and source control
Experience in PostgreSQL, SQL Server, MySQL & Oracle databases.
Experience in MPP such as AWS Redshift and EMR.
Experience in distributed programming with Python, Unix Scripting, MPP, RDBMS databases for data integration
Experience building distributed high-performance systems using Spark/PySpark, AWS Glue and developing applications for loading/streaming data into databases, Redshift
Experience in Agile methodology
Proven skills to write technical specifications for data extraction and good quality code.
Experience in analytic tools Tableau/Qlik
Experience with big data processing techniques using Sqoop, Spark, hive are additional plus

Data Transformation Engineer