Role Snapshot: You will design, build and deploy world-leading data pipelines in Databricks. You’ll use Delta Lake, Apache Spark, Azure Data Factory and Python and Scala to build enterprise data platforms in the Cloud - GCP & Azure.

Working in one of the most collaborative and productive environments, this organisation has worked hard to create an incredible culture of openness and transparency. At the centre of this business, the people are all passionate about creating world-leading technologies platforms with emerging technologies. More relevant to you, world-leading data technologies!

**Their mission is to become the UK’s most trusted and responsible Fintech business.

**Your mission is to develop and maintain data products, in line with companies data strategy, architectural vision and roadmap. Adhering to defined standards, patterns and practices for the data engineering chapter.

Responsibilities:

Designing, building, deploying, operating and maintaining data products and pipelines in line with the data strategy, architectural vision and roadmaps
Working with a team of talented people as part of an agile delivery team
Ensuring quality standards are met and products are continually improved in line with business value
Working in alignment with the business stakeholders to give Oakbrook a distinctive capability in data and analytics

Skills you’ll have and skills you’ll gain - we don’t expect to find someone with everything!

Highly proficient in building and maintaining data pipelines in Databricks
Highly proficient in data engineering technologies, such as Delta Lake, Apache Spark, Azure Data Factory etc.
Highly proficient in big data engineering programming languages such as Python and/or Scala
Experience with cloud technologies, especially GCP and Azure
Experience in T-SQL and maintenance of SSIS packages
Highly proficient in ETL Process Development
Experience of Data Modelling
Experience of Data Warehousing dimensional modelling techniques.
Some experience in .NET C# or Terraform would be useful
Experience in the usage of a continuous delivery system and related concepts
Experience in the usage of data reporting tools, such as PowerBI
Strong understanding of application security concepts, including securing production applications and delivery pipelines
Strong understanding of systems required in delivering commercial finance products, and how they fit together (i.e. loan origination systems, loan management systems, collections systems)
Strong understanding of data governance concepts such as data ownership, data stewardship etc

About you!

Collaborates well in a team environment
Passionate about continuous improvement / best practice
Passionate about Business Intelligence
Confidence to speak in front of people and produce useful and concise documentation as necessary
A desire to learn new techniques and trends and apply them within our business context
An ability to successfully balance technical requirements with pragmatic delivery
Must be able to demonstrate leadership, communication and influencing skills

This client will consider candidates who require sponsorship.

Please apply online and we’ll come back to you to arrange an initial discussion with Simon Bucknell - Recruiter!

Senior Data Engineer - Databricks