One of the world's largest education technology innovators (USA / UK / Asia) is delivering radical change inside UK primary and secondary education through data engineering and digital transformation. This job offers you a chance to make a difference to the education sector by improving teaching and learning through data, using Azure Data Factory / Data Lake!

This senior role reports directly to the Director of Data Engineering in the UK and will take you out of your comfort zone as you push the possibilities of what Azure can deliver.

Here is the experience we need:

Solid and demonstrable experience with the components of Azure Synapse

Highly competent with Azure Data Factory and Azure Data Lake
Excellent knowledge of Azure services supporting the modern data architecture
Expert in the design and implementation of data storage solutions including partitioning and serving data
Expert in designing and developing data processing using data factory and Synapse pipelines
Experience in developing batch-processing solutions including triggers and validation
Ability to monitor and optimize data storage and processing
Experience in designing and implementing data security in Azure
Self-starter/able to work collaboratively as part of a team
Confident communicating with stakeholders of all levels including the ability to advise, train and support staff where necessary
Ability to organise and manage own time according to agreed project priorities and deadlines

Desirable Skills/Experience:

Experience in working at all stages of the project lifecycle
Exposure to data analysis and data science principles
Azure process and deployment automation (Azure DevOps)

A little more about the role!

The Azure Data Engineer should have subject matter expertise in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions.

Responsibilities for this role include helping stakeholders understand the data through exploration, building and maintaining secure and compliant data processing pipelines by using different tools and techniques. This professional uses various Azure data services and languages to store and produce cleansed and enhanced datasets for analysis.

The Azure data engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints. This professional deals with unanticipated issues swiftly and minimizes data loss. An Azure data engineer also designs, implements, monitors, and optimizes data platforms to meet the data pipeline needs.

The engineer must have a solid knowledge of data processing languages, such as SQL, Python, or Scala, and they need to understand parallel processing and data architecture patterns.

This high-profile role will lead on cutting-edge data engineering for a national scale Education Ministry multi-year project working in a small and focused team including data analyst, data science, and education consultancy. The engineer will own the Azure Synapse environment deliverables (such as Azure Data Factory and Azure Data Lake) working hand in hand with the rest of the project team and will be expected to contribute to both the functional specifications as well as the handover to QA. As it is a small team working on cutting-edge developments, third-line support for the assets provided will also escalate back to the project team.

If you’re interested in finding out more please send your CV. Of course, we’ll discuss this role and your skills at length before making a formal application and if we have a chat and it’s not for you we’ll look for other things in the future.