Data Engineer

We are seeking a highly skilled Azure Data Engineer to join our newly formed Group Data Office (GDO). As a vital member of the new team, you will play a pivotal role in the building and maintaining our Azure Data Lake (ADL) as well as developing data pipelines from enterprise systems.

The ideal candidate should have a strong background in ADL, Synapse integration, and data pipeline construction. They should be proficient in SOLID development principles and have hands on experience of Azure, or similar cloud warehousing technologies, as well as demonstrate a deep understanding of enterprise architecture.

Reporting to the Senior Data Engineer, this role is intended to work in the Data Engineering Team within the Group Data Office (GDO). The Data Engineering Team is intended to build our Azure warehouse, work closely with the Visualisation team to support Power BI data model development, build data pipelines, as well as integration of 3rd party data.

You will be expected to:

• Design, implement and maintain Azure Data Lake Storage solutions that effectively store and manage data for enterprise-level analytics
• Collaborate cross-functionally to integrate Azure Synapse into our data ecosystem, enabling efficient data processing and analytics
• Develop and maintain robust data pipelines to Extract, Load and Transform from various enterprise systems into the ADL
• Apply SOLID software development principles to ensure code quality, maintainability, and scalability of data engineering solutions
• Work within TOGAF to align data engineering efforts with enterprise architecture standards and best practices
• Collaborate with software developers and 3rd party vendors to design and implement API integrations that facilitate data exchange between systems
• Implement data transport mechanisms using XML and JSON formats over HTTPs protocols, ensuring data integrity and security during transit
• Demonstrate a deep understanding of the software development lifecycle (SDLC) and actively participate in software testing, deployment and maintenance activities.