Azure Data Engineer - UK Remote

Datatech Analytics; Greater London; Hybrid; GBP 39,000 - 56,000; Full time

Job summary

A leading analytics company in the UK seeks an experienced Azure Data Engineer to design and maintain secure data pipelines on the Microsoft Azure platform. This role involves close collaboration with stakeholders and ensuring compliance with data regulations. The ideal candidate will have strong skills in MS Azure technology, ETL processes, and database management. A competitive salary is offered with remote working options.

Benefits

Home working allowance of £581 per annum

Referral bonus for recommending candidates

Qualifications

• Experience with MS Azure Databricks, Synapse, ADF, and CI/CD.
• Educated to degree level or equivalent professional experience.
• Experience writing ETL scripts and working with database technologies.

Responsibilities

• Design, build, and test data pipelines and services.
• Translate requirements into solutions with stakeholders.
• Ensure compliance and document code accurately.

Skills

MS Azure Databricks

SQL Server

Python

Data modelling

Data security practices

Communication skills

ETL processes

Education

Degree in relevant field or equivalent experience

Tools

Microsoft Azure

data lakes

DevOps tools

Job description

Azure Data Engineer

Remote Working - UK Home-based with occasional travel into the office

£39,784 - £49,477 (National)
£45,456- £55,149 (London within the M25)
Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (Within the M25)
Home working allowance of £581 per annum

Job Ref: J12964

A technically proficient Azure Data Engineer is required to join an enterprise data platform team. The role will see the successful individual designing, building, testing, and maintaining robust, scalable, and secure data pipelines and services on the Microsoft Azure platform. You'll play a key role in enabling data accessibility for business stakeholders and end users, ensuring that solutions meet functional, non-functional, and compliance requirements.

Accountabilities:

·Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products.
·Design, write and iterate code from prototype to production ready. Understand security, accessibility and version control. Use a range of coding tools and languages as required.
·Work closely with colleagues across the Data & Insight Unit to effectively translate requirements into solutions, and accurately communicate across technical and non-technical stakeholders as well as facilitating discussions within a multidisciplinary team.
·Deliver robust, supportable and sustainable data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof.
·Understand the concepts and principles of data modelling and produce, maintain and update relevant physical data models for specific business needs, aligning to the enterprise data architecture standards.
·Design and implement data solutions for the ingest, storage and use of sensitive data within the organisation, including designing and implementing row and field-level controls as needed to appropriately control, protect and audit such data.
·Clearly, accurately and informatively document and annotate code, routines and other components to enable support, maintenance and future development.
·Work collaboratively, sharing information appropriately and building supportive, trusting and professional relationships with colleagues and a wide range of people within and outside of the organisation.
·Provide oversight and assurance of suppliers and team members, coaching and mentoring colleagues to create a highly-performant and effective team.
·Design and undertake appropriate quality control and assurance for delivery of output.
·Provide direction and guidance to peers and junior colleagues, including line management and development of teams, where required.

Essential Skills and Experience:

·Educated to degree level or have equivalent professional experience.
·Essential experience of MS Azure Databricks, Synapse, ADF and CI/CD
·Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL.
·Experience following product/solution development lifecycles using frameworks/methodologies such as Agile, SAFe, DevOps and use of associated tooling (e.g., version control, task tracking).
·Demonstrable experience writing ETL scripts and code to make sure the ETL processes perform optimally.
·Experience in other programming languages for data manipulation (e.g., Python, Scala).
·Extensive experience of data engineering and the development of data ingest and transformation routines and services using modern, cloud-based approaches and technologies.
·Understanding of the principles of data modelling and data flows with ability to apply this to design of data solutions.
·Experience of supporting and enabling AI technologies.
·Experience implementing data flows to connect operational systems, data for analytics and BI systems.
·Experience documenting source-to-target mappings.
·Experience translating business requirements into solution design and implementation.
·Experience in assessing and analysing technical issues or problems in order to identify and implement the appropriate solution.
·Knowledge and experience of data security and data protection (e.g., GDPR) practices and application of these through technology.
·Strong decision-making, leadership and mentoring skills
·Proven ability to communicate to technical and non-technical stakeholders of all levels

Additional Requirements:
Candidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available.

If this sounds like the role for you then please apply today!

Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.
Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk