Principal Data Engineer

Fusion People; Bristol; On-site; GBP 40,000 - 60,000; Full time

Job summary

A leading company in data solutions is seeking a Data Developer to build pipelines for analytics and AI projects. You will contribute significantly by working on data workflows, ensuring governance, and leading innovation on the platform. This permanent position offers a competitive salary with benefits, making it an appealing opportunity for skilled professionals in the field.

Qualifications

• Strong knowledge of Python programming required.
• Experience with Azure Databricks and Pyspark is ideal.
• Adept in data governance and adaptable to flexible work environments.

Responsibilities

• Build and develop re-usable pipelines for analytics and AI projects.
• Lead relationships between IT and Data to enable new capabilities.
• Monitor execution of data workflows and mitigate risks.

Skills

Python programming

Pyspark

Azure Databricks

Data governance best practices

Communication to non-technical audience

Job description

Social network you want to login/join with:

Salary: Competitive + 28% pension contributions

Job type: Permanent/fulltime or 6 – 12 month contract (both options available)

Summary of any essential experience required for the role

• Strong Python programming knowledge, ideally Pyspark
• Knowledge of the Azure Databricks platform and associated functionalities
• Adaptable, with a willingness to work flexibly as the needs of the organisation evolve.
• Working well within a team, and able to work closely with internal and external stakeholders.
• An ability to take a logical and analytical approach, and to take a pragmatic, collaborative approach to solving problems.
• Adept at communicating technical concepts to a non-technical audience.
• Awareness of the modern data stack and associated methodologies

You will be a key individual contributor and be responsible for:

• Building and developing re-usable pipelines for analytics and AI projects
• Pushing for innovation within the platform to enable great efficiencies and detailed insights and outputs
• Leading key relationships between IT and Data to grow the platform and release new capabilities
• Deploying production AI models with automated monitoring from the data pipeline to the model runs and outputs

As well as supporting the team responsibilities on:

• Work to Extract, Load & Transform (ELT) data sets from a variety of data sources across the clients enterprise technology stack, with a particular focus on the Extract & Load parts.
• Monitoring the execution of data workflows, including identifying and mitigating risks, setting service level indicators, and configuring alerts.
• Adopting data governance best practices when processing raw data to develop, test, and maintain datasets, including the use and maintenance of relevant resources (such as, but not limited to, a data catalogue, data dictionary, logical data models).
• Developing coding standards for Python programming to be used across the Data function.

— Fusion People are committed to promoting equal opportunities to people regardless of age, gender, religion, belief, race, sexuality, or disability. We operate as an employment agency and employment business. You’ll find a wide selection of vacancies on our website.