Data Engineer

TerraQuest Solutions Ltd; Birmingham; Hybrid; GBP 40,000 - 65,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to join their dynamic Solutions Team. This role involves working with cutting-edge cloud data technologies to develop a robust Data Platform that meets diverse business needs. You'll collaborate with agile software engineering teams, ensuring efficient data management and governance. With a commitment to employee well-being and professional development, this forward-thinking company offers a supportive environment where your contributions will directly impact innovative projects. If you're passionate about data and eager to grow in a collaborative setting, this opportunity is for you.

Benefits

Pension

Life Assurance

Employee Assistance Programme

Additional annual leave

Flexible working hours

Qualifications

• Minimum 2 years experience as Data Engineer with familiarity in data concepts.
• Experience with Azure technologies and data pipeline development.

Responsibilities

• Developing and maintaining Data Platform pipelines.
• Supporting data migration activities and software engineering teams.

Skills

Data Engineering

Azure Data Factory

Python

Data Modelling

Data Management

Agile Methodologies

Data Governance

Education

Bachelor's Degree in Computer Science or related field

Tools

Azure DevOps

JIRA

Git

PowerBI

Job description

TerraQuest

Role: Data Engineer

Location: Birmingham in line with our Agile Working Policy. You will need to be able to work from our Birmingham office 2 days per week/office to be attended as often as business needs require.

Salary: Competitive

Who we are...

TerraQuest Solutions Ltd is an award-winning and market-leading specialist provider of planning, land, property, and business solutions. We are an established and trusted organisation that is renowned for its expertise in providing innovative and cost-effective solutions to both public and private sectors. Our team delivers bespoke, flexible, and efficient services through a process-orientated delivery structure. We pride ourselves on strong customer relationships evidenced by the high proportion of referrals and repeat business.

Why work with us…

We are a Living Wage Foundation accredited employer, committed to supporting the well-being and development of all our people. With competitive salaries, enhanced Family Friendly policies; a fabulous suite of benefits (including: Pension; Life Assurance; Employee Assistance Programme; option to buy additional annual leave in addition to 25 days plus Bank Holidays); true flexibility with our Agile Working approach, and superb training and development opportunities, we really care about our team!

What we need...

Due to a period of sustained growth, we are looking to recruit a Data Engineer to join our Solutions Team.

Working in an emerging Data Team of data specialists, alongside our agile scrum software engineering teams - successful candidate will be developing concept of Data Platform to meet a breadth of business requirements for internal and external data consumption.

Right candidate will be expected to gain knowledge and experience in working with latest cloud data technologies, including Azure Data Factory, Databricks, and Data Lake, following industry standards, methodologies and best practices with ability to innovate and research.

What you will be doing…

• Working with range of data technologies in order to implement enterprise-wide Data Platform
• Building, testing and maintaining Data Platform pipelines
• Data engineering, including ingestion, transformation, translation, cleansing and publishing
• Data modelling
• Data management and governance as a part of the Data Team
• Supporting software engineering teams in developing new web based solutions as required
• Supporting data migration activities as required
• Providing and sharing knowledge and expertise with the rest of the team
• Keeping up to date with the current and latest data technologies and practices

What we are looking for…

Ideal candidate will have a commercial experience in working with data, within a team of data professionals, ideally within agile software development environment, will be able to take ownership of ticket / user story from its planning, through implementation to presentation.

Essential skills and experience:

• Minimum 2 years, preferably 5 years experience as Data Engineer
• Good familiarity with key digital data concepts and methodologies
• Working knowledge of following Microsoft Azure data technologies:
  • Azure Data Factory - designing, implementing and maintaining pipelines
  • Azure Databricks and Spark – transforming and processing data
  • Azure Data Lake – data modelling
  • Azure Storage Accounts
  • Azure SQL Server – with understanding of good database design principles and practices
• Ability to produce entity relationship diagrams
• Programming / scripting experience (Python)
• Familiarity with a Software Development Cycle Management Tool (Azure DevOps, JIRA…)

Advantageous skills and experience:

• Data modelling (relational, star, snowflake schemas)
• Azure Data Warehouse / Synapse
• Source control (git)
• C# programming
• NoSQL databases (Mongo / CosmosDB)
• JSON, XML
• RestAPI
• PowerBI

Please apply for more information and please do not be put off if you do not have all of the experience and skills required. If you have the majority of skills and relevant experience, we would still like to hear from you!