Data Engineer

Jacobs; Glasgow; Hybrid; GBP 55,000 - 90,000; Full time

Benefits offered by this job

Pension

Holiday allowance

Flexible working

Mentoring and development

Learning time for certifications

Volunteer and community initiatives

Job summary

Jacobs is hiring for a Data Engineer to design, build and operate cloud-based data pipelines across government and regulated environments in the UK. You will work with AWS and Azure services, PySpark, SQL and Java/Python to deliver robust data platforms, partnering with architects, analysts and stakeholders to ensure trusted data delivery and scalable analytics.

You will contribute to documentation, runbooks and reusable assets while practicing DevOps with CI/CD, automated tests and version

Qualifications

• AWS Glue, Lambda, Step Functions or Azure Data Factory, Synapse Pipelines, Azure Functions and Logic Apps
• PySpark
• SQL (Athena, Redshift, Azure Synapse SQL)
• AWS S3 or Azure Data Lake Storage Gen2
• Python and/or Java
• ETL/ELT data pipeline development
• Data quality, validation and monitoring
• Git, CI/CD and Agile delivery practices
• Eligibility for SC Clearance

Responsibilities

• Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns
• Develop and support data integration components and services, including Java-based microservices where required
• Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON
• Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse
• Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services
• Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery
• Support the performance tuning and optimisation of data pipelines, SQL workloads and integration services
• Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps
• Contribute to documentation, runbooks, data dictionaries and reusable engineering assets that support delivery teams
• Collaborate with data architects, analysts, software engineers and client stakeholders to deliver high-quality solutions
• Support DevOps ways of working through source control, automated testing and CI/CD practices
• Communicate progress, risks and technical decisions effectively with both technical and non-technical stakeholders

Job description

At Jacobs, we're challenging today to reinvent tomorrow by solving the world's most critical problems for thriving cities, resilient environments, mission-critical outcomes, operational advancement, scientific discovery and cutting-edge manufacturing, turning abstract ideas into realities that transform the world for good.

Your impact

This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity to design, build and maintain modern data platforms that help organisations unlock the value of their data and make better-informed decisions. Working alongside talented engineers, architects, analysts and client stakeholders, you'll contribute to solutions that support critical services across government, defence and highly regulated industries.

Whether your experience has been gained through data engineering, software development, cloud platforms or a combination of technical disciplines, you'll be supported to develop your skills while working on meaningful projects that make a real difference. If you're passionate about solving problems, collaborating with others and using data to create positive outcomes, we'd love to hear from you.

Day to Day

• Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns
• Develop and support data integration components and services, including Java-based microservices where required
• Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON
• Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse
• Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services
• Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery
• Support the performance tuning and optimisation of data pipelines, SQL workloads and integration services
• Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps
• Contribute to documentation, runbooks, data dictionaries and reusable engineering assets that support delivery teams
• Collaborate with data architects, analysts, software engineers and client stakeholders to deliver high-quality solutions
• Support DevOps ways of working through source control, automated testing and CI/CD practices
• Communicate progress, risks and technical decisions effectively with both technical and non-technical stakeholders

What's In It For You

• Work on impactful data engineering projects that support important services and organisations across the UK
• Build and enhance modern cloud-based data platforms using AWS and Azure technologies
• Gain hands-on experience with a wide range of data engineering, integration and analytics challenges
• Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams
• Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices
• Access mentoring, knowledge sharing and development opportunities to help you grow your career
• Contribute to solutions that deliver measurable value and meaningful outcomes for clients
• Progress through clear technical and leadership development pathways as your experience grows

Benefits

• A global network of expertise and opportunity
• A culture founded on safety, integrity, inclusion and belonging
• Flexible working arrangements that support your well-being and potential
• Investment in your development, including certifications, learning time and access to mentors
• Opportunities to contribute to communities of practice and internal technical initiatives
• Exposure to diverse projects across multiple industries and sectors
• Competitive benefits package including pension, holiday allowance and additional perks
• An inclusive environment where diverse perspectives, backgrounds and experiences are valued and encouraged

We welcome applications from candidates with varied backgrounds and experiences. If you don't meet every requirement listed but believe you can bring value to the role, we encourage you to apply.

#DigitalUKI

Here’s what you’ll need

• AWS Glue, Lambda, Step Functions or Azure Data Factory, Synapse Pipelines, Azure Functions and Logic Apps
• PySpark
• SQL (Athena, Redshift, Azure Synapse SQL)
• AWS S3 or Azure Data Lake Storage Gen2
• Python and/or Java
• ETL/ELT data pipeline development
• Data quality, validation and monitoring
• Git, CI/CD and Agile delivery practices
• Eligibility for SC Clearance

Joining Jacobs not only connects you locally but globally. Our values stand on a foundation of safety, integrity, inclusion and belonging. We put people at the heart of our business, and we truly believe that by supporting one another through our culture of caring, we all succeed. We value positive mental health and a sense of belonging for all employees.

With safety and flexibility always top of mind, we’ve gone beyond traditional ways of working so you have the support, means and space to maximize your potential. You’ll uncover flexible working arrangements, benefits, and opportunities, from well-being benefits to our global giving and volunteering program, to exploring new and inventive ways to help our clients make the world a better place. No matter what drives you, you’ll discover how you can cultivate, nurture, and achieve your goals – all at a single global company. Find out more about life at Jacobs.

We aim to embed inclusion and belonging in everything we do. We know that if we are inclusive, we’re more connected and creative. We accept people for who they are, and we champion the richness of different perspectives, lived experiences and backgrounds in the workplace, as a source of learning and innovation. We are committed to building vibrant communities within Jacobs, including through our Jacobs Employee Networks, Communities of Practice and our Find Your Community initiatives, allowing every employee to find connection, purpose, and belonging.Find out more about ourJacobs Employee Networks here.

Jacobs partners with VERCIDA to help us attract and retain talent from a wide range of backgrounds. For greater online accessibility please visit https//www.vercida.com/uk/employers/jacobs to view and access our roles.

As a disability confident employer, we will interview disabled candidates who best meet the criteria. We welcome applications from candidates who are seeking flexible working and from those who may not meet all the listed requirements for a role.

We value collaboration and believe that in-person interactions are crucial for both our culture and client delivery. We empower employees with our hybrid working policy, allowing them to split their work week between Jacobs offices/projects and remote locations enabling them to deliver their best work.

Your application experience is important to us, and we’re keen to adapt to make every interaction even better. If you require further support or reasonable adjustments with regards to the recruitment process (for example, you require the application form in a different format), please contact the team via Careers Support.