Data Engineer - Big Data

JR United Kingdom; Gloucester; Hybrid; GBP 45,000 - 70,000; Full time

Job summary

A leading company in the UK is seeking a skilled Data Engineer with Active Security Clearance. Join their team in a hybrid working environment to design and implement data pipelines supporting large-scale analytics. The role demands strong expertise in AWS services and big data technologies, with responsibilities including data architecture development and optimizing data systems for business needs.

Qualifications

• Active Security Clearance is required.
• Strong background in AWS services like S3 and Redshift.
• Experience in big data technologies and data architecture.

Responsibilities

• Develop and maintain data architectures and processing systems.
• Collaborate to ensure data availability for analyses.
• Optimize data models for business intelligence and reporting.

Skills

AWS

Data Engineering

ETL Processes

Data Modelling

Big Data Technologies

Communication

Job description

Social network you want to login/join with:

Hybrid working (2-3 days per week in Gloucester)

3 months

We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically within the AWS ecosystem. You will be responsible for designing and implementing data pipelines that support large-scale data processing and analytics.

Key Responsibilities:

- Develop, construct, test, and maintain data architectures and data processing systems.

- Collaborate with data scientists and analysts to understand data requirements and ensure data availability.

- Design and optimise data models to support business intelligence and reporting needs.

- Monitor and troubleshoot data systems to ensure high availability and performance.

- Implement best practises for data management, security, and compliance.

Required Skills:

- Active Security Clearance

- Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR.

- Strong experience with big data technologies and frameworks.

- Solid understanding of data modelling, ETL processes, and database management.

- Ability to work effectively in a team environment and communicate technical concepts clearly to non-technical stakeholders.