Data Engineer - Big Data

JR United Kingdom; Cheltenham; Hybrid; GBP 50,000 - 80,000; Full time

Job summary

A leading company in data engineering located in Cheltenham seeks a skilled Data Engineer. This role involves designing data architectures and pipelines within the AWS framework, collaborating with teams to ensure data availability while monitoring data systems for optimal performance. The ideal candidate will possess active security clearance and expertise in big data technologies.

Qualifications

• Active Security Clearance required.
• Strong experience with data processing in AWS ecosystem.
• Ability to communicate technical concepts to non-technical stakeholders.

Responsibilities

• Design and implement data processing systems and data architectures.
• Collaborate with data scientists to ensure data requirements are met.
• Optimize data models for business intelligence and reporting.

Skills

Proficiency in AWS services

Big data technologies

Data modelling

ETL processes

Database management

Team collaboration

Job description

Social network you want to login/join with:

Hybrid working (2-3 days per week in Gloucester)

3 months

We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically within the AWS ecosystem. You will be responsible for designing and implementing data pipelines that support large-scale data processing and analytics.

Key Responsibilities:

- Develop, construct, test, and maintain data architectures and data processing systems.

- Collaborate with data scientists and analysts to understand data requirements and ensure data availability.

- Design and optimise data models to support business intelligence and reporting needs.

- Monitor and troubleshoot data systems to ensure high availability and performance.

- Implement best practises for data management, security, and compliance.

Required Skills:

- Active Security Clearance

- Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR.

- Strong experience with big data technologies and frameworks.

- Solid understanding of data modelling, ETL processes, and database management.

- Ability to work effectively in a team environment and communicate technical concepts clearly to non-technical stakeholders.