Sr Data Processing Engineer

General Motors; United Kingdom; Hybrid; GBP 70,000 - 100,000; Full time

Job summary

A leading automotive company seeks a Data Engineer to architect and maintain scalable data pipelines. The ideal candidate will have extensive experience in data processing and project management, collaborating with cross-functional teams to deliver efficient data solutions. This hybrid role requires a Bachelor's degree and significant industry experience.

Benefits

Relocation benefits

Immigration-related sponsorship

Qualifications

• 10+ years of experience in data engineering or related fields.
• 5+ years managing data/software development projects.
• Proficient in multiple programming languages.

Responsibilities

• Architect and maintain data pipelines for large volumes of data.
• Develop and manage integration projects across platforms.
• Ensure data integrity and quality through automated processes.

Skills

Data Engineering

Data Processing

Project Management

Python

C++

Java

Kafka

Flink

Databricks

SQL

MongoDB

AWS

Azure

HPC Architecture

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

SLURM

LSF

Job description

Job Description

What You'll Do

• Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources.
• Develop and manage projects to integrate data from various platforms and systems (e.g., on-premises and cloud databases, data lakes, APIs, third-party vendors).
• Partner with cross-functional teams (Data Scientists, Product Managers, Engineers, Aerodynamicists, etc.) to translate business requirements into efficient data solutions.
• Manage cross-functional projects that deliver these data solutions.
• Ensure the integrity, consistency, and quality of processed data through automated validation and monitoring processes.
• Ensure that all tools and architecture adhere to best practices in software engineering.

Additional Job Description

What You'll Need (Required Qualifications)

• Bachelor's degree in Computer Science, Data Science, or a related field.
• 10+ years of experience in the engineering industry, specializing in data engineering, data processing, or related fields.
• 5+ years of experience managing data or software development projects.
• Proficient in multiple programming languages such as Python, C++, Java.
• Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks.
• Skilled in managing distributed computing management systems like SLURM, LSF.
• Knowledgeable in relational and non-relational databases (e.g., SQL, MongoDB).
• Familiarity with cloud platforms (AWS, Azure).
• Excellent interpersonal skills, capable of effectively collaborating with both technical and non-technical stakeholders.
• This job may be eligible for relocation benefits.

What Will Give You A Competitive Edge (Preferred Qualifications)

• Master's degree in Computer Science, Data Science, or a related field.
• Experience leading the development and delivery of complex data pipeline projects.
• Experience developing data solutions for a motorsports environment.
• Proficiency in applying data governance, privacy, and security best practices.
• Experience with HPC architecture.
• Skilled in developing live streaming data pipelines.

Additional Details

This role is hybrid, based in the UK, but the successful candidate will also spend 10-25% of their time at the Charlotte Technical Centre as required.

GM will provide immigration-related sponsorship for this role.

About GM

Our vision is a world with Zero Crashes, Zero Emissions, and Zero Congestion. We embrace the responsibility to lead change that makes our world better, safer, and more equitable for all.

Why Join Us

We believe in making a daily choice to drive meaningful change through our words, deeds, and culture. We want every employee to feel they belong to one General Motors team.

Non-Discrimination and Equal Employment Opportunities

GM is committed to fostering an inclusive workplace that promotes diversity and belonging. We encourage candidates to review the key responsibilities and qualifications and apply for roles that match their skills. Applicants may be required to complete assessments or screenings prior to employment. For more information, see "How we Hire".

Accommodations

GM offers opportunities to all job seekers, including individuals with disabilities. If you need a reasonable accommodation during your job search or application process, please email us or call 800-865-7580, including a description of the accommodation needed, the job title, and the requisition number.