Pipeline Engineer

St. James’s Place; Greater London; Remote; GBP 50,000 - 90,000; Full time

Job summary

An established industry player is seeking a talented data engineer to design and maintain scalable data solutions. This role involves utilizing cutting-edge tools like Snowflake and AWS to optimize data accessibility and reliability for AI and analytics. The ideal candidate will thrive in a collaborative environment, working closely with data scientists and stakeholders to create innovative solutions that drive business performance. With a focus on continuous learning and improvement, this position offers the chance to make a significant impact in a forward-thinking company committed to excellence and innovation.

Benefits

Discretionary annual bonus

28 days annual leave plus bank holidays

Competitive parental leave

Private medical insurance

10% non-contributory pension

Qualifications

• Strong proficiency in SQL and basic proficiency in Python required.
• Experience with Snowflake and AWS services for data engineering.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Snowflake.
• Collaborate with teams to ensure data integrity and compliance.

Skills

SQL

Python

Data Engineering

Machine Learning

Data Visualization

Education

Bachelor's Degree in Computer Science or related field

Tools

Snowflake

AWS

Matillion

PowerBI

Tableau

Job description

Posted on: 30/04/2025 – Application Deadline: -

Are you ready to chart your own career path? At SJP, we need talented individuals like yourself to support our evolving culture. If you're seeking an employer that is passionate about excellence, innovation, and autonomy, SJP could be the place for you.

At a glance:

Location: United Kingdom

Workplace Type: Remote

Employment Type: Permanent

Seniority: Mid-Senior Level

Number of roles available: 2

The primary purpose of this role is to design, implement, and maintain scalable, efficient, and cost-effective data solutions using modern data ecosystem tools including Snowflake, AWS, Matillion, and data visualization tools such as PowerBI and Tableau. This role is key in ensuring data is accessible, reliable, and optimized for AI, Machine Learning, analytics, and empowering stakeholders to make data-driven decisions. This includes collaborating with teams across the organization to understand data requirements, designing and building solutions, whilst ensuring compliance with data and AI governance and security protocols.

What you'll be doing:

• Clean, transform, and preprocess raw data to make it suitable for Machine Learning and AI algorithms
• Design, develop, and maintain scalable data pipelines to meet project requirements.
• Integrate structured and unstructured data from various sources into a central data platform, ensuring data integrity.
• Establish monitoring systems for AI and ML solutions to ensure performance, reliability, and scalability.
• Facilitate continuous learning pipelines to refine models based on new data and changing business requirements.
• Collaborate with data scientists, analysts, product owners, and other stakeholders to ensure that data pipelines meet modeling requirements and deliver tailored Snowflake-based solutions.
• Work closely with third-party AI and machine learning solution providers to integrate and operationalize their solutions within our infrastructure and/or assess the data solutions offered by external providers, ensuring they align with business needs, technical standards, and regulatory requirements.
• Ensure solutions are built to centrally maintained standards and that data governance and security protocols are followed to safeguard sensitive data.
• This also includes data visualization such as PowerBI and Tableau.
• Monitor, troubleshoot, and improve Snowflake data pipelines for performance and reliability.
• Work with data architects to design critical data models.

Who we're looking for:

A technical individual driven by the future of technology and utilizing its benefits to enhance the company. You will be excited to drive change and innovate solutions to enable better performance.

• Design, develop, and maintain scalable data pipelines and ETL processes using Snowflake
• Build and optimize Snowflake data architecture to ensure efficient data retrieval and processing.
• Strong proficiency in SQL and basic proficiency in Python required.
• Familiarity with AWS services and Matillion relevant to data engineering (e.g., S3, DynamoDB, Glue).
• Basic proficiency in PowerBI preferred,
• Stay current with Snowflake features, tools, and best practices in data engineering.

Maintain an understanding of database systems (SQL) and data modeling concepts.

Special Requirements:

N/A

What's in it for you?

We reward you for the work you do, whether through our discretionary annual bonus scheme reflecting personal and company performance, a competitive annual leave allowance (28 days plus bank holidays, with an option to purchase an additional 5 days), or an online rewards platform with various discounts.
We also offer benefits to support different life stages, including:

• Competitive parental leave (28 weeks full pay)
• Private medical insurance (optional taxable benefit)
• 10% non-contributory pension (increasing with length of service)

Reasonable Adjustments

We're an equal opportunities employer committed to accessible and inclusive recruitment. If you require reasonable adjustments at any stage, please contact us at [e-mail].

Research indicates that applicants, especially from underrepresented groups, may be discouraged if they do not meet all criteria or have had an extended career break. If you believe you're a good fit and can demonstrate transferable experience, please apply, even if you don't meet every requirement.

What's next?

If you're excited about this role and believe you have the skills and experience we're seeking, we want to hear from you! Submit your application by clicking ‘apply’ below, and our team will contact you.
As a business regulated by the FCA, please familiarize yourself with conduct regulations and consumer duty obligations prior to an interview with SJP.