Lead Data Engineer at NPAworldwide Birmingham, AL

NPAworldwide; Birmingham (AL); Híbrido; USD 67.000 - 94.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible hours

Hybrid/remote work

Learning budget

Career development

Team events

Pension

Healthcare

Collaborative culture

Descripción de la vacante

Wishalicious is seeking a seasoned Data Engineer to design, build and maintain scalable data pipelines. You will collaborate with customers and colleagues to ensure data availability, quality, security and performance across high priority projects in regulated environments.

You will work with Snowflake, Databricks, and cloud platforms (AWS/Azure) to implement robust ETL/ELT processes, data models, and governance standards while contributing to technical roadmaps and strategy.

Formación

• Proven experience as a Data Engineer in complex environments.
• Strong knowledge of data modelling, integration, quality and governance.
• Experience with Snowflake and Databricks is essential.
• Familiarity with cloud platforms (AWS/Azure) and data pipelines.

Responsabilidades

• Interpret, validate, and analyse data requirements across complex environments.
• Gather, profile, and analyse large-scale datasets to ensure data accuracy and quality.
• Design and implement robust ETL/ELT frameworks for data ingestion and transformation.
• Develop and maintain scalable data pipelines for analytics and operations.
• Implement data quality controls and prepare datasets for reporting and visualization.
• Design and maintain data models to support analytical needs.
• Manage cloud storage solutions (S3, Azure, BigQuery, Snowflake).
• Contribute to data governance, security, and compliance practices.
• Monitor and optimise data workflows for performance and cost efficiency.
• Present technical findings to customers and stakeholders.

Conocimientos

SQL

Python

Data governance

Data quality

Security

Herramientas

Snowflake

Databricks

Airflow

Spark

BigQuery

AWS

Azure

Descripción del empleo

Visa sponsorship provided: No Location: Birmingham Remote Status: no remote Pay Type: Annual Salary Salary: 50000-70000/UK Pound Sterling Occupational Categories: Information Technology/ Computing/ Cyber/ Software Industry(ies): Consulting Services Our client is a specialist technical consultancy delivering bespoke technology and data solutions to solve complex operational challenges. Due to continued growth, they are looking for an experienced Data Engineer to join their growing engineering team.This is an exciting opportunity to work on high-priority projects supporting customers across Central Government, Defence, National Security, and Critical National Infrastructure.As a Data Engineer, you will work alongside experienced technical professionals to design, build, and maintain robust and scalable data pipelines that ensure data availability, accuracy, security, and performance.You will work closely with customers and internal stakeholders throughout the full project lifecycle, while also contributing to data engineering strategy, technical roadmaps, research, and the adoption of emerging technologies.LocationThe successful candidate can work from one of the organisation's UK offices, including Bristol, Cheltenham, or London, or work remotely from home.The role will involve occasional travel to customer sites and other company locations when required.

Key Responsibilities

• Interpret, validate, and analyse data requirements across complex environments.
• Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness.
• Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data.
• Develop and maintain scalable data pipelines to support analytics and operational decision-making.
• Implement data quality controls and prepare datasets for reporting and visualisation.
• Design and maintain data models to support analytical and operational requirements.
• Manage and optimise cloud and data storage solutions, including Amazon S3, Azure Blob Storage, BigQuery, and Snowflake.
• Contribute to data management standards, policies, governance frameworks, and best practices.
• Support data synthesis and anonymisation activities to ensure compliance, security, and appropriate data handling.
• Develop robust data models within secure and highly controlled environments.
• Monitor and optimise data workflows to improve performance, reliability, scalability, and cost efficiency.
• Evaluate emerging data technologies and identify opportunities to improve engineering capabilities.
• Contribute to data analytics and visualisation strategies.
• Present technical findings and recommendations to customers and stakeholders.
• Work collaboratively with technical and non-technical teams throughout the project lifecycle.

About You

We are looking for an experienced Data Engineer who enjoys solving complex technical problems and working collaboratively with customers and colleagues. You should have a strong understanding of modern data engineering principles, with experience working in complex or highly regulated environments.

The ideal candidate will have:

• Proven experience working as a Data Engineer within complex technical environments.
• Strong knowledge of data management principles, including data modelling, integration, quality, and governance.
• Strong commercial experience with Snowflake and Databricks – essential.
• Experience assessing existing data management systems and recommending improvements.
• Experience with modern data architectures, including cloud-based and distributed systems.
• Strong proficiency in SQL and Python.
• Experience with data engineering and pipeline technologies such as Apache Airflow and Spark.
• Experience working with cloud platforms, particularly AWS and Azure.
• Knowledge of big data technologies and distributed data processing.
• Understanding of data analytics and visualisation.
• Awareness of data standards, interoperability, data governance, and data sharing.
• Experience working with sensitive or security-conscious data environments would be highly beneficial.
• Strong analytical, problem-solving, communication, and stakeholder-management skills.

Security Clearance

Due to the nature of the projects and industries supported by our client, the successful candidate will need to be eligible to obtain high-level UK security clearance. To meet the current eligibility requirements, candidates must: Hold British citizenship; and Have been permanently resident in the UK for the previous five years. Candidates who already hold relevant UK security clearance are particularly encouraged to apply.

What’s on Offer?

This is an excellent opportunity to join a technically strong organisation with the culture and flexibility of a growing specialist business, alongside the stability and benefits of an established organisation.

The benefits package includes:

• Flexible working: 37.5-hour working week with flexibility around how you structure your time.
• Hybrid/remote working: Choice of working from home or from a UK office.
• Learning & Development: Budget available for conferences, training courses, certifications, and other professional development.
• Career Development: Opportunities to develop your technical expertise and progress your career.
• Social Culture: Regular team and company social events.
• Pension: Employer-matched pension scheme.
• Healthcare: Comprehensive healthcare benefits.
• Collaborative Environment: A supportive, inclusive, and team-focused working culture.

Equal Opportunities

Our client is committed to creating an inclusive and diverse workplace where everyone is treated fairly and with respect. Applications are welcomed from candidates of all backgrounds, regardless of ethnicity, age, gender, veteran status, religion or belief, sexual orientation, marital status, disability, or health condition. Reasonable adjustments can be provided throughout the recruitment process for candidates who require them. The organisation is committed to ensuring that all applicants have a fair and accessible recruitment experience.

Qualifications

We are looking for an experienced Data Engineer who enjoys solving complex technical problems and working collaboratively with customers and colleagues. You should have a strong understanding of modern data engineering principles, with experience working in complex or highly regulated environments.

Why is This a Great Opportunity

Professional development is an important part of the role. You will be encouraged to take ownership of your career, develop your technical expertise, and proactively pursue opportunities that support your professional goals. You will have the opportunity to work with a broad range of technologies and contribute to challenging projects that have a genuine operational impact.