Data engineer

Exalto Consulting; United States; Remote; USD 118,000 - 155,000; Full time

Benefits offered by this job

Remote work

Initial six-month contract

Outside IR35

Job summary

Exalto Consulting is urgently seeking an experienced Data Engineer to join a six-month contract, with strong AWS, Python and Apache Airflow skills. You will build and maintain data pipelines, develop cloud-based data solutions, and ensure data quality for downstream analytics and program requirements.

The role suits someone who values reliability and maintainability, with remote collaboration. Experience in ML/AI data projects or marine/geospatial data is a plus; security clearance (SC) is

Qualifications

• Strong commercial experience in data engineering.
• Hands-on experience building and supporting data solutions on AWS.
• Strong Python development skills for data processing and integration.
• Practical experience using Apache Airflow to orchestrate data workflows.
• Experience developing reliable, maintainable data pipelines.
• A methodical approach to troubleshooting and resolving data issues.
• Ability to communicate clearly and work effectively in a remote team.
• Active SC clearance that has been used within the last 12 months.
• This role is restricted to sole British nationals.

Responsibilities

• Developing and maintaining data pipelines using Python and AWS services.
• Building, scheduling and monitoring data workflows with Apache Airflow.
• Integrating data from multiple sources and preparing it for downstream use.
• Improving pipeline reliability, performance and data quality.
• Investigating data processing issues and implementing robust solutions.
• Working with technical colleagues and stakeholders to understand data requirements.
• Writing clear, maintainable code and documenting data workflows and processes.
• Applying appropriate security practices when handling data and developing solutions.

Skills

Python

AWS

Apache Airflow

Data pipelines

Data quality

Tools

Airflow

Job description

Описание

We’re urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract. You’ll help build and maintain reliable data pipelines, develop cloud-based data solutions and make data available for downstream analytics and programme requirements. This opportunity would suit someone who combines practical engineering skills with a focus on data quality, reliability and maintainability. Experience supporting machine learning or artificial intelligence programmes would be valuable. Marine or geospatial data experience would also be a significant advantage, although neither is essential.

Задачи

• Developing and maintaining data pipelines using Python and AWS services.
• Building, scheduling and monitoring data workflows with Apache Airflow.
• Integrating data from multiple sources and preparing it for downstream use.
• Improving pipeline reliability, performance and data quality.
• Investigating data processing issues and implementing robust solutions.
• Working with technical colleagues and stakeholders to understand data requirements.
• Writing clear, maintainable code and documenting data workflows and processes.
• Applying appropriate security practices when handling data and developing solutions.

Требования

• Strong commercial experience in data engineering.
• Hands-on experience building and supporting data solutions on AWS.
• Strong Python development skills for data processing and integration.
• Practical experience using Apache Airflow to orchestrate data workflows.
• Experience developing reliable, maintainable data pipelines.
• A methodical approach to troubleshooting and resolving data issues.
• The ability to communicate clearly and work effectively in a remote team.
• Applicants must hold active SC clearance that has been used within the last 12 months.
• This role is restricted to sole British nationals. Applicants holding dual citizenship cannot be considered.
• Будет плюсом: Experience delivering data engineering within ML or AI programmes; Experience working with marine data; Experience processing or managing geospatial datasets

Условия

£550 per day Outside IR35 Remote working Initial six-month contract A further 12-month extension is planned