Data Engineer/Architect - Apache Airflow - Astronomer

Akkodis; City Of London; On-site; GBP 129,000 - 148,000; Full time

Job summary

Modis are seeking a Data Engineer/Architect to lead a production-grade Apache Airflow/Astronomer rollout for a major financial services client in London. The role focuses on establishing scalable orchestration, RBAC controls, and observability while aligning with DBT and Snowflake workloads.

You will collaborate with data engineering and platform teams, upskill colleagues, and ensure a robust, cost-effective orchestration capability during a 6-month engagement, onsite three days a week.

Qualifications

• Excellent communication and stakeholder engagement skills.
• Strong background with DBT, Snowflake and Python.
• Experience with Apache Airflow and Astronomer, preferably Astronomer Cosmos.
• Experience on an Airflow/Astronomer implementation would be preferred.

Responsibilities

• Defining reusable Architectural and Orchestration patterns for DBT and Snowflake Workloads.
• Establishing security, secrets, RBAC and environment controls.
• Implementing monitoring, alerting and observability for platform and workloads.
• Defining integration patterns between Airflow and enterprise schedulers (Autosys).
• Upskilling and documenting for the wider team on Apache Airflow / Astronomer Cosmos.

Skills

Communication

Stakeholder engagement

Tools

Airflow

Astronomer

Astronomer Cosmos

DBT

Snowflake

Python

AutoSys

Azure DevOps

GitHub Actions

Job description

Data Engineer/Architect - Apache Airflow - Astronomer

Location: London - 3 days a week onsite (non-negotiable)
Duration: 6 Months
Rate: £700-£800 per day Inside IR35

The Role

We're supporting a highly reputable client in the Financial Services industry who are seeking an experienced Data Engineer to support them through a period of significant change across their Technology Delivery function.

The team are in the early stages of adopting Apache Airflow and Astronomer as their core orchestration platform/tooling for their DBT projects. To move forward with the process and maximise the tooling, the team require an Engineer with expertise in this field to take technical ownership of establishing Astronomer as a production-ready, scalable, observable and cost-effective orchestration capability, working alongside our existing Data Engineering and platform teams. Responsibilities will include:

• Defining reusable Architectural and Orchestration patterns for DBT and Snowflake Workloads
• Establishing appropriate security, secrets, RBAC and environment controls
• Implement monitoring, alerting and observability covering platform and workload health.
• Defining reliable integration patterns between Airflow and our client's wider enterprise scheduling environment (Autosys etc)
• Provide upskilling and documentation to the wider team to aid with the option of Apache Airflow / Astronomer Cosmos

Essential Experience

• Highly experienced Data Engineer/Architect with a broad range of enterprise environment experience
• Strong background with DBT, Snowflake and Python
• Previous experience working with Apache Airflow and Astronomer, with a strong preference towards Astronomer Cosmos experience
• Experience on an Airflow/Astronomer implementation would be preferred
• Excellent communication and stakeholder engagement skills

Desirable Experience

• Experience supporting client's in the Financial Services sector
• Enterprise scheduler tooling experience, with a preference towards AutoSys
• CI/CD, testing and deployment experience
• Azure DevOps and/or Github Actions experience

Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.