Data Engineer

Cognita Schools; Greater London; On-site; GBP 70,000 - 105,000; Full time

Benefits offered by this job

Competitive salary based on experience

Private Medical Insurance & Healthcare

GPP Pension

Life Assurance

25 days annual leave

Employee Assistance Programme

Employee Discounts Site

Professional Subscriptions

Job summary

Cognita Schools is seeking a hands-on Data Engineer to build and maintain a modern cloud data platform in Azure Databricks. You will design robust data pipelines across CRM, MIS, Finance, and HR, ensuring quality, governance and scalable ingestion frameworks.

Working with analysts and engineers, you will translate business requirements into reliable data solutions, using CI/CD, and contribute to a medallion-architecture approach. London office with one day remote per week is offered.

Qualifications

• Degree in a relevant field (CS/IS/engineering).
• Proven experience designing and delivering production-grade data pipelines in cloud environments.
• Strong Azure Databricks, PySpark, Delta Lake, Databricks Jobs knowledge and SQL proficiency.

Responsibilities

• Build and maintain Cognita's modern data platform in Azure Databricks.
• Design, develop and optimise end-to-end data solutions from source systems (CRM, MIS, Finance, HR).
• Implement data quality, monitoring, governance and schema management; CI/CD practices.

Skills

PySpark

Delta Lake

SQL

Data pipelines

Medallion architecture

CI/CD practices

Collaboration

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems or related field

Tools

Azure Databricks

Git-based version control

APIs

Databricks Jobs

JSON/Parquet/CSV handling

Job description

About Cognita:

Cognita is a global leader in independent education. Founded in 2004, we are a growing community of 90 schools in 20 countries - in Europe, North America, Latin America, Asia and the Middle East - serving more than 100,000 students. Each of our schools are proudly unique, however our collective purpose is to create an environment where everyone can, "Thrive in a rapidly evolving world".

About the Role:

The Data Engineer will play a key role in building and maintaining Cognita’s modern data platform, developing robust and scalable data pipelines within our Azure Databricks environment. Working with data from a range of core systems, including HubSpot CRM, MIS, Finance and HR platforms, you will design, develop and optimise end-to-end data solutions that transform raw information into reliable, high-quality datasets for business use. Responsible for managing data across the bronze and silver layers of our medallion architecture, you will implement effective ingestion processes for structured and semi-structured data, ensure pipelines are resilient, observable and well-governed, and support evolving business requirements through strong data quality, monitoring and schema management practices. Collaborating closely with analysts, analytics engineers, platform engineers and the wider Group Data team, you will help deliver data models that meet organisational needs while maintaining high engineering standards through documentation, code reviews and CI/CD practices. This is an excellent opportunity for a hands‑on Data Engineer who enjoys solving complex data challenges, working within a modern cloud-based technology stack, and translating business requirements into scalable and maintainable data solutions.

Working Arrangement: 4 days per week in London office, 1 day working from home.

To view the role profile, click here

Who We Are Looking For:

We are looking for a skilled and hands‑on Data Engineer with proven experience designing and delivering production‑grade data pipelines within modern cloud environments. You will have strong expertise in Azure Databricks, including PySpark, Delta Lake and Databricks Jobs, alongside excellent SQL skills and a solid understanding of medallion architecture principles. Comfortable working with data from CRM, MIS, Finance and HR systems, you will have experience building scalable ingestion frameworks using APIs and a range of structured and semi‑structured data formats, including JSON, CSV and Parquet. You will be confident implementing data quality controls, managing schema changes, and using Git‑based version control to support robust engineering practices. With a collaborative approach and strong problem‑solving skills, you will be able to translate business requirements into reliable technical solutions and work effectively with both technical and non‑technical stakeholders. A degree in Computer Science, Data Engineering, Information Systems or a related field, along with Azure certifications and ongoing professional development in cloud data technologies, would be advantageous.

Benefits at Cognita:

• Competitive salary based on experience
• Private Medical Insurance & Healthcare Cash Plan
• GPP Pension
• Life Assurance
• 25 days annual leave allowance (plus Bank Holidays)
• Employee Assistance Programme
• Employee Discounts Site
• Professional Subscriptions

The Closing Date for Applications is: Sunday 18th October 2026

Cognita Schools is committed to safeguarding and promoting the welfare of children and young people. We expect all staff and volunteers to share this commitment. All appointments are subject to safer recruitment checks, including an enhanced DBS check. Our Safeguarding and Child Protection Policy is available on the school website. Details on Recruitment of Ex-Offenders is included within the Application Guidance.

We are an equal opportunities employer committed to diversity and treating all employees with dignity and respect regardless of background.

Early applications are encouraged, we reserve the right to interview and appoint prior to closing date for the right applicant.