Data Engineer - Hybrid, Scalable Data Pipelines

Civil Aviation Authority; Gatwick; Hybrid; GBP 50,000 - 55,000; Full time

Job summary

Civil Aviation Authority in the United Kingdom is seeking a Data Engineer to inform strategic and operational decisions by sourcing, accessing and transforming data, and building robust data processes across the organisation.

You will partner with project teams to understand data sources, deliver data models and ETL solutions, and ensure governance and scalability of data flows in a hybrid Gatwick office.

Qualifications

• Knowledge of Data architecture and engineering disciplines.
• Conceptual, logical and physical data modelling with proven experience and delivery benefits.
• Understanding of Master and Reference Data Management concepts.
• An analytical mindset to challenge the business with both BAU and project deliverables.
• Knowledge of Data Platform Management.
• Willingness to confidently challenge and quantify data decisions.
• Experience in the transformation of data to meet strategic and analytical goals.
• Business analyst skills (desirable).
• Proven experience of the development of end-to-end ETL solutions delivering business benefit.
• Understanding and experience in Agile methodology/ways of work.

Responsibilities

• Partner with project teams to understand new and existing data sources, and deliver relevant project deliverables, whether data models, data extracts, data transformation.
• Data Engineers will work across both business as usual and project delivery activities and may be deployed across multiple programmes, projects and change initiatives to support organisational priorities, ensuring CAA wide delivery and adherence to the Data Strategy.
• Devise solutions and make decisions by seeking feedback from stakeholders.
• Collect, compile and cleanse data solving any problems as relevant.
• Implement & re engineer data flows to connect operational systems, accessible data for analytics and BI systems to enable scaling and repeatable use.
• Identify and use a range of programming languages and tools for data manipulation, analysis, visualisation and system integration. Develop reproducible analysis and robust code in accordance with relevant standards.
• Use analysis and models to inform and improve organisational outcomes, building models and validating results.
• Implement data solutions, using relevant software engineering architecture and design patterns.
• Design and delivery of fully governed ETL processes.
• Find, present, communicate and disseminate outputs effectively.
• Provide guidance on implementation of high-quality data management whilst developing and maintaining collaborative relationships at strategic and operational levels.
• Develop solutions that deliver the automation of existing manual processes.

Skills

Data architecture

Data modelling

Master data management

Analytical mindset

Agile

Data platform management

Data transformation

Job description

Civil Aviation Authority in the United Kingdom is seeking a Data Engineer to inform strategic and operational decisions by sourcing, accessing and transforming data, and building robust data processes across the organisation.

You will partner with project teams to understand data sources, deliver data models and ETL solutions, and ensure governance and scalability of data flows in a hybrid Gatwick office.