Data Engineer - Azure, Spark & AI Pipelines (Hybrid Madrid)

AVEVA; Cambridgeshire and Peterborough; Hybrid; GBP 51,000 - 77,000; Full time

Job summary

AVEVA is seeking an experienced Data Engineer for the Data Science & AI team to design, build, and maintain scalable data pipelines and architectures powering advanced analytics and AI agent development. You will collaborate with data scientists, AI engineers, and business stakeholders to ensure reliable, accessible data for analytics and operations.

Your role emphasizes data quality, governance, and secure data handling within Microsoft ecosystem tools and cloud services.

Qualifications

• 5+ years of experience in Data Engineering.
• Strong Python and SQL skills.
• Experience with Spark/Databricks and Azure.
• Experience in ETL/ELT pipelines.

Responsibilities

• Design, develop, and maintain robust, scalable data pipelines.
• Build and manage data architectures and data models.
• Ensure data quality, governance, and security standards.
• Collaborate with Data Scientists and AI Engineers.
• Optimize data processing for performance and cost-efficiency.
• Integrate multiple data sources and develop end-to-end workflows.

Skills

Python

SQL

Azure

Databricks

Spark

ETL/ELT

Power Automate

Git/CI/CD

Data Modeling

Education

Master’s or Ph.D. in Data/CS/Statistics/Mathematics

Tools

Azure Data Factory

Job description

AVEVA is seeking an experienced Data Engineer for the Data Science & AI team to design, build, and maintain scalable data pipelines and architectures powering advanced analytics and AI agent development. You will collaborate with data scientists, AI engineers, and business stakeholders to ensure reliable, accessible data for analytics and operations.

Your role emphasizes data quality, governance, and secure data handling within Microsoft ecosystem tools and cloud services.