Data Engineer - Python/SQL on Azure Databricks

Adria Solutions; England; On-site; GBP 50,000 - 70,000; Full time

Benefits offered by this job

26 days annual leave

Birthday off

Contributory pension scheme

Health & wellbeing initiatives

Job summary

Adria Solutions is seeking a hands-on Data Engineer to join our Southampton team. You will design and build scalable data pipelines using Python and SQL, while enhancing a cloud-based data platform on Azure and Databricks.

You will collaborate with Data Scientists and analysts to deliver robust data solutions that support analytics and BI. You will ensure data quality, governance and security, and explore AI-driven automation to monitor pipelines and improve efficiency.

Qualifications

• Strong commercial experience in Data Engineering, with Python-driven pipelines.
• Excellent SQL and data modelling knowledge.
• Experience with cloud data platforms (Azure/Databricks).
• Understanding ETL/ELT and data integration patterns.
• Knowledge of data governance, security and quality standards.

Responsibilities

• Design, develop and maintain scalable data pipelines using Python and SQL.
• Build and enhance a cloud-based enterprise data platform on Azure/Databricks.
• Develop robust data integration processes for analytics and BI.
• Ensure data quality, governance, security and compliance.
• Administer databases, optimize performance and manage access.
• Explore AI-driven automation to monitor pipelines and boost efficiency.
• Utilise Azure DevOps for version control and workflows.
• Collaborate with Data Scientists and analysts to deliver solutions.
• Troubleshoot issues and improve platform reliability.

Skills

Python

SQL

Azure

Databricks

Data pipelines

CI/CD

Data governance

Analytics

Tools

Azure DevOps

Job description

Adria Solutions is seeking a hands-on Data Engineer to join our Southampton team. You will design and build scalable data pipelines using Python and SQL, while enhancing a cloud-based data platform on Azure and Databricks.

You will collaborate with Data Scientists and analysts to deliver robust data solutions that support analytics and BI. You will ensure data quality, governance and security, and explore AI-driven automation to monitor pipelines and improve efficiency.