Data Engineer-Jobs in Großbritannien

Zusammenfassung

A leading recruitment agency in the UK is seeking an experienced Azure Data Engineer to design and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks and Azure Synapse Analytics, as well as a passion for transforming raw data into reliable datasets. Key responsibilities include developing data pipelines using Azure services and collaborating with stakeholders to deliver solutions. This is a remote role with competitive pay and benefits.

Qualifikationen

• 3+ years of experience as a Data Engineer or in a similar role.
• Strong experience with Azure Databricks (PySpark, Spark SQL).
• Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools).
• Solid understanding of data warehousing concepts and dimensional modeling.
• Proficiency in SQL and Python.
• Experience with Azure data services like Azure Data Lake Storage, Azure Data Factory, and Azure SQL.
• Familiarity with CI/CD pipelines and version control (Git, Azure DevOps).
• Experience working in Agile/Scrum environments.

Aufgaben

• Design, develop, and optimize end-to-end data pipelines using Azure services.
• Build and maintain scalable ETL/ELT workflows using Azure Databricks.
• Develop and manage data warehouses and analytics solutions using Azure Synapse Analytics.
• Ingest data from multiple sources into Azure data platforms.
• Implement data modeling, transformation, and validation to ensure data quality.
• Optimize performance, cost, and scalability of data pipelines and queries.
• Collaborate with data analysts and stakeholders to deliver data solutions.
• Implement security, governance, and compliance best practices.
• Monitor, troubleshoot, and resolve pipeline and performance issues.
• Document data architecture, pipelines, and operational processes.