Enable job alerts via email!
A leading tech company seeks a Senior Data Engineer to manage and optimize a cloud-based data platform. The ideal candidate will have a minimum of 5 years of experience, particularly with Azure tools, and excel in developing ETL processes. This is a fully remote position offering a competitive salary and a collaborative team environment.
This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.
Senior Data Engineer
Department: Services
Employment Type: Permanent
Location: Remote, UK
Description
We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure. You will be responsible for building and maintaining a scalable and robust cloud-based platform that consolidates existing legacy data services. The platform will enable efficient data management, automation of processes, and provide high-quality data services to our users and tooling.
The role is 100% remote.
Key Responsibilities
• Design, develop, and implement data pipelines and ETL processes to ingest, transform, and load data into the data platform.
• Collaborate with the Lead Architect and Cloud Engineer to ensure the seamless
integration of data services within the cloud infrastructure.
• Develop data models and schemas to support efficient data storage and retrieval.
• Implement data quality and validation processes to ensure the accuracy and consistency of data.
• Optimize data processes and queries for performance and scalability.
• Collaborate with business stakeholders to understand their data requirements and provide insights and solutions for data-driven decision-making.
• Work closely with data scientists to provide them with the necessary data and tooling for developing revenue-generating insights and models.
• Implement data governance and security controls to ensure data privacy and compliance with regulations.
• Stay updated with the latest data technologies and trends and make
recommendations for technology adoption and improvements.
Skills, Knowledge and Expertise
• Minimum 5 years experience in industry
• Excellent understanding of Azure data tools, especially Databricks
• Proven experience as a Data Engineer, working with Azure data services.
• Strong understanding of data modeling concepts and relational and
non-relational databases.
• Proficiency in SQL and experience with data integration and ETL tools (e.g., Azure Data Factory, Azure Databricks).
• Experience with data warehousing concepts and technologies (e.g., Azure
Synapse Analytics, Azure Data Lake Storage).
• Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus.
• Knowledge of data governance and data security best practices.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills to work effectively within a team environment.
• Experience with Agile methodologies is a plus.
The Ideal Candidate
• Enthusiastic, motivated self-starter
• Comfortable problem solving alone as well as part of a team
• Confident reaching out to stakeholders and colleagues in order to solve problems and understand issues
• Happy in a remote working environment
• Keen interest in new technologies and learning about them
Benefits