Data Scientist jobs in United Kingdom
Discover more opportunities than anywhere else. Find more jobs now
Connect with headhunters to apply for similar jobsAdvanced Digital Data Analyst - Digital Engagement
lloyds banking group
Data Architect / Data Modeler Contract
Consortia Group
Operations / Data Analyst
Taylor James Resourcing
Data Engineer
Job summary
A leading data solutions firm in the City of London is seeking a motivated Data Engineer. This role involves developing and maintaining a data-bricks lake house architecture, ensuring accessible and accurate data for decision-making. Candidates should have experience in data warehousing, proficiency in SQL and Python, and relevant certifications. This position offers an engaging environment focused on data quality and stakeholder collaboration.
Qualifications
- Experience in data warehousing, data lakes and data integration.
- Hands-on experience with Databricks for scalable data processing.
- Proficiency in SQL, Python, and modern data pipeline tools.
Responsibilities
- Design, develop, unit test, and deploy data pipelines.
- Optimize automated data quality and validation processes.
- Collaborate with data scientists for data needs.
Skills
Education
We are seeking a motivated Data Engineer to support the development, and maintenance of a data-bricks lake house architecture. This role is critical in enabling the organisation to store, integrate, and analyse large volumes of data from diverse sources, ensuring data is accessible, accurate, and actionable for decision-making.
- Contribute to the design, development, unit testing, and deployment of data pipelines for extraction, ingestion, and transformation of data.
- Support the development of scalable data architecture to process and store datasets efficiently.
- Optimisation of data pipelines from internal and external sources using modern data engineering tools and frameworks.
- Ensure their deliverables meet the team standards and best practices.
- Work closely with data scientists, analysts, and business stakeholders to understand data needs and deliver fit-for-purpose datasets and operational data capabilities.
- Collaborate with team members to support applications and resolve technical challenges.
- Create and maintain high-quality documentation
- Optimize automated data quality, cleansing, and validation processes within data pipelines.
- Experience in data warehousing, data lakes and data integration, transformation, and modelling
- Hands-on experience with Databricks for scalable data processing and Azure SQL for data storage and querying.
- Proficiency in SQL, Python, and modern data pipeline tools (e.g. dbt).
- Demonstrate an ability to implement data quality frameworks and ensure data integrity across systems.
- Familiarity with data privacy regulations (e.g., GDPR) and security best practices.
- Follow best practices for data security and privacy, ensuring compliance with internal policies and external regulatory requirements.
- Apply technical knowledge to deliver key projects, including the automation of data deployment, release, and upgrade processes.
- Experience working in cross-functional teams and collaborating with other engineers.
- Databricks or Azure Data Engineer certifications (e.g. Databricks Certified Data Engineer Associate or Databricks Certified Data Engineer professional)
- DBT Analytics Engineering Certification
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.