Lead Data Engineer

AI Connect; City of Edinburgh; Hybrid; GBP 60,000 - 75,000; Full time

Job summary

AI Connect is seeking a Lead Data Engineer to drive the development of their data platform in a hybrid role based in Edinburgh. The position offers a salary of up to £75,000 with a robust benefits package, focusing on innovative solutions in biotech for disease detection and analysis through advanced data handling and machine learning integration.

Qualifications

• Proficiency in Python & SQL for pipeline development.
• Excellent experience with cloud platforms, preferably AWS.
• Good knowledge of Databricks preferred.

Responsibilities

• Develop data platforms and architecture for the business.
• Create data infrastructure to enable machine learning.
• Work independently under guidance from the CIO.

Skills

Python

SQL

Cloud platforms (AWS, Azure, GCP)

Databricks

IoT systems

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by AI Connect. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from AI Connect

Hybrid, 2 days per week in Edinburgh office

Up to £75,000 + comprehensive benefits package

AI Connect have partnered with an exciting growing brand in the biotech space to source a Lead Data Engineer to spearhead the development of their data platform and overall data capability. As the main Data Engineer here, you will have the opportunity to work with a good level of independence, creating data infrastructure and long-term architecture that will serve the business for years to come.

This company are developing some of the most innovative disease and parasite detection devices in the world, with more new developments lined up for testing and production in 2026. The intention is to start harnessing R&D data to improve the accuracy of biological analyses, as well as help identify potential geographical locations where disease outbreaks may occur. Most of the data you’ll be working with is ingested from various sources including laboratories and geographical sensors.

As the main data engineer, you will combine day-to-day development with big-picture strategic thinking, creating a comprehensive platform to enable machine learning and advanced analytics on IoT data. You’ll have full support and guidance from the CIO to shape the long-term strategy and align your expertise with the overall business vision, so it’s an excellent opportunity for an experienced engineer to demonstrate their independent capability.

The core skillset:

• Proficiency in Python & SQL for pipeline development, orchestration, and transformation
• Excellent experience required with cloud platforms, preferably AWS but we’re open to Azure or GCP exposure if other tech xp aligns
• Good knowledge of Databricks would be useful as implementation of Databricks can be started immediately as a main aspect of the data strategy
• Experience of working with IoT or sensor-based systems would be useful but not essential

Beyond this core skillset, our priority is always to introduce great culture fits to our client’s teams. We’re looking for enthusiastic and forward-thinking individuals who are willing to learn and pass on knowledge to the team around them.

Apply here and we’ll be delighted to tell you all the details on a call.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Biotechnology Research and IT System Data Services

Referrals increase your chances of interviewing at AI Connect by 2x

Get notified about new Data Engineer jobs in Edinburgh, Scotland, United Kingdom.

Edinburgh, Scotland, United Kingdom 3 weeks ago

Edinburgh, Scotland, United Kingdom 4 months ago

Edinburgh, Scotland, United Kingdom 2 weeks ago

Edinburgh, Scotland, United Kingdom 6 days ago

Edinburgh, Scotland, United Kingdom 1 day ago

Python Backend Junior Software Engineer - Remote 4 days a week (Europe)

Edinburgh, Scotland, United Kingdom $30,000.00-$40,000.00 1 month ago

Edinburgh, Scotland, United Kingdom 23 hours ago

Edinburgh, Scotland, United Kingdom 5 days ago

Edinburgh, Scotland, United Kingdom 3 weeks ago

Edinburgh, Scotland, United Kingdom 1 week ago

Edinburgh, Scotland, United Kingdom 1 month ago

Edinburgh, Scotland, United Kingdom 1 day ago

Data Engineer (MS/Azure) - Near Edinburgh (Hybrid)

Edinburgh, Scotland, United Kingdom 2 weeks ago

Edinburgh, Scotland, United Kingdom 1 week ago

Edinburgh, Scotland, United Kingdom 2 weeks ago

Edinburgh, Scotland, United Kingdom 2 months ago

Edinburgh, Scotland, United Kingdom 2 weeks ago

Edinburgh, Scotland, United Kingdom 2 weeks ago

Edinburgh, Scotland, United Kingdom 2 months ago

Edinburgh, Scotland, United Kingdom 2 days ago

Edinburgh, Scotland, United Kingdom 1 week ago

Edinburgh, Scotland, United Kingdom 1 month ago

Edinburgh, Scotland, United Kingdom 6 days ago

Edinburgh, Scotland, United Kingdom 4 days ago

Edinburgh, Scotland, United Kingdom 6 days ago

Freelance Data Analyst (Python) - AI Trainer

Edinburgh, Scotland, United Kingdom 5 days ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Edinburgh, Scotland, United Kingdom 4 months ago

Edinburgh, Scotland, United Kingdom 1 week ago

Edinburgh, Scotland, United Kingdom 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.