Senior Data Engineer

Eden Scott; Glasgow; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

A leading company is seeking a Senior Data Engineer to develop a modern data platform for a prominent project. This permanent role involves using advanced technologies to optimize data processing, enabling innovative search capabilities to enhance user experience. Join a skilled team and contribute to impactful data solutions while enjoying a collaborative and agile work culture.

Benefits

Competitive salary & benefits package

Opportunity to work with cutting-edge technologies

Chance to make a real impact on industry-leading platforms

Qualifications

• Experience with large-scale data processing and search technologies.
• Expert in Apache Lucene, Solr, Elasticsearch; willing to learn more.
• Hands-on experience with SQL and NoSQL databases.

Responsibilities

• Design, build, and optimize a high-performance data platform and search solution.
• Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch.
• Engineer scalable data pipelines in Java or Python.

Skills

Apache Lucene

Solr

Elasticsearch

Java

Python

SQL

NoSQL

Agile methodologies

DevOps practices

Education

Degree in Computer Science/Software Engineering

Job description

Eden Scott is recruiting a Senior Data Engineer for Amici to develop a cutting-edge platform.

As the business looks to the future, we are now seeking an experienced Senior Data Engineer for our data team. This is a permanent, full-time position.

You'll work in an agile, collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch.

What you'll be doing:

• Design, build, and optimize a high-performance data platform and search solution.


• Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch.


• Engineer scalable data pipelines in Java or Python.


• Write high-quality, test-driven code using Agile methodologies.


• Collaborate with Business Analysts, Data Engineers, and UI Developers.


• Work across the full stack, from React/TypeScript front-end to Java-based search services.


• Leverage cloud technologies like Azure Data Factory, Batch Services, Azure SQL.


• Contribute to DevOps practices, code reviews, and system optimizations.

Current projects you'll be involved in:

Good data is at the core our platform, and as we build out the next-generation version of the platform, how we process, store and present that data is core to the user experience.

We have a number of data projects planned for this year, starting with making sure supplier catalogue data works well with new search features, helping users find the right products faster.

We'll be exploring tools such as AI based categorisation models and vector search to exploit the market leading data sets which we maintain.

Role Profile

• Have experience with large-scale data processing and search technologies.


• An expert in Apache Lucene, Solr, Elasticsearch, if not you have the appetite to learn more.


• Hands on experience with SQL and NoSQL databases under your belt.


• Have experience in Java development and exposure to Python.


• Hold a degree in Computer Science/Software Engineering or equivalent experience.


• Familiar with writing automated tests and maintaining high code quality.


• You have laser sharp attention to detail.


• Strong communication skills (both verbal and written) are just some of your top talents in delivering reports and technical specifications.


• Enjoy working within a fast-paced environment, possess a 'can do' attitude, with the ability to 'flex' and perform as a strong team player.


• You have the ability and the desire to proactively identify improvements to our products and processes.


• Experience in understanding and balancing client, Company and technical needs.


• Experience of agile environments with modern DevOps and CI/CD practices.


• Thrive with the opportunity to mentor more junior members of the team.

Why This role?

• Be part of a highly skilled team developing a modern data and search platform


• Work on vector search and machine learning applications


• A culture that values innovation, collaboration, and continuous learning

What's In It for You?

• Competitive salary & benefits package


• A chance to work with cutting-edge technologies in a fast-moving, innovative environment


• The opportunity to make a real impact on a platform used by industry-leading biotech companies

This role could be remote or hybrid, if remote then you must be willing to travel to our Glasgow office a minimum of once per quarter and if hybrid it is a minimum of one office day per week which is currently set as a Tuesday.

If you're passionate about building high-performance applications and working with the latest in search and data technology, we'd love to hear from you!

Please contact our recruitment partners at Eden Scott for an informal discussion:

[e-mail]