Senior Data Engineer

Clarity; Remote; GBP 70,000 - 90,000; Full time

Job summary

A leading AI solutions company in the UK is seeking a Senior Data Engineer to optimize and manage their AI pipeline. The ideal candidate will have strong Python skills, ML experience, and a deep understanding of cloud infrastructure. This fully remote role offers generous vacation, professional growth opportunities, and a vibrant company culture. Join us to redefine customer experience with AI and work alongside industry leaders.

Benefits

Fully Remote

In-person Meetups

Generous Vacation

Growth Opportunities

Dynamic Culture

Stock Options

Qualifications

• Strong Python skills with experience in building production services or APIs.
• Experience with SQL, ETL, and data modeling.
• Practical experience with ML concepts and libraries.
• Deep knowledge of cloud networking and security.
• Familiarity with AI infrastructure on AWS and GCP.

Responsibilities

• Extend, scale, and manage numerous integrations.
• Implement new connections and own integrations.
• Ensure AI pipeline works efficiently.
• Host and monitor NLP models for inference.
• Develop systems for monitoring model performance.

Skills

Python Proficiency

Data Pipelining

ML Experience

Infra Knowledge

Cloud Expertise

Tools

Docker

SQL

Kubernetes

AWS

GCP

Job description

Role Overview:

We are looking for a talented and passionate Senior Data Engineer to join our team. In this role, you'll be at the heart of our AI pipeline, ensuring seamless integration, scalability, and reliability of our data processes.

Key Responsibilities and Skills:

• Integrate and Scale: Extend, scale, monitor, and manage our ever-growing pile of 100s of integrations. Ensure they are reliable and responsive.

• Own the Integrations: Implement new connections and be the master and owner of these integrations.

• Optimize AI Pipelines: Ensure our AI pipeline works like clockwork. Improve and support its complex infrastructure.

• ML Experience: Practical experience with ML, including classification, clustering, time series forecasting, and anomaly detection. You need to know the concept and be handy with the most common libraries

• Model Hosting and Monitoring: Host and monitor NLP models and LLM for real-time and batch inference.

• Develop Monitoring Systems: Create and support robust models for monitoring.

• Support and Innovate: Assist with a long tail of super important tasks, bringing innovative solutions to the table.

Qualifications:

• Python Proficiency: Strong Python skills with experience in building and monitoring production services or APIs. Experience with third-party APIs is essential.

• Data Pipelining: Experience with SQL, ETL, data modeling. Experienced with the lifecycle of building ML solutions

• Speak AI language: Understand the fundamentals of ML/AI and communicate effectively with AI and Data Scientists.

• Infra: Deep Knowledge of Docker, Git, cloud networking, and cloud security for services and infrastructure. Experience with Kubernetes (K8S) is a plus.

• Cloud Expertise: Familiarity with AI infrastructure on AWS and GCP, including Sagemaker, Vertex, Triton, and GPU computing.

• Bonus Points: Experience with Airbyte is a significant advantage.

Perks and Benefits:

• Fully Remote: Freedom to work from anywhere in the world with flexible core working hours.

• In-person Meetups and Regular Team-building Remote Events: Enjoy in-person meetups and monthly game sessions for team bonding.

• Generous Vacation: Benefit from our comprehensive vacation policy.

• Growth Opportunities: Access continuous professional development and growth support.

• Dynamic Culture: Be part of a vibrant, inclusive, and energetic company culture.

• Stock Options: Participate in our stock options program in this early-stage, fast-growing startup.

About Clarity

Clarity is redefining customer experience with AI. Our mission is to empower businesses to deliver faster, smarter, and more human service interactions. By combining cutting‑edge AI with intuitive design, we enable customer service teams to operate more efficiently while providing customers with seamless, personalized experiences.

We are trusted by industry leaders like OpenAI, GrubHub, STC and Tabby who rely on us to deliver real impact. Our investors include Prosus Ventures, STV AI Fund (backed by Google) and angels from Open AI and Google. With a 25% month-on-month growth rate and over 300% net revenue retention, this is a unique opportunity to join a hyper growth AI company and redefine an industry.