Data Engineer

Cloudsmith; United Kingdom; Hybrid; GBP 60,000 - 85,000; Full time

Job summary

A leading SaaS company in the UK is seeking a Data Engineer to develop their critical data platform. You will collaborate with cross-functional teams to build scalable data solutions while leveraging AWS technologies. The ideal candidate has a robust background in data engineering, strong programming skills in Python and SQL, and is passionate about continuous learning. This role offers a competitive compensation package, an innovative work environment, and opportunities for professional development.

Benefits

Competitive compensation package

Health, dental, and vision insurance

Generous annual leave

Flexible working policies

Professional development budget

Dynamic work environment

Qualifications

• Proven track record in designing and building large-scale data platforms.
• Knowledge of AWS and associated services.
• Strong programming skills, especially in Python and SQL.

Responsibilities

• Design and develop the data platform and data pipelines.
• Collaborate with cross-functional teams to integrate systems.
• Drive innovation in data practices with the latest technologies.

Skills

Data Engineering

AWS Services

Python

SQL

Problem-Solving

Communication

Tools

Postgres

ClickHouse

S3

Lambda

Kinesis

Kafka

dbt

Job description

Data Engineer

Are you ready to play a central role in designing and building a best‑in‑class artifact management and software supply‑chain security platform? If you have a strong grounding in data engineering principles, enjoy creating scalable, efficient, and secure data solutions, and bring real passion for your craft, we’d love to hear from you. This is a challenging and rewarding role for someone with a genuine curiosity and a drive to keep learning.

Join Cloudsmith as a Data Engineer and help shape the future of secure software delivery.

About Cloudsmith

Cloudsmith is transforming how organizations handle software artifacts and secure their supply chains. As a fully managed multi‑tenant Software as a Service (SaaS) platform, we enable organizations to build software better, through best‑in‑class artifact management and software supply chain security. Our vision is to become the software supply chain itself, powering the future of software delivery.

We are the world's most potent artifact management platform, built by developers for developers. Our platform supports over 30 formats spanning languages, container formats, and operating systems, with enterprise‑grade features, including vulnerability and security scanning, world‑class policy management and enforcement, and web‑scale to handle the Fortune 500. Organizations integrate Cloudsmith as critical infrastructure into their development, deployment, and distribution pipelines, trusting us to protect and accelerate, no matter the scale.

Backed by top‑tier investors and on a trajectory toward IPO and beyond, we’re building mission‑critical infrastructure that powers software delivery for organizations worldwide. We operate at the cutting edge of cloud‑native technology, tackling complex distributed systems challenges that directly impact millions of developers. Now is an exciting time to join us as we revolutionize how organizations deliver and secure software and help write the next chapter of our rocketship growth story.

The Role

As a Data Engineer, you will be at the heart of developing the data platform that serves customer needs – both internal and external. This platform is critical to our business strategy and serves as the backbone for providing insights to customers to help improve their software supply chain, and will serve as the foundation for AI‑powered features that leverage our large amounts of static and event data across all of our customers’ build usage.

Our Team

We are four teams responsible for building application capabilities and the underlying platform upon which Cloudsmith is founded. We operate in a highly collaborative environment, where people with different skills come together to make things happen. We have a modern approach to CI/CD, deploying several times per day, and we support a global set of customers who are engineers like us.

Key Responsibilities

• Design and Development: Participate in the design and development of our data platform. You will work with other talented data engineers to build scalable, maintainable and efficient data pipelines.
• Collaborate with Cross‑Functional Teams: Work closely with data engineers, software engineers, and business stakeholders to ensure the platform meets business needs and integrates seamlessly with other systems.
• Innovation and Continuous Improvement: Stay abreast of the latest developments in data engineering and AWS technologies. Drive innovation and continuous improvement in our data practices.

Required Experience, Qualities & Skills

• Experience in Data Engineering: Proven track record in designing and building large‑scale data platforms, particularly on AWS.
• Expertise in AWS Services: Knowledge of AWS and other services related to data engineering (e.g. Postgres, ClickHouse, S3, Lambda, Kinesis, Kafka, dbt).
• Strong Programming Skills: Proficiency in languages like Python, SQL, and experience with data pipeline tools.
• Excellent Problem‑Solving Skills: Ability to tackle complex challenges and provide efficient, innovative solutions.
• Communication: Ability to communicate effectively with colleagues across various business functions.

Benefits, Location & Work Environment

Note: You must be based in Ireland or the United Kingdom and have the right to work independently without requiring sponsorship.

Headlines

• A position based in Ireland or the United Kingdom.
• A competitive compensation package, including equity.
• With comprehensive health, dental, and vision insurance.
• Plus, generous annual leave and flexible working policies to suit your lifestyle.
• Including a professional development budget for conferences and training.
• In a dynamic, innovative, trust‑centric, and supportive work environment.
• With the opportunity to shape a fast‑growing Series B startup (and beyond).
• Regular (monthlyish) travel may be required for team meetings.
• Regular (quarterlyish) travel may also be required for events and customers.

Health and Wellness

Regardless of your location, we deeply care about the health and wellness of our staff and their families; a sustainable pace is important to us. In addition to generous annual leave (PTO), we offer health and wellbeing benefits along with flexible family‑friendly working policies.

Personal Growth

You will have an enormous opportunity to learn new skills alongside your colleagues, and your continued professional development is essential to us because it's important to you. We will support you with budgets for equipment, training, books, conferences, travel, and certifications. The more powerful you become, the better for all of us.

Facilities

Cloudsmith is headquartered in Belfast, Northern Ireland, with fully‑equipped office space that’s open 24x7. We use our HQ regularly for activities like working sessions, team planning, meets and greets, and sometimes other group activities (like games!). We also hold all‑hands off‑sites in Belfast thrice yearly, with guest speakers and team activities. Many Cloudsmithers work remotely, so we rely on our online collaboration tools; Slack, Google Docs, Linear, and other popular collaboration tools are how we work.

About Equal Opportunity

Cloudsmith is an equal‑opportunity employer proud to nurture a diverse workplace that welcomes applications from individuals of all races, genders, and ethnic groups. We do not discriminate on age, religion, sexual orientation, citizenship status, military service, or health conditions. We will not tolerate discrimination of any kind within our workforce.

The Final Word

We're looking for someone who can balance ideal design with real‑world constraints, has the experience and/or potential to build a highly scalable data platform, and is fearless in rolling up their sleeves when needed. We're critical infrastructure by developers / for developers and building the world's software supply chain platform and ecosystem. We want to hear from you if you're excited to build the data platform that underpins this, and leaves a lasting impact on the software industry from today until IPO and beyond.