Senior Data Engineer

United States Digital Space LLC; Greater London; On-site; GBP 90,000 - 150,000; Full time

Job summary

the company is seeking a highly skilled Senior Data Engineer to join the core Enterprise Data Engineering team. You will design and expand enterprise-level data infrastructure to empower internal teams to interact with data comprehensively.

The role focuses on big data processing, pipeline orchestration, and data modeling, requiring leadership in implementing scalable data solutions within a fast-paced, data-centric product environment.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 8+ years of progressive experience in data engineering with leadership impact.
• Experience owning production data systems and participating in on-call rotations.
• Proven ability to design and scale enterprise data infrastructure for data-centric products.

Responsibilities

• Design, develop, and maintain high-performance data pipelines using Airflow, DBT, and Python.
• Architect and optimize the data warehouse and lakehouse, primarily using Snowflake.
• Lead integration of diverse data sources (structured and unstructured) into the data ecosystem.
• Define roadmap priorities to ensure internal consumer needs and competitive AI capabilities.
• Mentor junior engineers and drive best practices in code quality, data architecture, and incident response.
• Collaborate with ML engineers, data scientists, and product managers to translate business needs into scalable data solutions.
• Define and monitor data quality SLAs across pipelines and products.

Skills

SQL

Python

Airflow

DBT

Snowflake

Data modeling

On-call experience

Cloud platforms (GCP/AWS)

Data quality

Education

Bachelor's or Master's in CS/Engineering

Tools

Airflow

DBT

Snowflake

Kafka

Datadog

Terraform

Grafana

Job description

the company is where careers accelerate. We move fast, think boldly, and empower you to do the best work of your life. You’ll be surrounded by teammates who care deeply, challenge each other, and celebrate wins. With tools that amplify your impact and a culture that backs your ambition, you won’t just contribute. You’ll make things happen–fast.

We are looking for a highly skilled Senior Data Engineer to become part of our core Enterprise Data Engineering team. You will be a senior member of the larger AI, Data and Innovation organization, responsible for designing and expanding enterprise-level data infrastructure that enables the company's internal teams to interact with data comprehensively.

The ideal candidate has a strong background in big data processing, pipeline orchestration, and data modeling, with a proven track record of delivering scalable and high-quality data solutions in fast-paced, data-centric product environments. Given the dynamic nature of emerging technologies, this role requires an individual who excels at exploration and embraces continuous learning as core responsibilities. You'll constantly research and implement innovative solutions while integrating vast, diverse data sources into our AI applications, including our industry-leading LLM-powered systems.

This role also carries production ownership: you will share on-call responsibility for the pipelines and platforms you build, and you're comfortable triaging, escalating, and driving incidents to resolution under pressure.

What you’ll do:

• Design, develop, and maintain high-performance, product-centric data pipelines using Airflow, DBT, and Python.

• Architect and optimize the massive-scale data warehouse and lakehouse that serves as our single source of truth for all customer data, primarily using Snowflake.

• Lead the integration of diverse structured and unstructured data sources (e.g., web data, third-party APIs) into our data ecosystem, ensuring high-quality and reliable ingestion.

• Define roadmap priorities that anticipate internal consumer needs and drive competitive advantage in data and AI capabilities.

• Serve as a trusted advisor to leadership on strategy, AI-readiness, and data infrastructure investment decisions.

• Collaborate with ML engineers, data scientists, and product managers to translate business needs into scalable data solutions that directly enhance customer value.

• Define, monitor, and enforce data quality SLAs across all pipelines and products, ensuring data accuracy and lineage are a top priority.

• Participate in a shared PagerDuty on-call rotation, responding to pipeline and platform incidents, performing root-cause analysis, and driving remediation and postmortems.

• Triage production issues quickly and expedite them appropriately, knowing when to loop in engineering leadership, Platform engineers, adjacent teams or business stakeholders based on severity, blast radius, and customer impact.

• Operate effectively amid ambiguity by making sound judgment calls and iterating with stakeholders rather than waiting for perfect clarity.

• Mentor and coach junior engineers, motivating best practices in code quality, data architecture, incident response, and operational excellence.

• Participate in architectural decisions and long-term strategy planning for our enterprise-wide data infrastructure, with a focus on cost, performance reliability, and observability.

• Contribute to and maintain runbooks, on-call documentation, and operational playbooks to reduce time-to-resolution for future incidents.

What you bring:

• Expert-level SQL for building performant, scalable queries and transformations on massive datasets.

• Strong Python programming skills with a focus on distributed computing, data manipulation, and building robust APIs.

• Production-level experience for large-scale batch and stream data processing.

• Hands-on experience with DBT (Data Build Tool) for advanced data modeling and transformations in a modern data stack.

• Deep knowledge of Snowflake data warehouse design, optimization, and cost modeling.

• Experience owning production systems, including on-call rotations (e.g., PagerDuty, Opsgenie), incident response, and postmortem processes.

• Strong understanding of data architecture concepts, including data lakes, event-driven architectures (e.g., Kafka), ETL/ELT, and data mesh.

• Proficiency with cloud platforms (GCP and/or AWS) and infrastructure as code (e.g., Terraform).

• Experience with monitoring/observability tooling (e.g., Datadog, Monte Carlo, Grafana) for proactive detection of data quality and pipeline issues.

• Familiarity with CI/CD practices applied to data workflows (e.g., automated testing for pipelines, version-controlled data models).

Required Non-Technical Skills

• Excellent communication skills – ability to explain complex technical concepts to both engineering teams and non-technical stakeholders, especially during high-pressure incidents.

• Strategic & Product-Oriented Thinking – can translate business objectives and customer needs into scalable, high-impact data solutions.

• Leadership & Mentorship – experienced guiding and uplifting engineering teams to achieve their full potential.

• Stakeholder Management – able to collaborate effectively across departments (Product, Engineering, Sales, Compliance) and communicate clearly with the right people at the right time when issues arise.

• Sound Judgment Under Ambiguity – comfortable making decisions with incomplete information, adjusting course as new data emerges, and knowing when to ask for help versus when to move forward independently.

• Ownership & Accountability – takes responsibility for the full lifecycle of what you build, including production support, not just initial delivery.

• Strong documentation habits and ability to evangelize best practices across the organization.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

• 8+ years of progressive experience in data engineering, with a track record of leadership and impact.

• Demonstrated experience in implementing or scaling data infrastructure for a data-centric product company.

• Experience participating IN an on-call rotation supporting production data systems.

#LI-JH1#LI-Remote

About us:

the company (NASDAQ: GTM) is the Go-To-Market Intelligence Platform that empowers businesses to grow faster with AI-ready insights, trusted data, and advanced automation. Its solutions provide more than 35,000 companies worldwide with a complete view of their customers, making every seller their best seller.

the company is committed to protecting your privacy when you apply for jobs with us. Please review our Job Applicant Privacy Notice for more details on how we handle your personal information.

the company may use a software-based assessment as part of the recruitment process. More information about this tool, including the results of the most recent bias audit, is available here.

the company is proud to be an equal opportunity employer, hiring based on qualifications, merit, and business needs, and does not discriminate based on protected status. We welcome all applicants and are committed to providing equal employment opportunities regardless of sex, race, age, color, national origin, sexual orientation, gender identity, marital status, disability status, religion, protected military or veteran status, medical condition, or any other characteristic protected by applicable law. We also consider qualified candidates with criminal histories in accordance with legal requirements.

For Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. the company does not administer lie detector tests to applicants in any location.

Find Jobs in United Kingdom on Arbeitnow