Data Engineer

YouGov; Stati Uniti; Remoto; USD 120.000 - 180.000; Tempo pieno

Descrizione del lavoro

You will join YouGov’s Data Enablement Team to build and maintain foundational data infrastructure powering decision-making across the company. The role focuses on ingestion, transformation, and modeling of data to ensure clean, reliable datasets accessible through our centralized warehouse.

Utilizing Snowflake, dbt, Python, and Airflow, you’ll enable downstream teams like product, finance, and marketing to own their analytics.

Competenze

• Bachelor’s degree in computer science or related field.
• Proven years of experience in a Data Engineering or Software Engineering role.
• Very good knowledge of Python and experience with SQL.
• Experience with Kubernetes and containerization.
• Experience with Airflow or similar process orchestration tool.
• Familiarity with modern data file formats (Parquet, ORC, JSON).
• Experience with data architecture, modelling, and pipelines in an enterprise data warehouse (Snowflake, Redshift, BigQuery).
• Experience with AWS products (S3, Lambda, Athena).
• Ability to work both independently and in a team-oriented environment.
• Strong analytical skills with a critical thinking attitude.
• Engage in a highly collaborative environment, working closely with data analysts and other team members.
• Experience firsthand the impact of your contributions on the overall success of the team and organization.
• Demonstrable experience as a software or data engineer, demonstrating a good understanding of data architecture and engineering principles.
• You have great communication skills both written and verbal.
• You embrace the YouGov values.

Mansioni

• Design, develop, and maintain robust, scalable data pipelines using Python and Airflow.
• Collaborate with Analytics Engineers and other team members to deliver clean, well-modeled data to downstream users.
• Implement monitoring, logging, and alerting to ensure data pipeline reliability and performance.
• Ensure data quality and integrity through validation frameworks and testing.
• Optimize performance and cost-efficiency of cloud-based data systems.
• Contribute to architectural decisions around data storage, workflow orchestration, and infrastructure as code.
• Document data pipelines and processes

Conoscenze

Python

SQL

Kubernetes

Containerization

Airflow

Data modeling

Data architecture

Formazione

Bachelor's degree in computer science or related field

Strumenti

Snowflake

Redshift

BigQuery

S3

Lambda

Athena

Airflow

DBT

Descrizione del lavoro

Here’s a summary of the role:

The Data Enablement Team is responsible for building and maintaining the foundational data infrastructure that powers decision-making across the company. We focus on the ingestion, transformation, and modeling of data. Our goal is to ensure that our data is clean, reliable, and accessible through our centralized data warehouse.

By delivering well-structured and trusted datasets, we enable downstream teams such as product, finance, and marketing to own their analytics and reporting independently. We use modern tools like Snowflake, dbt, and Python to ensure our data platform is scalable, efficient, and aligned with business needs.

Those in the Data Engineer role are expected to be experienced software engineers with a specialization in data centric programming and tools. The Data Engineer should be comfortable working with a wide variety of data systems, and be able to transform raw datasets into something useful for analysts and data scientists.

A successful member of the data engineering team should stay up to date and knowledgeable about the industry’s newest tools and best practices.

Here’s a breakdown of what you’ll do (not all of it, just the important stuff):

• Design, develop, and maintain robust, scalable data pipelines using Python and Airflow.
• Collaborate with Analytics Engineers and other team members to deliver clean, well-modeled data to downstream users.
• Implement monitoring, logging, and alerting to ensure data pipeline reliability and performance.
• Ensure data quality and integrity through validation frameworks and testing.
• Optimize performance and cost-efficiency of cloud-based data systems.
• Contribute to architectural decisions around data storage, workflow orchestration, and infrastructure as code.
• Document data pipelines and processes

These are the essentials you’ll need to get an interview:

• Bachelor’s degree in computer science or related field
• Proven years of experience in a Data Engineering or Software Engineering role
• Very good knowledge of Python and experience with SQL
• Experience with Kubernetes and containerization
• Experience with Airflow or similar process orchestration tool
• Familiarity with modern data file formats (Parquet, ORC, JSON)
• Experience with data architecture, modelling, and pipelines in an enterprise data warehouse (Snowflake, Redshift, BigQuery)
• Experience with AWS products (S3, Lambda, Athena)
• Ability to work both independently and in a team-oriented environment
• Strong analytical skills with a critical thinking attitude.
• Engage in a highly collaborative environment, working closely with data analysts and other team members.
• Experience firsthand the impact of your contributions on the overall success of the team and organization.
• Demonstrable experience as a software or data engineer, demonstrating a good understanding of data architecture and engineering principles.
• You have great communication skills both written and verbal.
• You embrace the YouGov values

It would be great if you had these to, but we’ll support you if you don’t:

• Experience with a data transformation tool such as DBT
• Experience with NoSQL and Graph Database technologies
• Familiarity with data reporting software (Power BI, Tableau, Apache Superset)
• Experience with R

#LI-AS1

Why join YouGov?
Join our global team to help us achieve our social mission: to make millions of people’s opinions heard for the benefit of our local, national, and international communities.

Understanding diversity of opinion requires diversity of background. Although our global panel of millions of people worldwide powers our research, our biggest asset is our people. If our research is to be truly representative of what the world thinks, we need people from all walks of life to be part of the team to bring their perspective to the work we do.

Life at YouGov
We are driven by a set of shared values. We are fast, fearless, and innovative. We work diligently to get it right. We are guided by accuracy, ethics, and proven methodologies. We respect and trust each other, bringing these values into everything that we do.

We strive to provide YouGovers with best-in-class benefits to support their physical, financial, and emotional wellbeing. We want our employees to have a sense of belonging and uniqueness in a supportive workplace, so they can bring their full selves to work.
Equal Opportunity Employer
As an Equal Opportunity Employer, qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, gender identity or expression, and sexual orientation), parental status, national origin, marital status, age, disability, genetic information, HIV status, political affiliation, socioeconomic background, veteran status or any other characteristic protected by law or in line with our responsibilities as a fair and ethic employer. All employment decisions are made based on occupational qualifications, merit, and business need.

Data Privacy
To find out how we collect and use your personal data when you apply for a role at YouGov, please read our privacy notice at https://jobs.yougov.com/privacy