Senior Data Engineer – GCP Pipelines & AI-Driven Data

Jobtailor; Palo Alto (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

Jobtailor is hiring a data engineer to build and optimize scalable data pipelines on Google Cloud Platform. You will collaborate with cross-functional data teams to model data and deliver reliable data products while mentoring junior engineers.

In this role, you will also contribute to architecture decisions, maintain reusable components, and leverage AI-assisted tools to drive efficiency across data workflows. A strong background in GCP data services and ETL is required.

Qualifications

• Bachelor's degree or equivalent experience in a related field.
• 4+ years of experience in data engineering.
• Experience with GCP data services including BigQuery, Dataform, Dataflow, and Pub/Sub.
• Experience setting up CI/CD pipelines for data processing.
• Experience optimizing data pipeline performance and cost.
• Experience with data modeling and ETL processes.
• Strong understanding of GCP or other hyperscalers (AWS/Azure).
• Strong knowledge of data optimization techniques.
• Programming experience in Python, SQL, or TypeScript.
• Strong understanding of how data solves business problems.

Responsibilities

• Design, develop, and maintain scalable data pipelines using GCP services (Dataform, BigQuery, Dataflow, Pub/Sub).
• Optimize data processing and storage for performance and cost.
• Write comprehensive data quality tests to ensure reliability.
• Collaborate with data teams to implement complex data models.
• Develop reusable data components and shared libraries.
• Mentor junior engineers and provide code review feedback.
• Contribute to technical documentation and architectural decisions.
• Leverage AI tools to improve workflows and efficiency.
• Apply development tools, including AI assistance, to deliver quality code.

Skills

Data Engineering

Data Quality Testing

ETL Processes

Data Modeling

Python Programming

SQL Programming

Typescript Programming

Education

Bachelor's Degree in Computer Science

Bachelor's Degree in Data Science

Bachelor's Degree in Engineering

Tools

BigQuery

Dataform

Dataflow

Pub/Sub

Airflow

CI/CD Pipelines

AWS

Azure

Job description

Jobtailor is hiring a data engineer to build and optimize scalable data pipelines on Google Cloud Platform. You will collaborate with cross-functional data teams to model data and deliver reliable data products while mentoring junior engineers.

In this role, you will also contribute to architecture decisions, maintain reusable components, and leverage AI-assisted tools to drive efficiency across data workflows. A strong background in GCP data services and ETL is required.