Software Engineer, Data

Jobtailor; Palo Alto (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

Jobtailor is hiring a data engineer to build and optimize scalable data pipelines on Google Cloud Platform. You will collaborate with cross-functional data teams to model data and deliver reliable data products while mentoring junior engineers.

In this role, you will also contribute to architecture decisions, maintain reusable components, and leverage AI-assisted tools to drive efficiency across data workflows. A strong background in GCP data services and ETL is required.

Qualifications

• Bachelor's degree or equivalent experience in a related field.
• 4+ years of experience in data engineering.
• Experience with GCP data services including BigQuery, Dataform, Dataflow, and Pub/Sub.
• Experience setting up CI/CD pipelines for data processing.
• Experience optimizing data pipeline performance and cost.
• Experience with data modeling and ETL processes.
• Strong understanding of GCP or other hyperscalers (AWS/Azure).
• Strong knowledge of data optimization techniques.
• Programming experience in Python, SQL, or TypeScript.
• Strong understanding of how data solves business problems.

Responsibilities

• Design, develop, and maintain scalable data pipelines using GCP services (Dataform, BigQuery, Dataflow, Pub/Sub).
• Optimize data processing and storage for performance and cost.
• Write comprehensive data quality tests to ensure reliability.
• Collaborate with data teams to implement complex data models.
• Develop reusable data components and shared libraries.
• Mentor junior engineers and provide code review feedback.
• Contribute to technical documentation and architectural decisions.
• Leverage AI tools to improve workflows and efficiency.
• Apply development tools, including AI assistance, to deliver quality code.

Skills

Data Engineering

Data Quality Testing

ETL Processes

Data Modeling

Python Programming

SQL Programming

Typescript Programming

Education

Bachelor's Degree in Computer Science

Bachelor's Degree in Data Science

Bachelor's Degree in Engineering

Tools

BigQuery

Dataform

Dataflow

Pub/Sub

Airflow

CI/CD Pipelines

AWS

Azure

Job description

• Design, develop, and maintain scalable data pipelines using GCP services such as Dataform, BigQuery, and Airflow
• Optimize data processing and storage for performance and cost efficiency
• Write comprehensive data quality tests to ensure data reliability
• Collaborate with data teams to implement complex data models
• Develop reusable data components and shared libraries
• Mentor junior engineers and provide constructive code review feedback
• Contribute to technical documentation and architectural decisions
• Leverage AI tools and technologies to improve workflows, processes, and efficiency
• Apply development tools, including AI assistance, to deliver quality code efficiently

Requirements

• Bachelor's degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience)
• 4+ years of experience in data engineering
• Experience with GCP data services, including BigQuery, Dataform, Dataflow, and Pub/Sub
• Experience setting up CI/CD pipelines for data processing
• Experience optimizing data pipeline performance and cost
• Experience with data modeling and ETL processes
• Strong understanding of GCP or other hyperscalers, including AWS and Azure
• Strong knowledge of data optimization techniques
• Programming experience in Python, SQL, or Typescript
• Strong understanding of how data is applied to solve business problems

Core Competencies

Demonstrates expertise in designing and optimizing scalable data pipelines using GCP services, with a strong focus on data quality, performance, and cost efficiency. Proven ability to mentor junior engineers and contribute to architectural decisions while leveraging AI tools to enhance workflows.

Highest-signal resume keywords

• GCP Data Services
• Data Pipeline Optimization
• Data Modeling
• Python Programming
• CI/CD Pipeline Setup

ATS Optimization Keywords

Hard Skills

• Data Engineering
• Data Quality Testing
• ETL Processes
• Data Optimization Techniques
• SQL Programming
• Typescript Programming
• BigQuery
• Dataform
• Dataflow
• Pub/Sub

Soft Skills

• Mentoring
• Collaboration
• Constructive Feedback
• Technical Documentation

Certifications & Qualifications

• Bachelor's Degree in Computer Science
• Bachelor's Degree in Data Science
• Bachelor's Degree in Engineering

Industry Keywords

• Data Processing
• Data Storage
• Hyperscalers
• Business Problem Solving

Tools & Technologies

• Airflow
• AI Tools
• Development Tools