Senior Data Engineer: Teradata to BigQuery Pipelines

Fractal Analytics Inc.; California (MO); On-site; USD 140,000 - 150,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Paid holidays

Parental Leave

PTO

Job summary

Fractal is seeking a Senior Data Engineer to join our team in California. You will build scalable data pipelines on Google Cloud Platform, migrating data from Teradata to BigQuery while ensuring data quality and reliability.

Collaborate with analysts, architects, and business stakeholders to translate requirements into robust solutions. The role emphasizes SQL and Python development, ETL/ELT design, and pipeline monitoring, with hands-on experience in GCP services and migration tools.

Qualifications

• Strong SQL and Python skills.
• GCP services including BigQuery, GCS, Composer, Cloud Functions.
• Experience with ETL/ELT pipelines and data workflows.
• Ability to test, validate, and debug data pipelines.
• Knowledge of Teradata-to-GCP mapping concepts.

Responsibilities

• Write efficient, optimized SQL queries to process large datasets.
• Automate repetitive data workflows and reporting processes.
• Build end-to-end data pipelines on Google Cloud Platform.
• Migrate data from Teradata to BigQuery and validate results.
• Implement monitoring, logging, and alerting for pipelines.
• Collaborate with data analysts, architects, and stakeholders.

Skills

SQL

Python

BigQuery

GCP

ETL/ELT

APIs

CI/CD

Git

Data quality

Tools

Storage Transfer Service

gsutil

bq CLI

Cloud Functions

Composer

Job description

Fractal is seeking a Senior Data Engineer to join our team in California. You will build scalable data pipelines on Google Cloud Platform, migrating data from Teradata to BigQuery while ensuring data quality and reliability.

Collaborate with analysts, architects, and business stakeholders to translate requirements into robust solutions. The role emphasizes SQL and Python development, ETL/ELT design, and pipeline monitoring, with hands-on experience in GCP services and migration tools.