Senior Data Engineer – Cloud Data Pipelines (GCP)

Fractal; California (MO); On-site; USD 140,000 - 150,000; Full time

Benefits offered by this job

Health, dental, vision insurance

Life insurance

Disability plans

401(k) plan after 30 days

11 paid holidays

12 weeks Parental Leave

PTO policy

Job summary

Fractal is hiring a Data Engineer to build scalable data infrastructure on Google Cloud Platform. You will migrate data from Teradata to BigQuery, create end-to-end data pipelines, and ensure data quality and integrity across the platform.

Collaboration with analysts, architects, and business stakeholders is essential to translate requirements into production-ready solutions. You will automate workflows, document methodologies, and implement monitoring to ensure reliable data delivery in a

Qualifications

• Proficient in SQL and Python for data extraction and transformation.
• Experience with GCP services: BigQuery, GCS, Composer, Cloud Functions.
• Solid understanding of ETL/ELT data flows and pipeline design.
• Experience with APIs, file-based ingestion, and orchestration tools.
• Ability to test, validate, and debug data pipelines effectively.
• Hands-on with migration tools like Storage Transfer Service, gsutil, and bq CLI.
• Understanding Teradata→GCP mapping concepts.
• Familiarity with CI/CD concepts and Git for code management.
• Knowledge of data security, access controls, and governance.
• Experience with data quality frameworks and reconciliation techniques.

Responsibilities

• Write optimized SQL queries to extract, clean, transform, and analyze large datasets.
• Automate repetitive data workflows and reporting processes.
• Document methodologies, code, and findings for reproducibility.
• Execute migration tasks under guidance of senior engineers.
• Build ingestion scripts, transformation logic, and end-to-end pipelines.
• Support migration of data from Teradata to BigQuery.
• Implement pipeline monitoring, logging, and alerting for reliability.
• Test, validate, and reconcile migrated datasets for data integrity.
• Maintain and update technical documentation and runbooks.
• Collaborate with data analysts, architects, and stakeholders to translate requirements.

Skills

SQL

Python

ETL/ELT design

APIs

Orchestration tools

Testing data pipelines

CI/CD concepts

Git version control

Data security & governance

Data quality & reconciliation

Tools

BigQuery

GCS

Composer

Cloud Functions

Storage Transfer Service

gsutil

bq CLI

Job description

Fractal is hiring a Data Engineer to build scalable data infrastructure on Google Cloud Platform. You will migrate data from Teradata to BigQuery, create end-to-end data pipelines, and ensure data quality and integrity across the platform.

Collaboration with analysts, architects, and business stakeholders is essential to translate requirements into production-ready solutions. You will automate workflows, document methodologies, and implement monitoring to ensure reliable data delivery in a