Senior Data Engineer: GCP/BigQuery Pipelines

Fractal Analytics; United States; On-site; USD 140,000 - 150,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability plan

401(k) after 30 days

11 paid holidays

Parental Leave (12 weeks)

PTO policy

Job summary

Fractal is seeking a Data Engineer to join our team and build scalable, reliable data infrastructure on Google Cloud. You will migrate data from Teradata to BigQuery, develop end-to-end pipelines, and ensure data quality across platforms.

You will collaborate with data analysts, architects, and stakeholders to translate requirements into production-ready solutions, writing efficient SQL and Python, and leveraging GCP tools.

Qualifications

• Strong SQL and Python skills.
• GCP services experience incl. BigQuery, GCS, Composer, Cloud Functions.
• Solid understanding of ETL/ELT data flows and pipeline design.
• Experience working with APIs, file-based ingestion, and orchestration tools.
• Ability to test, validate, and debug data pipelines effectively.
• Hands-on exposure to migration tools such as Storage Transfer Service, gsutil, and bq CLI.
• Understanding of Teradata-to-GCP mapping concepts (e.g., Teradata → GCS, ADF → Composer).
• Familiarity with CI/CD concepts and practices.
• Exposure to version control systems such as Git for code management and collaboration.
• Understanding of data security, access controls, and governance best practices in cloud environments.
• Familiarity with data quality frameworks and reconciliation techniques.
• Good communication and problem-solving skills, with the ability to work independently and in a team setting.

Responsibilities

• Write efficient, optimized SQL queries to extract, clean, transform, and analyze large and complex datasets from multiple sources.
• Automate repetitive data workflows and reporting processes to improve efficiency and reduce manual effort.
• Document methodologies, code, and findings clearly for reproducibility and knowledge sharing.
• Execute migration tasks under the guidance of senior engineers and architects.
• Build ingestion scripts, transformation logic, and end-to-end data pipelines.
• Support migration of data from Teradata to BigQuery.
• Implement pipeline monitoring, logging, and alerting to ensure reliability.
• Support testing, validation, and reconciliation of migrated datasets to ensure data integrity.
• Maintain and update technical documentation and operational runbooks.
• Collaborate with cross-functional teams including data analysts, architects, and business stakeholders to understand requirements.

Skills

SQL

Python

GCP (BigQuery)

ETL/ELT

APIs

CI/CD

Git

Tools

Storage Transfer Service

gsutil

bq CLI

Job description

Fractal is seeking a Data Engineer to join our team and build scalable, reliable data infrastructure on Google Cloud. You will migrate data from Teradata to BigQuery, develop end-to-end pipelines, and ensure data quality across platforms.

You will collaborate with data analysts, architects, and stakeholders to translate requirements into production-ready solutions, writing efficient SQL and Python, and leveraging GCP tools.