Senior Data Engineer: GCP, ETL & Real-Time Data

Jobtailor; Menomonee Falls (WI); On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor in Wisconsin is seeking a Senior Data Engineer to design, build, and scale cloud-based data ecosystems on GCP. You will develop robust ETL pipelines, optimize data models, and ensure data quality across batch and streaming workloads.

Collaborate with data scientists, product teams, and engineers to implement GenAI-enabled data improvements, enforce PCI/PII compliance, and drive cost-efficient performance. Proven TDD, CI/CD, and XP practices preferred.

Qualifications

• 4+ years of experience in software development.
• Understanding of design patterns, event-driven architecture, databases, schemas, and testing strategies.
• In-depth knowledge of CI/CD and TDD.
• Degree in MIS/CS or related field preferred.

Responsibilities

• Lead development of robust, observable, and measurable applications using XP practices and a user-centric approach.
• Participate in the full application lifecycle with designers, product managers, and engineers.
• Use data, experiments, and best practices to achieve business outcomes.
• Facilitate group discussions and team ceremonies.
• Establish and lead product engineering and software standards.
• Ideate products from user problems into testable solutions.
• Research current technology trends and practices.
• Lead technical initiatives across the team and department.
• Develop, automate, and maintain batch and streaming ETL pipelines.
• Build and manage cloud-based data ecosystems on GCP.
• Design and optimize data models for data lakes and warehouses.
• Implement real-time ingestion and streaming data processing.
• Optimize data performance, scalability, and cost on GCP.
• Ensure PCI and PII data compliance.
• Integrate GenAI tools for data quality and analytics enhancement.
• Collaborate with stakeholders, data scientists, and full-stack engineers to deliver reusable data products.
• Perform additional assigned tasks.

Skills

GCP Cloud Services

ETL Pipeline Development

Data Modeling (SQL, NoSQL)

CI/CD

Event-Driven Architecture

Performance Tuning

Apache Kafka

Data Mesh Principles

Streaming Data Processing

Apache Airflow

Apache Spark

Python

Scala

Education

Bachelor's Degree in MIS, Computer Science, or Related Field

Tools

Apache Airflow

Apache Spark

Python

Scala

BigQuery

MongoDB

Snowflake

Pub/Sub

Dataproc

Bigtable

Job description

Jobtailor in Wisconsin is seeking a Senior Data Engineer to design, build, and scale cloud-based data ecosystems on GCP. You will develop robust ETL pipelines, optimize data models, and ensure data quality across batch and streaming workloads.

Collaborate with data scientists, product teams, and engineers to implement GenAI-enabled data improvements, enforce PCI/PII compliance, and drive cost-efficient performance. Proven TDD, CI/CD, and XP practices preferred.