Data Engineer

Stellar IT Solutions LLC; Minneapolis (MN); Hybrid; USD 110,000 - 140,000; Full time

Job summary

Stellar IT Solutions LLC is seeking a Data Engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform. The role focuses on batch and streaming data, with deep SQL expertise, Airflow orchestration, and Python-based ELT/ETL development to support advertising measurement and retail analytics.

You will work across cross-functional teams to deliver reliable data products, ensure data quality, and optimize performance in a hybrid on-site/off-site setting in Richfield, MN.

Qualifications

• 5+ years of SQL and data engineering experience.
• Hands-on with Apache Airflow (Cloud Composer) and GCP.
• Strong Python for ELT/ETL and data modeling in Big Data environments.

Responsibilities

• Design, build, and operate scalable data pipelines and DAGs for batch and near real-time workloads.
• Develop ELT/ETL processes on GCP services (BigQuery, Dataflow, Pub/Sub) and ensure observability.
• Write advanced SQL for complex transformations and performance tuning; optimize costs.
• Create Python data components, packaging, and CI/CD for deployment to Composer/Dataflow.
• Collaborate with product, analytics, and platform teams to meet security, quality, and SLAs.

Skills

SQL

Apache Airflow

GCP

Python

Big Data

Postgres

Tools

Cloud Composer

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Job description

Overview

Richfield, MN 55423 (Local - Hybrid 2 Days/Week)

12+ Months Contract

Project Description

You will be part of the Myads reporting team responsible for building the measurement, reporting, and insights platform that powers Ads and the broader Retail Media Network. In this role, you will design, develop, and maintain scalable, reliable, and high-performance data solutions that enable advertisers, merchants, and internal teams to measure campaign performance and business impact.

As a Developer, you will build and enhance data pipelines, APIs, and cloud-based services on Google Cloud Platform (GCP) while contributing to the architecture and implementation of measurement platforms. You will collaborate closely with Product Management, Ads Engineering, Analytics, Data Science, and other cross-functional teams to deliver high-quality solutions that meet business needs and support growth objectives. You will participate in the full software development lifecycle, including design, implementation, testing, deployment, and ongoing optimization of data and measurement systems. This role is hybrid, which means you will work some days on site at the client\'s location and some days virtually from home.

Position Summary / Job Description

Hire an experienced Data Engineer to design, build, and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise, production grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL, with exposure to Postgres.

Skills Overview

• SQL (5+ years)
• Apache Airflow (Cloud Composer) (3+ years)
• GCP (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ years)
• Python (5+ years)
• Big Data (warehousing/processing concepts, performance)(5+ years)
• Postgres (3+)

Experience

• Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
• Build ELT/ETL on GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.
• Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.
• Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.
• Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
• Integrate Postgres sources/targets
• Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.

Nice to have / Preferred Skills

• Experience in ads domain is a plus.
• Ability to talk with stakeholders to understand problems and solve them efficiently.
• Preventing data quality issues before they impact users.
• Prioritizing projects and handling multiple requests.