Senior Data Engineer - AWS Data Platform & AI Pipelines

Hearst Media Services

Troy (MI)

Hybrid

USD 120,000 - 170,000

Full time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Hearst Media Services (MOTOR Information Systems) seeks a Senior Data Engineer to architect, build, and evolve an AWS-based data platform focused on scalable, reliable data pipelines and products. You will own design decisions around performance, cost, and reliability while collaborating with a cross-functional team in a data-driven automotive domain.

The role requires expert Python/SQL, strong AWS experience, Databricks, Kubernetes, and DevOps practices, with a focus on handling large datasets

Qualifications

Expert Python and SQL development.
Strong AWS experience including Lambda, Glue, Step Functions, Fargate, CloudFormation, and Redshift.
Strong experience with semi-structured data (XML, CSV, JSON, Parquet).
Strong automation experience.
Experience with Databricks, Delta Lake, notebooks, and SQL analytics.
Experience with Kubernetes, including cluster orchestration and pod management.
Experience with DevOps and CI/CD, including Octopus Deploy deployment orchestration.
Experience with agentic AI: LangGraph, MCP servers, and agent frameworks.
Experience with Pandas, NumPy, Apache Spark, and Ray.

Responsibilities

Analyze large, complex data sets to support pipeline and platform decisions.
Design, develop, and coordinate the generation of data pipelines.
Collaborate with the team to plan and solve complex technical problems.
Design for, or optimize existing pipelines, focusing on performance and cost efficiency.